One Team That Gave Rise to a Paper That Changed the Whole Industry
The Google Brain team Dean led gathered many top researchers in deep learning, and in 2017 eight researchers within the team jointly published the "Attention Is All You Need" paper, proposing the Transformer architecture wholly based on self-attention, a paper that thereafter became not only the technical basis of Google’s own models such as BERT and PaLM but also directly inspired OpenAI’s GPT series, becoming the acknowledged common technical foundation of the whole large-language-model industry, its influence far beyond anyone’s expectation at publication.