Tag: #transformer

• GPT-4: the flagship that raised the bar (2023)

  2023-03-14

  History Systems

  OpenAI's GPT-4 could read images as well as text and scored well on exams built for humans, cementing a fierce commercial race, and a secrecy that unsettled researchers.

• GPT-3: when scale became the strategy (2020)

  2020-07-28

  History Research

  OpenAI's 175-billion-parameter model showed that a big enough language model could learn new tasks from a few examples in the prompt, no retraining required.

• "Attention is all you need": the Transformer arrives (2017)

  2017-06-12

  History Research

  A 2017 paper replaced the sequential machinery of earlier networks with pure attention. The Transformer became the architecture behind almost every large language model since.