Attention Is All You Need
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
Vaswani et al.
The open catalogue
A starting point for understanding AI. Explore the ideas, examine the evidence, and make up your own mind.
3 papers in the starter collection
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
From noise to structure. Understand the surprisingly simple idea behind a generation of image models.
Learning representations from both directions of a sentence, then adapting them to language understanding tasks.
This is the beginning of the library.
Help us decide what belongs here next.