Attention Is All You Need
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
Vaswani et al.
The open catalogue
A starting point for understanding AI. Explore the ideas, examine the evidence, and make up your own mind.
3 papers in the starter collection
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
Learning representations from both directions of a sentence, then adapting them to language understanding tasks.
An exploration of what a large language model can learn from a handful of examples in its context.
This is the beginning of the library.
Help us decide what belongs here next.