Attention Is All You Need
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
Vaswani et al.
The open catalogue
A starting point for understanding AI. Explore the ideas, examine the evidence, and make up your own mind.
3 papers in the starter collection
The architecture that changed how we build language models. A closer look at attention, parallelism, and what makes a Transformer work.
Learning representations from both directions of a sentence, then adapting them to language understanding tasks.
Treat an image as a sequence of patches, and revisit the role of convolution in visual recognition.
This is the beginning of the library.
Help us decide what belongs here next.