Scaling Laws for Neural Language Models
How model size, data, and compute shape performance—and why the assumptions behind a scaling curve matter.
Kaplan et al.
The open catalogue
A starting point for understanding AI. Explore the ideas, examine the evidence, and make up your own mind.
3 papers in the starter collection
How model size, data, and compute shape performance—and why the assumptions behind a scaling curve matter.
A landmark approach to predicting three-dimensional protein structure from sequence information.
Treat an image as a sequence of patches, and revisit the role of convolution in visual recognition.
This is the beginning of the library.
Help us decide what belongs here next.