Scaling Laws for Neural Language Models
How model size, data, and compute shape performance—and why the assumptions behind a scaling curve matter.
Kaplan et al.
The open catalogue
A starting point for understanding AI. Explore the ideas, examine the evidence, and make up your own mind.
2 papers in the starter collection
How model size, data, and compute shape performance—and why the assumptions behind a scaling curve matter.
An exploration of what a large language model can learn from a handful of examples in its context.
This is the beginning of the library.
Help us decide what belongs here next.