Language, speech & LLMs· 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding
On the reading lists
- #381 in the Top 500 (2026 edition)
- #59 in Language, speech & LLMs (2026 edition)
Why it matters
Permutation language modeling captures bidirectional context without masking.
Condensed from the expert lists' notes.
The record
- First released
- 2019 (from arXiv 1906.08237)
- Citations
- 9,600 citations, as counted by Papers With Code (CC BY-SA 4.0)
- Named by
- both expert lists
- Score
- 0.390 · computed rank 381 · consensus 0.315, must-read 0, citations percentile 0.844 (2010s · language), awards 0, existing lists 0. Method
Data sources
Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.