the open
    research
    Contribute
    Back to the reading lists

    Deep learning· 2017

    Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

    Noam Shazeer (first author) · 2017

    Read the original

    arXiv 1701.06538OpenAlex W2581624817

    On the reading lists

    Why it matters

    Established practical sparse expert routing, enabling massive model capacity without proportional computation.

    Condensed from the expert lists' notes.

    The record

    First released
    2017 (from arXiv 1701.06538)
    Citations
    5,951 citations, as counted by Papers With Code (CC BY-SA 4.0)
    Named by
    both expert lists
    Also relevant to
    Language, speech & LLMs
    Score
    0.595 · computed rank 155 · consensus 0.85, must-read 1, citations percentile 0.686 (2010s · deep-learning), awards 0, existing lists 0. Method

    Editor's notes

    • Readability check: pass: Mixture-of-experts, explained clearly. (AI draft (Claude), not yet reviewed, 2026-10-29)

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.