Back to the reading lists

    Machine learning foundations· 2025

    Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

    Zihan Qiu (first author) · 2025

    Read the original

    DOI 10.52202/085713-3345arXiv 2505.06708OpenAlex W4417514206

    On the reading lists

    The record

    First released
    2025 (from arXiv 2505.06708)
    Citations
    351 citations, as counted by Papers With Code (CC BY-SA 4.0)
    Named by
    the chatgpt list only
    Score
    0.274 · computed rank 671 · consensus 0.175, must-read 0, citations percentile 0.632 (2020s · foundations), awards 0, existing lists 0. Method

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.