the open
    research
    Contribute
    Back to the reading lists

    Deep learning· 2023

    FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

    Tri Dao (first author) · 2023

    Read the original

    arXiv 2307.08691OpenAlex W4384648639

    On the reading lists

    Why it matters

    Improved GPU occupancy and work partitioning, substantially accelerating exact attention kernels.

    Condensed from the expert lists' notes.

    The record

    First released
    2023 (from arXiv 2307.08691)
    Citations
    3,489 citations, as counted by Papers With Code (CC BY-SA 4.0)
    Named by
    both expert lists
    Score
    0.430 · computed rank 319 · consensus 0.45, must-read 0, citations percentile 0.844 (2020s · deep-learning), awards 0, existing lists 0. Method

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.