the open
    research
    Contribute
    Back to the reading lists

    Computer vision & multimodal· 2021

    BEiT: BERT Pre-Training of Image Transformers

    Hangbo Bao (first author) · 2021

    Read the original

    arXiv 2106.08254OpenAlex W3170863103

    On the reading lists

    Why it matters

    Transferred BERT-style masked token prediction into vision transformer pretraining.

    Condensed from the expert lists' notes.

    The record

    First released
    2021 (from arXiv 2106.08254)
    Citations
    3,960 citations, as counted by Papers With Code (CC BY-SA 4.0)
    Named by
    both expert lists
    Score
    0.388 · computed rank 383 · consensus 0.63, must-read 0, citations percentile 0.568 (2020s · vision), awards 0, existing lists 0. Method

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.