the open
    research
    Contribute
    Back to the reading lists

    Reinforcement learning· 1999

    Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

    Richard S. Sutton (first author) · 1999

    Read the original

    DOI 10.1016/s0004-3702(99)00052-1OpenAlex W2109910161

    On the reading lists

    Why it matters

    Formalized options, enabling temporally extended actions and hierarchical reinforcement learning.

    Condensed from the expert lists' notes.

    The record

    First released
    1999 (from OpenAlex)
    Citations
    3,119 citations, as counted by OpenAlex (CC0)
    Named by
    the chatgpt list only
    Score
    0.347 · computed rank 486 · consensus 0.38, must-read 0, citations percentile 0.667 (1990s · reinforcement-learning), awards 0, existing lists 0. Method

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.