the open
    research
    Contribute
    Back to the reading lists

    Reinforcement learning· 1994

    Markov Decision Processes: Discrete Stochastic Dynamic Programming

    Puterman (first author) · 1994

    Read the original

    DOI 10.2307/2291177OpenAlex W2119567691

    On the reading lists

    Why it matters

    Canonical MDP theory reference.

    Condensed from the expert lists' notes.

    The record

    First released
    1994 (from oracle lists)
    Citations
    8,037 citations, as counted by OpenAlex (CC0)
    Named by
    the grok list only
    Score
    0.331 · computed rank 527 · consensus 0.13, must-read 0, citations percentile 0.833 (1990s · reinforcement-learning), awards 0, existing lists 0. Method

    Data sources

    Catalogue data from OpenAlex (CC0), Crossref (CC0 metadata; no abstracts are shown), arXiv, and Papers With Code (CC BY-SA 4.0). Each count names its source. See the method.