Hahsler M (2025). markovDP: Infrastructure for Discrete-Time Markov Decision Processes (MDP). R package version 0.99.0, https://github.com/mhahsler/markovDP.

Corresponding BibTeX entry:

  @Manual{,
    title = {markovDP: Infrastructure for Discrete-Time Markov Decision
      Processes (MDP)},
    author = {Michael Hahsler},
    year = {2025},
    note = {R package version 0.99.0},
    url = {https://github.com/mhahsler/markovDP},
  }