To cite package ‘markovDP’ in publications use:

  Hahsler M (2024). _markovDP: Infrastructure for Discrete-Time Markov
  Decision Processes (MDP)_. R package version 0.99.0,
  <https://github.com/mhahsler/markovDP>.

A BibTeX entry for LaTeX users is

  @Manual{,
    title = {markovDP: Infrastructure for Discrete-Time Markov Decision Processes (MDP)},
    author = {Michael Hahsler},
    year = {2024},
    note = {R package version 0.99.0},
    url = {https://github.com/mhahsler/markovDP},
  }