To cite package ‘markovDP’ in publications use: Hahsler M (2024). _markovDP: Infrastructure for Discrete-Time Markov Decision Processes (MDP)_. R package version 0.99.0, . A BibTeX entry for LaTeX users is @Manual{, title = {markovDP: Infrastructure for Discrete-Time Markov Decision Processes (MDP)}, author = {Michael Hahsler}, year = {2024}, note = {R package version 0.99.0}, url = {https://github.com/mhahsler/markovDP}, }