Package: markovDP
Title: Infrastructure for Discrete-Time Markov Decision Processes (MDP)
Version: 0.99.0
Date: 2024-08-29
Authors@R: 
    person("Michael", "Hahsler", , "mhahsler@lyle.smu.edu", role = c("aut", "cph", "cre"),
           comment = c(ORCID = "0000-0003-2716-1405"))
Description: Provides the infrastructure to work with Markov Decision
        Processes (MDPs) in R. The focus is on convenience in
        formulating MDPs, the support of sparse representations (using
        sparse matrices, lists and data.frames) and visualization of
        results. Some key components are implemented in C++ to speed up
        computation. Several popular solvers are implemented.
License: GPL (>=3)
URL: https://github.com/mhahsler/markovDP
BugReports: https://github.com/mhahsler/markovDP/issues
Depends: R (>= 3.5.0)
Imports: fastmap, foreach, igraph, lpSolve, Matrix, MatrixExtra,
        methods, progress, Rcpp, stats
Suggests: doParallel, gifski, knitr, rmarkdown, testthat, visNetwork
LinkingTo: Rcpp
VignetteBuilder: knitr
Classification/ACM: G.4, G.1.6, I.2.6
Copyright: Copyright (C) Michael Hahsler.
Encoding: UTF-8
Roxygen: list(markdown = TRUE)
RoxygenNote: 7.3.2
SystemRequirements: C++17
Collate: 'AAA_check_installed.R' 'AAA_colors.R' 'AAA_foreach_helper.R'
        'AAA_near_equal.R' 'AAA_nodots.R' 'AAA_package.R'
        'AAA_progress.R' 'AAA_sample_sparse.R' 'AAA_shorten.R'
        'AAA_which_max_random.R' 'Cliff_walking.R' 'DynaMaze.R' 'MDP.R'
        'MDPSample.R' 'Maze.R' 'Q_values.R' 'RcppExports.R'
        'Windy_gridworld.R' 'absorbing_states.R'
        'accessors_transitions.R' 'accessors_reward.R' 'accessors.R'
        'act.R' 'action.R' 'action_state_helpers.R'
        'available_actions.R' 'bellman_operator.R'
        'check_and_fix_MDP.R' 'convergence_horizon.R'
        'find_reachable_states.R' 'greedy.R' 'gridworld.R'
        'linear_function_approximation.R' 'policy.R'
        'policy_evaluation.R' 'policy_evaluation_LP.R'
        'policy_evaluation_MC.R' 'policy_evaluation_bellman.R'
        'reachable_states.R' 'regret.R' 'reward.R'
        'round_stochchastic.R' 'sample_MDP.R' 'sample_MDPSample.R'
        'schedule.R' 'solve_MDP.R' 'solve_MDP_APPROX.R'
        'solve_MDP_DP.R' 'solve_MDP_LP.R' 'solve_MDP_MC.R'
        'solve_MDP_PG.R' 'solve_MDP_SAMP.R' 'solve_MDP_TD.R'
        'sparse_helpers.R' 'start.R' 'transformation.R'
        'transition_graph.R' 'unreachable_states.R' 'value_function.R'
        'visit_probability.R' 'zzz.R'
Config/pak/sysreqs: libglpk-dev libxml2-dev
Repository: https://mhahsler.r-universe.dev
Date/Publication: 2025-07-21 19:37:59 UTC
RemoteUrl: https://github.com/mhahsler/markovDP
RemoteRef: HEAD
RemoteSha: e8ab3f595ec64fc5e97be7b5faec9dea0126a505
NeedsCompilation: yes
Packaged: 2026-07-02 08:06:17 UTC; root
Author: Michael Hahsler [aut, cph, cre] (ORCID:
    <https://orcid.org/0000-0003-2716-1405>)
Maintainer: Michael Hahsler <mhahsler@lyle.smu.edu>