Recurrence conditions for Markov decision processes with Borel state space: A survey

JOURNAL ARTICLE published December 1991 in Annals of Operations Research

Authors: Onésimo Hernández-Lerma | RaÚl Montes-De-Oca | Rolando Cavazos-Cadena

Nonstationary Markov decision processes and related topics in nonstationary Markov chains

DISSERTATION published

Authors: Bruce Lee Bowerman

Discrete-Time, Finite-State Markov Chains

BOOK CHAPTER published 9 February 2015 in Markov Processes

Time-varying Markov decision processes with state-action-dependent discount factors and unbounded costs

JOURNAL ARTICLE published 13 March 2019 in Kybernetika

Authors: Beatris A. Escobedo-Trujillo | Carmen G. Higuera-Chan

Approximation of average cost optimal policies for general Markov decision processes with unbounded costs

JOURNAL ARTICLE published June 1997 in Mathematical Methods of Operations Research

Authors: Evgueni Gordienko | Ra�l Montes-De-Oca | Adolfo Minj�rez-Sosa

Deterministic Discounted Markov Decision Processes with Fuzzy Rewards/Costs

JOURNAL ARTICLE published September 2023 in Fuzzy Information and Engineering

Authors: Hugo Cruz-Suárez | Raúl Montes-de-Oca | R. Israel Ortega-Gutiérrez

A Markov Decision Process (MDP)

BOOK CHAPTER published 19 April 2016 in Markov Chains and Decision Processes for Engineers and Managers

Markov Decision Processes

BOOK CHAPTER published in Stochastic Modelling and Applied Probability

Discrete-Time, Innite-State Markov Chains

BOOK CHAPTER published 9 February 2015 in Markov Processes

A note on deterministic approximation of discounted Markov decision processes

JOURNAL ARTICLE published August 2009 in Applied Mathematics Letters

Authors: Hugo Cruz-Suárez | Evgueni Gordienko | Raúl Montes-de-Oca

The exponential cost optimality for finite horizon semi-Markov decision processes

JOURNAL ARTICLE published 17 August 2022 in Kybernetika

Authors: Haifeng Huo | Xian Wen

First passage risk probability optimality for continuous time Markov decision processes

JOURNAL ARTICLE published 10 March 2019 in Kybernetika

Authors: Haifeng Huo | Xian Wen

Average Optimality for Adaptive Markov Control Processes with Unbounded Costs and Unknown Disturbance Distribution

BOOK CHAPTER published 2002 in Markov Processes and Controlled Markov Chains

Authors: J. Adolfo Minjárez-Sosa

Mean-variance optimality for semi-Markov decision processes under first passage criteria

JOURNAL ARTICLE published 30 March 2017 in Kybernetika

Authors: Xiangxiang Huang | Yonghui Huang

AVERAGE COST SEMI-MARKOV DECISION PROCESSES

REPORT published 1 September 1969

Authors: Sheldon M. Ross

Interval Methods for Uncertain Markov Decision Processes

BOOK CHAPTER published 2002 in Markov Processes and Controlled Markov Chains

Authors: Masami Kurano | Masami Yasuda | Jun-ichi Nakagami

Markov Chain Structure and Models

BOOK CHAPTER published 19 April 2016 in Markov Chains and Decision Processes for Engineers and Managers

Constrained optimality problem of Markov decision processes with Borel spaces and varying discount factors

JOURNAL ARTICLE published 26 May 2021 in Kybernetika

Authors: Xiao Wu | Yanqiu Tang

Denumerable controlled Markov chains with strong average optimality criterion: bounded and unbounded costs

PROCEEDINGS ARTICLE published in Proceedings of 1994 33rd IEEE Conference on Decision and Control

Authors: R. Cavazos-Cadena | E. Fernandez-Gaucherand

Average cost Markov control processes: stability with respect to the Kantorovich metric

JOURNAL ARTICLE published August 2009 in Mathematical Methods of Operations Research

Authors: Evgueni Gordienko | Enrique Lemus-Rodríguez | Raúl Montes-de-Oca