Markov Decision Processes with a New Optimality Criterion: Discrete Time

JOURNAL ARTICLE published 1 May 1973 in The Annals of Statistics

Authors: Stratton C. Jaquette

Markov Decision Processes with a New Optimality Criterion: Continuous Time

JOURNAL ARTICLE published 1 March 1975 in The Annals of Statistics

Authors: Stratton C. Jaquette

Markov Decision Processes with a New Optimality Criterion: Small Interest Rates

JOURNAL ARTICLE published December 1972 in The Annals of Mathematical Statistics

Authors: Stratton C. Jaquette

Blackwell optimality in Markov decision processes with partial observation

JOURNAL ARTICLE published 1 August 2002 in The Annals of Statistics

Authors: Dinah Rosenberg | Eilon Solan | Nicolas Vieille

Strong average optimality criterion for continuous-time Markov decision processes

JOURNAL ARTICLE published 2 January 2015 in Kybernetika

Authors: Qingda Wei | Xian Chen

A Utility Criterion for Markov Decision Processes

JOURNAL ARTICLE published September 1976 in Management Science

Authors: Stratton C. Jaquette

Optimality Conditions for CTMDP with Average Cost Criterion

BOOK CHAPTER published 2002 in Markov Processes and Controlled Markov Chains

Authors: Xianping Guo | Weiping Zhu

A Random Time Change Relating Semi-Markov and Markov Processes

JOURNAL ARTICLE published April 1968 in The Annals of Mathematical Statistics

Authors: James Yackel

On the Optimality Criterion in Compound Decision Problems

JOURNAL ARTICLE published 1 May 1975 in The Annals of Statistics

Authors: Susan D. Horn

Discrete-Time Spectral Estimation of Continuous-Time Processes-The Orthogonal Series Method

JOURNAL ARTICLE published 1 September 1980 in The Annals of Statistics

Authors: E. Masry

The Expected Total Cost Criterion

BOOK CHAPTER published 1999 in Further Topics on Discrete-Time Markov Control Processes

Authors: Onésimo Hernández-Lerma | Jean Bernard Lasserre

An Optimality Property of Scheffe Bounds

JOURNAL ARTICLE published 1 July 1973 in The Annals of Statistics

Authors: Robert Bohrer

Discrete-Time Controlled Markov Processes With Average Cost Criterion: A Survey

REPORT published 31 March 1992

Authors: Aristotle Arapostathis | Vivek S. Borkar | Emmanuel Fernandez-Gaucherand | Mrinal K. Ghosh | Steven I. Marcus

Random Time Transformations of Semi-Markov Processes

JOURNAL ARTICLE published February 1971 in The Annals of Mathematical Statistics

Authors: Richard F. Serfozo

Discrete-Time, Finite-State Markov Chains

BOOK CHAPTER published 9 February 2015 in Markov Processes

VMDP-program for solving optimality problems in vector criterion Markov and semi-Markov decision processes

JOURNAL ARTICLE published January 1991 in Optimization

Authors: J. Novák

Average optimality for continuous-time Markov decision processes in Polish spaces

JOURNAL ARTICLE published 1 May 2006 in The Annals of Applied Probability

Authors: Xianping Guo | Ulrich Rieder

Continuous Time Control of Markov Processes on an Arbitrary State Space: Discounted Rewards

JOURNAL ARTICLE published 1 November 1976 in The Annals of Statistics

Authors: Bharat T. Doshi

A New Optimality Criterion for Nonhomogeneous Markov Decision Processes

JOURNAL ARTICLE published December 1987 in Operations Research

Authors: Wallace J. Hopp | James C. Bean | Robert L. Smith

Discrete-Time, Innite-State Markov Chains

BOOK CHAPTER published 9 February 2015 in Markov Processes