Criteria for ergodicity, exponential ergodicity and strong ergodicity of Markov processes

JOURNAL ARTICLE published March 1981 in Journal of Applied Probability

Authors: R. L. Tweedie

Markov Decision Processes

REFERENCE ENTRY published in SpringerReference

A Generalization of Semi-Markov Processes

BOOK CHAPTER published 1999 in Semi-Markov Models and Applications

Authors: Marius Iosifescu

A Second bibliography on semi-Markov processes

BOOK CHAPTER published 1986 in Semi-Markov Models

Authors: Jozef L. Teugels

Piecewise Deterministic Markov Processes and Semi-Dynamic Systems

BOOK CHAPTER published 2002 in Markov Processes and Controlled Markov Chains

Authors: Guoxin Liu

Event coupling and performance sensitivity analysis of generalized semi-Markov processes

JOURNAL ARTICLE published September 1995 in Advances in Applied Probability

Authors: Xi-Ren Cao

Central limit theorems for multivariate semi-Markov sequences and processes, with applications

JOURNAL ARTICLE published June 1999 in Journal of Applied Probability

Authors: Frank Ball

Martingale Approach to Limit Theorems for Semi–Markov Processes

JOURNAL ARTICLE published January 1990 in Theory of Probability & Its Applications

Authors: M. N. Sviridenko

Structural results for Markov decision processes

BOOK CHAPTER published 21 March 2016 in Partially Observed Markov Decision Processes

A Theory for Semi-Markov Decision Processes with Unbounded Costs and Its Application to the Optimal Control of Queueing Systems

REPORT published 1 August 1976

Authors: Peter Orkenyi

Semi-Markov process

BOOK CHAPTER published 2015 in Semi-Markov Processes: Applications in System Reliability and Maintenance

Authors: Franciszek Grabski

Partially observable Markov decision processes for spoken dialog systems

JOURNAL ARTICLE published April 2007 in Computer Speech & Language

Authors: Jason D. Williams | Steve Young

General optimal stopping theorems for semi-Markov processes

JOURNAL ARTICLE published December 1993 in Advances in Applied Probability

Authors: Frans A. Boshuizen | José M. Gouweleeuw

Truncation approximation of the limit probabilities for denumerable semi-Markov processes

JOURNAL ARTICLE published March 1975 in Journal of Applied Probability

Authors: Richard L. Tweedie

On the exit time from open sets of some semi-Markov processes

JOURNAL ARTICLE published 1 June 2020 in The Annals of Applied Probability

Authors: Giacomo Ascione | Enrica Pirozzi | Bruno Toaldo

Markov Renewal Processes

BOOK CHAPTER published 2001 in Semi-Markov Processes and Reliability

Authors: N. Limnios | G. Oprişan

Insensitive average residence times in generalized semi-Markov processes

JOURNAL ARTICLE published December 1981 in Advances in Applied Probability

Authors: A. D. Barbour | R. Schassberger

Non-homogeneous semi-Markov reward processes and their numerical aspects

JOURNAL ARTICLE published December 1985 in Stochastic Processes and their Applications

$I$-Projection and Conditional Limit Theorems for Discrete Parameter Markov Processes

JOURNAL ARTICLE published 1 April 1993 in The Annals of Probability

Authors: Carolyn Schroeder

Semi-Markov decision processes with a reachable state-subset

JOURNAL ARTICLE published January 1989 in Optimization

Authors: M. Kurano