Embedding of Urn Schemes into Continuous Time Markov Branching Processes and Related Limit Theorems

JOURNAL ARTICLE published December 1968 in The Annals of Mathematical Statistics

Authors: Krishna B. Athreya | Samuel Karlin

A Markov Chain Derivation of Discrete Distributions

JOURNAL ARTICLE published December 1952 in The Annals of Mathematical Statistics

Authors: F. G. Foster

Optimality and Almost Optimality of Mixture Stopping Rules

JOURNAL ARTICLE published 1 July 1978 in The Annals of Statistics

Authors: Moshe Pollak

Chapter 8. Large deviations for markov processes

BOOK CHAPTER published 31 December 1993 in Large Deviations for Discrete-Time Processes with Averaging

Optimization of parametric policies of Markov decision processes under a variance criterion

PROCEEDINGS ARTICLE published May 2016 in 2016 13th International Workshop on Discrete Event Systems (WODES)

Authors: Li Xia

On Transient Markov Chains with Application to the Uniqueness Problem for Markov Processes

JOURNAL ARTICLE published June 1957 in The Annals of Mathematical Statistics

Authors: Leo Breiman

Adaptive control for discrete-time Markov processes with unbounded costs: Average criterion

JOURNAL ARTICLE published September 1998 in Mathematical Methods of Operations Research

Authors: Evgueni I. Gordienko | J. Adolfo Minjárez-Sosa

Discrete-Time Markov Control Processes

BOOK published 1996

Authors: Onésimo Hernández-Lerma | Jean Bernard Lasserre

Discrete-Time Markov Chains

BOOK CHAPTER published 3 September 2018 in Applied Probability and Stochastic Processes

Authors: Frank Beichelt

Markov Renewal Processes with Auxiliary Paths

JOURNAL ARTICLE published October 1970 in The Annals of Mathematical Statistics

Authors: Manfred Schal

Asymptotic Inference in Markov Processes

JOURNAL ARTICLE published June 1965 in The Annals of Mathematical Statistics

Authors: G. G. Roussas

Causal inference for continuous-time processes when covariates are observed only at discrete times

JOURNAL ARTICLE published 1 February 2011 in The Annals of Statistics

Authors: Mingyuan Zhang | Marshall M. Joffe | Dylan S. Small

New tests of optimality in Markov decision processes

PROCEEDINGS ARTICLE published in Proceedings of 1994 33rd IEEE Conference on Decision and Control

Authors: J.B. Lasserre

Occupation measures for controlled Markov processes: characterization and optimality

JOURNAL ARTICLE published 1 July 1996 in The Annals of Probability

Authors: Abhay G. Bhatt | Vivek S. Borkar

An Optimality Condition for Discrete Dynamic Programming with no Discounting

JOURNAL ARTICLE published August 1968 in The Annals of Mathematical Statistics

Authors: E. V. Denardo | B. L. Miller

Non-Markov Processes in Continuous Time with Discrete State Spaces

BOOK CHAPTER published 1974 in Stochastic Processes

Authors: Rodney Coleman

On Stochastic Processes Derived From Markov Chains

JOURNAL ARTICLE published August 1965 in The Annals of Mathematical Statistics

Authors: Alex Heller

Denumerable State Markovian Decision Processes-Average Cost Criterion

JOURNAL ARTICLE published December 1966 in The Annals of Mathematical Statistics

Authors: Cyrus Derman

New discount and average optimality conditions for continuous-time Markov decision processes

JOURNAL ARTICLE published December 2010 in Advances in Applied Probability

Authors: Xianping Guo | Liuer Ye

Invariant Measures on Some Markov Processes

JOURNAL ARTICLE published October 1971 in The Annals of Mathematical Statistics

Authors: Y. S. Yang