Metadata Search Funding Data Link References Status API Help
Facet browsing currently unavailable
Page 1 of 847 results
Sort by: relevance publication year

Sample-Path Optimality in Average Markov Decision Chains Under a Double Lyapunov Function Condition

BOOK CHAPTER published 2012 in Optimization, Control, and Applications of Stochastic Systems

Authors: Rolando Cavazos-Cadena | Raúl Montes-de-Oca

Markov Decision Processes

BOOK CHAPTER published in Stochastic Modelling and Applied Probability

A Tauberian Theorem and Uniform ∈-Optimality in Hidden Markov Decision Problems

BOOK CHAPTER published 31 May 2022 in A Course in Stochastic Game Theory

On lexicographical optimality criteria in controlled markov chains

BOOK CHAPTER published in Lecture Notes in Control and Information Sciences

Authors: G. I. Mirzashvili

Markov chains

BOOK CHAPTER published 27 February 2014 in Stochastic Networks

On the ergodic theory of critical branching Markov chains

JOURNAL ARTICLE published March 1994 in Stochastic Processes and their Applications

Authors: J.T Cox

STRONG AVERAGE OPTIMALITY FOR CONTROLLED NONHOMOGENEOUS MARKOV CHAINS*

JOURNAL ARTICLE published 21 February 2001 in Stochastic Analysis and Applications

Authors: Xianping Guo | Peng Shi | Weiping Zhu

Time changes of Markov chains

JOURNAL ARTICLE published August 1982 in Stochastic Processes and their Applications

Authors: A.O. Pittenger

Markov chains with almost exponential hitting times

JOURNAL ARTICLE published September 1982 in Stochastic Processes and their Applications

Authors: David J. Aldous

Finite-state Markov chains

BOOK CHAPTER published in Stochastic Processes

Countable-state Markov chains

BOOK CHAPTER published in Stochastic Processes

Markov models

BOOK CHAPTER published 2 April 2009 in Markov Chains and Stochastic Stability

Markov chains

BOOK CHAPTER published 24 February 2017 in Stochastic Processes

Markov Chains

BOOK CHAPTER published 1974 in Stochastic Processes

Authors: Rodney Coleman

Constrained Optimality for First Passage Criteria in Semi-Markov Decision Processes

BOOK CHAPTER published 2012 in Optimization, Control, and Applications of Stochastic Systems

Authors: Yonghui Huang | Xianping Guo

Crash Course on Conditional Markov Chains and on Doubly Stochastic Markov Chains

OTHER published 31 August 2020 in Structured Dependence between Stochastic Processes

7. Markov Chains: Continuous Parameter

BOOK CHAPTER published January 1999 in Stochastic Processes

6. Markov Chains: Discrete Parameter

BOOK CHAPTER published January 1999 in Stochastic Processes

Markov chains

BOOK CHAPTER published 24 February 2011 in Stochastic Population Processes

Authors: Eric Renshaw

Discrete time Markov chains

BOOK CHAPTER published 22 July 2013 in Applied Stochastic Processes