Metadata Search Funding Data Link References Status API Help
Facet browsing currently unavailable
Page 4 of 266 results
Sort by: relevance publication year

Convergence of Atomic Markov Chains

BOOK CHAPTER published 2018 in Springer Series in Operations Research and Financial Engineering

Authors: Randal Douc | Eric Moulines | Pierre Priouret | Philippe Soulier

Special Topics: State Reduction and Hidden Markov Chains

BOOK CHAPTER published 19 April 2016 in Markov Chains and Decision Processes for Engineers and Managers

Upper Bounds III: Sufficient Conditions

BOOK CHAPTER published 31 July 2022 in Large Deviations for Markov Chains

Eigenvalues

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Average Reward Stochastic Games

BOOK CHAPTER published 1997 in Competitive Markov Decision Processes

Authors: Jerzy Filar | Koos Vrieze

Markov Decision Processes

BOOK CHAPTER published in Stochastic Modelling and Applied Probability

Background material

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Average Reward Optimization Theory for Denumerable State Spaces

BOOK CHAPTER published 2002 in International Series in Operations Research & Management Science

Authors: Linn I. Sennott

Markov Decision Problems

BOOK CHAPTER published 1998 in Continuous-Time Markov Chains and Applications

Authors: G. George Yin | Qing Zhang

Open problems

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Lamplighter walks

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Hitting times

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Markov Chains on a Discrete State Space

BOOK CHAPTER published 2018 in Springer Series in Operations Research and Financial Engineering

Authors: Randal Douc | Eric Moulines | Pierre Priouret | Philippe Soulier

Rates of Convergence for Atomic Markov Chains

BOOK CHAPTER published 2018 in Springer Series in Operations Research and Financial Engineering

Authors: Randal Douc | Eric Moulines | Pierre Priouret | Philippe Soulier

Cover times

BOOK CHAPTER published 9 December 2008 in Markov Chains and Mixing Times

Special Topics

BOOK CHAPTER published 8 November 2010 in Markov Chains and Decision Processes for Engineers and Managers

Expected average cost: Dynamic Programming and LP

BOOK CHAPTER published 13 December 2021 in Constrained Markov Decision Processes

Authors: Eitan Altman

Hidden Markov Model for Customers Classification

BOOK CHAPTER published in International Series in Operations Research & Management Science

Multivariate Markov Chains

BOOK CHAPTER published 2013 in International Series in Operations Research & Management Science

Authors: Wai-Ki Ching | Ximin Huang | Michael K. Ng | Tak-Kuen Siu

Hidden Markov Chains

BOOK CHAPTER published 2013 in International Series in Operations Research & Management Science

Authors: Wai-Ki Ching | Ximin Huang | Michael K. Ng | Tak-Kuen Siu