Metadata Search Funding Data Link References Status API Help
Facet browsing currently unavailable
Page 3 of 730 results
Sort by: relevance publication year

Estimation for discrete time nonhomogeneous Markov chains

JOURNAL ARTICLE published June 1978 in Stochastic Processes and their Applications

Authors: Thomas R. Fleming | David P. Harrington

https://doi.org/10.1016/0304-4149(78)90012-1 Actions

Biological Applications of Discrete-Time Markov Chains

BOOK CHAPTER published 2 December 2010 in An Introduction to Stochastic Processes with Applications to Biology

https://doi.org/10.1201/b12537-9 Actions

Discrete-Time HMM Control

BOOK CHAPTER published in Hidden Markov Models

https://doi.org/10.1007/978-0-387-84854-9_10 Actions

A finite characterization of weak lumpable Markov processes. Part I: The discrete time case

JOURNAL ARTICLE published August 1991 in Stochastic Processes and their Applications

Authors: Gerardo Rubino | Bruno Sericola

https://doi.org/10.1016/0304-4149(91)90091-p Actions

Finite State Markov Chains

BOOK CHAPTER published 1996 in Discrete Stochastic Processes

Authors: Robert G. Gallager

https://doi.org/10.1007/978-1-4615-2329-1_4 Actions

Markov processes in continuous time and space

BOOK CHAPTER published 24 February 2011 in Stochastic Population Processes

Authors: Eric Renshaw

https://doi.org/10.1093/acprof:oso/9780199575312.003.0006 Actions

Generalization of discrete-time geometric bounds to convergence rate of Markov processes on Rn

JOURNAL ARTICLE published 30 May 2002 in Stochastic Models

Authors: Wai Kong Yuen

https://doi.org/10.1081/stm-120004469 Actions

Discount Optimality for Nonnegative Costs

BOOK CHAPTER published 2009 in Stochastic Modelling and Applied Probability

Authors: Xianping Guo | Onésimo Hernández-Lerma

https://doi.org/10.1007/978-3-642-02547-1_4 Actions

Discount Optimality for Unbounded Rewards

BOOK CHAPTER published 2009 in Stochastic Modelling and Applied Probability

Authors: Xianping Guo | Onésimo Hernández-Lerma

https://doi.org/10.1007/978-3-642-02547-1_6 Actions

Continuous time Markov chain

BOOK CHAPTER published 22 July 2013 in Applied Stochastic Processes

https://doi.org/10.1201/b15257-7 Actions

Recursive smoothers for hidden discrete-time Markov chains

JOURNAL ARTICLE published 1 January 2005 in Journal of Applied Mathematics and Stochastic Analysis

Authors: Lakhdar Aggoun

https://doi.org/10.1155/jamsa.2005.345 Actions

2. Discrete-Parameter Markov Chains

BOOK CHAPTER published January 2009 in Stochastic Processes with Applications

https://doi.org/10.1137/1.9780898718997.ch2 Actions

On geometric and algebraic transience for discrete-time Markov chains

JOURNAL ARTICLE published April 2014 in Stochastic Processes and their Applications

Research funded by NSFC (11131003) | SRFDP (20100003110005)

Authors: Yong-Hua Mao | Yan-Hong Song

https://doi.org/10.1016/j.spa.2013.12.012 Actions

Finite-Action Approximation of Markov Decision Processes

BOOK CHAPTER published 2018 in Systems & Control: Foundations & Applications

Authors: Naci Saldi | Tamás Linder | Serdar Yüksel

https://doi.org/10.1007/978-3-319-79033-6_3 Actions

Approximations for Partially Observed Markov Decision Processes

BOOK CHAPTER published 2018 in Systems & Control: Foundations & Applications

Authors: Naci Saldi | Tamás Linder | Serdar Yüksel

https://doi.org/10.1007/978-3-319-79033-6_5 Actions

Discrete-Time Markov Models

BOOK CHAPTER published 1999 in Modeling, Analysis, Design, and Control of Stochastic Systems

Authors: V.G. Kulkarni

https://doi.org/10.1007/978-1-4757-3098-2_5 Actions

Finite-State Approximation of Markov Decision Processes

BOOK CHAPTER published 2018 in Systems & Control: Foundations & Applications

Authors: Naci Saldi | Tamás Linder | Serdar Yüksel

https://doi.org/10.1007/978-3-319-79033-6_4 Actions

On recursive estimation for hidden Markov models

JOURNAL ARTICLE published February 1997 in Stochastic Processes and their Applications

Authors: Tobias Rydén

https://doi.org/10.1016/s0304-4149(96)00114-7 Actions

Discrete-Time Markov Chains

BOOK published 2005 in Stochastic Modelling and Applied Probability

https://doi.org/10.1007/b138226 Actions

Markov Chains with Countably Infinite State Spaces

BOOK CHAPTER published 1996 in Discrete Stochastic Processes

Authors: Robert G. Gallager

https://doi.org/10.1007/978-1-4615-2329-1_5 Actions
Feedback: support@crossref.org