Markov Decision Processes

MONOGRAPH published 15 April 1994 in Wiley Series in Probability and Statistics

Authors: Martin L. Puterman

649 ppMartin L. Puterman, Markov Decision Processes. Discrete Stochastic Dynamic Programming, John Wiley (1994).

JOURNAL ARTICLE published 1995 in Bulletin of Mathematical Biology

Authors: M MANGEL

Finite‐Horizon Markov Decision Processes

OTHER published 15 April 1994 in Markov Decision Processes

Discounted Markov Decision Problems

OTHER published 15 April 1994 in Markov Decision Processes

Appendix A: Markov Chains

OTHER published 15 April 1994 in Markov Decision Processes

Optimality equations in undiscounted Markov decision processes

PROCEEDINGS ARTICLE published in Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304)

Authors: M.L. Puterman

Front Matter

OTHER published 15 April 1994 in Markov Decision Processes

Examples

OTHER published 15 April 1994 in Markov Decision Processes

Index

OTHER published 15 April 1994 in Markov Decision Processes

Notation

OTHER published 15 April 1994 in Markov Decision Processes

Introduction

OTHER published 15 April 1994 in Markov Decision Processes

Afterword

OTHER published 15 April 1994 in Markov Decision Processes

Bibliography

OTHER published 15 April 1994 in Markov Decision Processes

Model Formulation

OTHER published 15 April 1994 in Markov Decision Processes

Sensitive Discount Optimality

OTHER published 15 April 1994 in Markov Decision Processes

Continuous‐Time Models

OTHER published 15 April 1994 in Markov Decision Processes

Infinite‐Horizon Models: Foundations

OTHER published 15 April 1994 in Markov Decision Processes

Appendix D: Linear Programming

OTHER published 15 April 1994 in Markov Decision Processes

Appendix B: Semicontinuous Functions

OTHER published 15 April 1994 in Markov Decision Processes

Markov Decision Processes: Discrete Stochastic Dynamic Programming

JOURNAL ARTICLE published August 1995 in Technometrics

Authors: Laurence A. Baxter | Martin L. Puterman