Markov chains and decision processes for engineers and managers /

Markov chains and decision processes for engineers and managers /

Show other versions (2)

This book presents an introduction to finite Markov chains and Markov decision processes, with applications in engineering and management. It introduces discrete-time, finite-state Markov chains, and Markov decision processes. The text describes both algorithms and applications, enabling students to...

Full description

Bibliographic Details
Main Author: Sheskin, Theodore J. (Author)
Corporate Author: Taylor & Francis
Format: eBook
Language:English
Published: Boca Raton, Fla. : CRC Press, [2011]
Subjects:
Decision making > Mathematics.
Markov processes.
Electronic books.
Online Access:Connect to the full text of this electronic book
Table of Contents:
  • chapter 1. Markov chain structure and models
  • chapter 2. Regular Markov chains
  • chapter 3. Reducible Markov chains
  • chapter 4. A Markov Chain with Rewards (MCR)
  • chapter 5. A Markov Decision Process (MDP)
  • chapter 6. Special topics : state reduction and hidden Markov chains.