Understanding Markov Chains: Examples and Applications

By Nicolas Privault

Book Overview

Probability Background.- Gambling Problems.- Random Walks.- Discrete-Time Markov Chains.- First Step Analysis.- Classification of States.- Long-Run Behavior of Markov Chains.- Branching Processes.- Continuous-Time Markov Chains.- Discrete-Time Martingales.- Spatial Poisson Processes.- Reliability Theory.

• Format: Paperback
• Language: English
• ISBN: 9811306583
• ISBN13: 9789811306587
• Release Date: August 2018
• Publisher: Springer
• Length: 372 Pages
• Weight: 1.21 lbs.
• Dimensions: 0.8" x 6.1" x 9.2"