Introduction to Probability · Problem 11.1.14

Markov Chains — Grinstead & Snell

Mathematics — Probability · markov-chains-introduction

Problem

Using the program MatrixPowers, find P1\mathbf{P}^1 through P6\mathbf{P}^6 for Examples 11.9 and 11.10. See if you can predict the long-range probability of finding the process in each of the states for these examples.

Related theory

Browse the problem library