Grinstead-Snell-Probability · Problem 11.1.14

Markov Chains

Mathematics · markov-chains-introduction

Problem

Using the program MatrixPowers, find

\mathbf{P}^1

through

\mathbf{P}^6

for Examples 11.9 and 11.10. See if you can predict the long-range probability of finding the process in each of the states for these examples.