Grinstead-Snell-Probability · Problem 11.1.9

Markov Chains

Mathematics · markov-chains-introduction

Problem

For the Markov chain in Exercise 8, draw a tree and assign a tree measure assuming that the process begins in state 0 and moves through two stages of transmission. What is the probability that the machine, after two stages, produces the digit 0 (i.e., the correct digit)? What is the probability that the machine never changed the digit from 0? Now let p=.1p = .1. Using the program MatrixPowers, compute the 100th power of the transition matrix. Interpret the entries of this matrix. Repeat this with p=.2p = .2. Why do the 100th powers appear to be the same?

Related theory

Browse the problem library