Grinstead-Snell-Probability · Problem 11.1.16

Markov Chains

Mathematics · markov-chains-introduction

Problem

Modify the program of Exercise 15 so that it keeps track of the proportion of times in each state in nn steps. Run the modified program for different starting states for Example 11.1 and Example 11.8. Does the initial state affect the proportion of time spent in each of the states if nn is large?

Related theory

Browse the problem library