Introduction to Probability · Problem 11.2.20

Markov Chains — Grinstead & Snell

Mathematics — Probability · absorbing-markov-chains

Problem

Assume that an experiment has mm equally probable outcomes. Show that the expected number of independent trials before the first occurrence of kk consecutive occurrences of one of these outcomes is (mk−1)/(m−1)(m^k - 1)/(m - 1). Hint: Form an absorbing Markov chain with states 1,2,…,k1, 2, \ldots, k with state ii representing the length of the current run. The expected time until a run of kk is 1 more than the expected time until absorption for the chain started in state 1. It has been found that, in the decimal expansion of pi, starting with the 24,658,601st digit, there is a run of nine 7's. What would your result say about the expected number of digits necessary to find such a run if the digits are produced randomly?

Related theory

Browse the problem library