Grinstead-Snell-Probability · Problem 11.2.36

Markov Chains

Mathematics · absorbing-markov-chains

Problem

We consider next a game called Penney-ante by its inventor W. Penney. There are two players; the first player picks a pattern A of H's and T's, and then the second player, knowing the choice of the first player, picks a different pattern B. We assume that neither pattern is a subpattern of the other pattern. A coin is tossed a sequence of times, and the player whose pattern comes up first is the winner. To analyze the game, we need to find the probability pAp_A that pattern A will occur before pattern B and the probability pB=1−pAp_B = 1 - p_A that pattern B occurs before pattern A. Using the results of Exercises 28 and 29, the expected time to reach a pattern B for the first time is E(TB)=BBE(T^B) = BB, and starting with pattern A, the expected time to reach pattern B is EA(TB)=BB−ABE_A(T^B) = BB - AB. (a) Show that the odds that the first player will win are given by John Conway's formula: pA1−pA=pApB=BB−BAAA−AB.\frac{p_A}{1 - p_A} = \frac{p_A}{p_B} = \frac{BB - BA}{AA - AB}. Hint: Explain why E(TB)=E(TA or B)+pAEA(TB)E(T^B) = E(T^{A \text{ or } B}) + p_A E_A(T^B) and thus BB=E(TA or B)+pA(BB−AB)BB = E(T^{A \text{ or } B}) + p_A(BB - AB). Interchange A and B to find a similar equation involving pBp_B. Finally, note that pA+pB=1p_A + p_B = 1. Use these equations to solve for pAp_A and pBp_B. (b) Assume that both players choose a pattern of the same length kk. Show that, if k=2k = 2, this is a fair game, but, if k=3k = 3, the second player has an advantage no matter what choice the first player makes.

Related theory

Browse the problem library