Grinstead-Snell-Probability · Problem 11.2.26

Markov Chains

Mathematics · absorbing-markov-chains

Problem

We considered the two examples of the Drunkard's Walk corresponding to the cases n=4n = 4 and n=5n = 5 blocks (see Example 11.13). Verify that in these two examples the expected time to absorption, starting at xx, is equal to x(n−x)x(n - x). See if you can prove that this is true in general. Hint: Show that if f(x)f(x) is the expected time to absorption then f(0)=f(n)=0f(0) = f(n) = 0 and f(x)=(1/2)f(x−1)+(1/2)f(x+1)+1f(x) = (1/2)f(x-1) + (1/2)f(x+1) + 1 for 0<x<n0 < x < n. Show that if f1(x)f_1(x) and f2(x)f_2(x) are two solutions, then their difference g(x)g(x) is a solution of the equation g(x)=(1/2)g(x−1)+(1/2)g(x+1).g(x) = (1/2)g(x-1) + (1/2)g(x+1). Also, g(0)=g(n)=0g(0) = g(n) = 0. Show that it is not possible for g(x)g(x) to have a strict maximum or a strict minimum at the point ii, where 1≤i≤n−11 \leq i \leq n-1. Use this to show that g(i)=0g(i) = 0 for all ii. This shows that there is at most one solution. Then verify that the function f(x)=x(n−x)f(x) = x(n-x) is a solution.

Related theory

Browse the problem library