Random Walks Statistical Mechanics

⚡ Key Takeaways

Random Walks in Statistical Mechanics describe the cumulative motion of a system that takes successive random steps. The central result is that the mean-squared displacement grows linearly with the number of steps, $\langle R^2 \rangle = N a^2$ , and that the displacement distribution converges to a Gaussian. They apply to diffusion, Brownian motion, polymer conformations, and lattice models. Foundational work by Pearson, Rayleigh, Einstein, and Smoluchowski (1900–1906).

💡 The Core Insight

Adding $N$ independent, identically distributed random steps produces a displacement whose typical magnitude scales as $\sqrt{N}$ , not $N$ . The direction averages to zero, but the spread accumulates. This $\sqrt{N}$ law is the signature of diffusive behavior and is a direct consequence of the additivity of variances for independent random variables.

DefinitionDiscrete Random Walk

Let $\{\vec{s}_i\}_{i=1}^{N}$ be independent, identically distributed (i.i.d.) random step vectors in $d$ dimensions with $\langle \vec{s}_i \rangle = 0$ and step length $|\vec{s}_i| = a$ . The position after $N$ steps is

1

\quad \vec{R}_N = \sum_{i=1}^{N} \vec{s}_i

Derivation hint: The walk is defined as the running sum of independent displacements; this is the definitional starting point. Symbols: $\vec{R}_N$ = net displacement vector; $\vec{s}_i$ = the $i$ -th step; $a$ = fixed step length; $N$ = number of steps; $d$ = spatial dimension.

TheoremMean-Squared Displacement Law

For a random walk with zero-mean, uncorrelated steps of length $a$ , the mean displacement vanishes and the mean-squared displacement grows linearly in $N$ :

2

\quad \langle \vec{R}_N \rangle = 0, \qquad \langle R_N^2 \rangle = N a^2

Derivation hint: Expand $\langle \vec{R}_N \cdot \vec{R}_N\rangle = \sum_{i,j}\langle \vec{s}_i\cdot\vec{s}_j\rangle$ ; cross terms vanish by independence, diagonal terms each give $a^2$ .

TheoremGaussian Limit / Central Limit Theorem

For large $N$ , the probability density of the endpoint $\vec{R}$ approaches a Gaussian:

3

\quad P(\vec{R}, N) = \left(\frac{d}{2\pi N a^2}\right)^{d/2} \exp\left(-\frac{d\, R^2}{2 N a^2}\right)

Derivation hint: Apply the multivariate central limit theorem; the variance per dimension is $\langle R^2\rangle/d = Na^2/d$ , fixing the normalization and exponent.

ProofMean-Squared Displacement

Step 1. Start from the displacement as a sum: $\vec{R}_N = \sum_{i=1}^N \vec{s}_i$ .

Step 2. Take the expectation of the displacement. By linearity and $\langle \vec{s}_i\rangle = 0$ :

4

\quad \langle \vec{R}_N \rangle = \sum_{i=1}^N \langle \vec{s}_i \rangle = 0

Derivation hint: Expectation is linear; each isotropic step has zero mean by symmetry.

Step 3. Compute the squared magnitude:

5

\quad R_N^2 = \vec{R}_N\cdot\vec{R}_N = \sum_{i=1}^N\sum_{j=1}^N \vec{s}_i\cdot\vec{s}_j

Derivation hint: Dot the sum with itself and expand into a double sum.

Step 4. Average term by term. Split diagonal ( $i=j$ ) and off-diagonal ( $i\neq j$ ):

6

\quad \langle R_N^2\rangle = \sum_{i=1}^N \langle \vec{s}_i\cdot\vec{s}_i\rangle + \sum_{i\neq j}\langle \vec{s}_i\cdot\vec{s}_j\rangle

Derivation hint: Separate the double sum; the second group contains all distinct-index pairs.

Step 5. Each diagonal term equals $a^2$ (there are $N$ of them). Each off-diagonal term factorizes by independence: $\langle\vec{s}_i\cdot\vec{s}_j\rangle = \langle\vec{s}_i\rangle\cdot\langle\vec{s}_j\rangle = 0$ .

Step 6. Therefore $\langle R_N^2\rangle = N a^2$ . The root-mean-square displacement is $R_\text{rms} = a\sqrt{N}$ . $\blacksquare$

∎

ProofContinuum Diffusion Limit

Step 1. Let $\tau$ be the time per step and $a$ the step length. After time $t = N\tau$ , the variance is $\langle R^2\rangle = (t/\tau)a^2$ .

Step 2. Define the diffusion coefficient so the variance is finite as $a,\tau\to 0$ :

7

\quad D = \frac{a^2}{2d\,\tau}

Derivation hint: Demand $\langle R^2\rangle = 2dDt$ to hold; solve for $D$ from $\langle R^2\rangle = (t/\tau)a^2$ .

Step 3. In this limit the discrete master equation for $P(\vec{R},t)$ Taylor-expands to the diffusion equation:

8

\quad \frac{\partial P}{\partial t} = D\,\nabla^2 P

Derivation hint: Expand $P(\vec{R},t+\tau)$ and $P(\vec{R}\pm a\hat{e},t)$ to second order; the leading surviving terms give $\partial_t P = D\nabla^2 P$ .

Step 4. The Gaussian $[3]$ (with $Na^2 = 2dDt$ ) is exactly the fundamental solution of $[8]$ . $\blacksquare$

∎

AE

Albert Einstein

1879–1955

In his 1905 paper Über die von der molekularkinetischen Theorie der Wärme geforderte Bewegung..., Einstein derived that the mean-squared displacement of a Brownian particle grows linearly in time, $\langle x^2\rangle = 2Dt$ , and connected $D$ to measurable quantities via $D = k_B T/(6\pi\eta r)$ (the Stokes–Einstein relation). This gave Perrin a route to measuring Avogadro's number and provided decisive evidence for the atomic hypothesis. Einstein's treatment fused random-walk statistics with thermodynamics, making the random walk a cornerstone of physical kinetics.

🧠 Intuition

Imagine a drunkard taking steps of length $a$ in random directions. After $N$ steps where will they be? On average, nowhere — they're equally likely to drift any way, so $\langle\vec{R}\rangle = 0$ . But "nowhere on average" does not mean "near the start." The spread of possible positions grows: after 100 steps the typical distance is $10a$ , after 10,000 steps it is $100a$ . The walker covers distance proportional to $\sqrt{N}$ , far slower than the $N$ they would travel walking straight. The reason is cancellation: forward and backward steps partially undo each other, but only partially, because fluctuations don't fully cancel. The leftover imbalance scales like $\sqrt{N}$ — exactly the standard deviation of a sum of independent coin flips.

Figure

Three random walk trajectories from a common origin, illustrating spread growing as √N

ExampleDiffusion of a Pollen Grain

Given: A pollen grain in water at $T = 300\text{ K}$ , radius $r = 1\,\mu\text{m}$ , water viscosity $\eta = 1.0\times10^{-3}\,\text{Pa}\,\cdot\,\text{s}$ . Find the rms displacement after $t = 10\,\text{s}$ (3D).

Step 1. Stokes–Einstein diffusion coefficient:

D = \frac{k_B T}{6\pi\eta r} = \frac{(1.38\times10^{-23})(300)}{6\pi(1.0\times10^{-3})(1.0\times10^{-6})}

Step 2. Numerator $= 4.14\times10^{-21}$ ; denominator $= 1.885\times10^{-8}$ .

D = 2.20\times10^{-13}\,\text{m}^2/\text{s}

Step 3. In 3D, $\langle R^2\rangle = 6Dt = 6(2.20\times10^{-13})(10) = 1.32\times10^{-11}\,\text{m}^2$ .

Step 4. $R_\text{rms} = \sqrt{1.32\times10^{-11}} = 3.63\times10^{-6}\,\text{m}$ .

\boxed{R_\text{rms} \approx 3.6\,\mu\text{m}}

ExampleEnd-to-End Distance of a Polymer

Given: An idealized freely-jointed polymer chain of $N = 10{,}000$ segments, each of length $a = 0.25\,\text{nm}$ . Find the rms end-to-end distance.

Step 1. Model the chain as a 3D random walk; each segment is a step of length $a$ .

Step 2. Apply $\langle R^2\rangle = N a^2$ :

\langle R^2\rangle = (10{,}000)(0.25\times10^{-9})^2 = (10{,}000)(6.25\times10^{-20}) = 6.25\times10^{-16}\,\text{m}^2

Step 3. $R_\text{rms} = \sqrt{6.25\times10^{-16}} = 2.5\times10^{-8}\,\text{m}$ .

Step 4. Compare to the contour length $L = Na = 2.5\,\mu\text{m}$ . The coil is $100\times$ more compact.

\boxed{R_\text{rms} = 25\,\text{nm}}

⚠️ Common mistake

"The walker drifts away at constant speed." No — net displacement scales as $\sqrt{N}$ , not $N$ . The walker's average velocity of net progress actually decreases over time as $\sqrt{N}/N = 1/\sqrt{N}$ . Confusing total path length ( $Na$ ) with net displacement ( $a\sqrt{N}$ ) is the single most common error.

⚠️ Common mistake

" $\langle R\rangle = 0$ means the walker stays put." The vector mean is zero by symmetry, but the magnitude $\langle|R|\rangle$ is nonzero and grows with $N$ . Always distinguish the mean of the vector from the mean of the distance.

CounterexampleSelf-Avoiding Walks Break the Simple Law

The clean result $\langle R^2\rangle = Na^2$ assumes steps are independent. A self-avoiding walk (SAW) — modeling a real polymer that cannot overlap itself — violates this. Excluded-volume interactions correlate steps, and the scaling changes to $\langle R^2\rangle \sim N^{2\nu}$ with the Flory exponent $\nu \approx 0.588$ in 3D (not $\nu = 1/2$ ). The chain swells beyond the ideal prediction. This shows the $\sqrt{N}$ law is a consequence of independence, not a universal truth of all walks.

connection

Random walks sit at the crossroads of several fields. The continuum limit yields the Diffusion Equation, identical in form to the heat equation. The Gaussian endpoint distribution is a direct manifestation of the Central Limit Theorem. The model underlies Brownian Motion as its continuous-time, continuous-space counterpart (the Wiener process). In polymer physics, the ideal chain connects to the Freely-Jointed Chain Model, while corrections lead to the Self-Avoiding Walk. The full probabilistic framework generalizes to Markov Chains, since each step depends only on the current state.

🔬 Where this appears

⏳ History

- 1827 — Robert Brown observes the erratic motion of pollen grains in water, later named Brownian motion.

- 1900 — Louis Bachelier, in Théorie de la spéculation, models stock prices as a random walk, anticipating diffusion theory.

- 1905 — Albert Einstein derives

\langle x^2\rangle = 2Dt

and the Stokes–Einstein relation, linking Brownian motion to molecular kinetics.

- 1905 — Karl Pearson coins the term "random walk" in a letter to Nature, posing the drunkard's-walk problem.

- 1905 — Lord Rayleigh notes the connection to his 1880 work on the sum of random sinusoidal vibrations.

- 1906 — Marian Smoluchowski independently develops a statistical theory of Brownian motion.

- 1908 — Jean Perrin experimentally verifies Einstein's predictions, measuring Avogadro's number.

- 1921 — George Pólya proves recurrence in 1D/2D and transience in

d\geq 3

("a drunk man finds his way home, a drunk bird may not").

- 1923 — Norbert Wiener gives the rigorous mathematical construction of Brownian motion (the Wiener process).

- 1949 — Paul Flory introduces excluded-volume theory, giving the swollen scaling exponent for self-avoiding walks.

open-problem

The connective constant $\mu$ governing the number of $N$ -step self-avoiding walks ( $c_N \sim \mu^N N^{\gamma-1}$ ) is not known in closed form for the square lattice; only rigorous bounds and high-precision numerical estimates exist. The exact value of the Flory exponent $\nu$ in three dimensions remains analytically open — its $d=2$ value ( $\nu = 3/4$ ) was conjectured by Nienhuis and connected to SLE (Schramm–Loewner Evolution) theory, but a fully rigorous derivation of SAW scaling in $d=3$ is still missing. More broadly, anomalous diffusion (where $\langle R^2\rangle \sim t^\alpha$ with $\alpha\neq 1$ ) in disordered and fractal media resists complete classification.

Formal Statement

Why It Holds / Derivation

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also