Stochastic Processes and the Fokker-Planck Equation

⚡ Key Takeaways

Stochastic processes describe systems evolving randomly in time; the Fokker-Planck equation (FPE) is the deterministic partial differential equation governing the time evolution of the probability density of a continuous Markov (diffusion) process. In one line: if a particle obeys the Itô SDE $dX_t = a\,dt + b\,dW_t$ , then its density $p(x,t)$ obeys $\partial_t p = -\partial_x(a p) + \tfrac12\partial_x^2(b^2 p)$ . It applies wherever drift competes with diffusion — Brownian motion, chemical kinetics, neuron firing, option pricing, population genetics. Introduced by Fokker (1914) and Planck (1917); rigorous foundations from Kolmogorov (1931).

💡 The Core Insight

A continuous Markov process is locally Gaussian: over an infinitesimal time $dt$ , its increment has mean $a(x,t)\,dt$ and variance $b^2(x,t)\,dt$ , with all higher cumulants $o(dt)$ . These two functions — drift $a$ and diffusion $D=\tfrac12 b^2$ — encode everything. The Fokker-Planck equation is simply the statement of probability conservation (a continuity equation) with a probability current built from advection by the drift plus Fickian diffusion. Forward in time it propagates densities; backward in time its adjoint propagates expectations.

DefinitionStochastic Process and Filtration

A stochastic process on a probability space $(\Omega,\mathcal F,\mathbb P)$ is a map $X:T\times\Omega\to\mathbb R^d$ such that $X_t=X(t,\cdot)$ is measurable for each $t$ . A filtration $\{\mathcal F_t\}$ is an increasing family of sub- $\sigma$ -algebras, $\mathcal F_s\subseteq\mathcal F_t$ for $s\le t$ , representing information available up to time $t$ . The process is adapted if $X_t$ is $\mathcal F_t$ -measurable. A process is Markov if for $s<t$ and any Borel $B$ ,

1

\quad \mathbb P(X_t\in B\mid \mathcal F_s)=\mathbb P(X_t\in B\mid X_s)=:P(s,X_s;t,B).

Derivation hint: This is the defining "memorylessness" — condition on the full past, recover dependence on the present alone. Define the transition kernel as the regular conditional probability.

DefinitionDiffusion Process and the SDE

A diffusion is a continuous-path Markov process whose transition kernel satisfies, for any $\varepsilon>0$ ,

2

\quad \lim_{h\downarrow0}\frac1h\int_{|y-x|>\varepsilon}P(t,x;t+h,dy)=0,

Derivation hint: This is the "no jumps" condition — the probability of a finite displacement in time $h$ vanishes faster than $h$ , forcing sample paths to be continuous (Lindeberg-type condition). with drift and diffusion coefficients

3

\quad a_i(x,t)=\lim_{h\downarrow0}\frac1h\,\mathbb E\big[(X^i_{t+h}-x)\,\big|\,X_t=x\big],\qquad b_{ij}(x,t)=\lim_{h\downarrow0}\frac1h\,\mathbb E\big[(X^i_{t+h}-x^i)(X^j_{t+h}-x^j)\,\big|\,X_t=x\big].

Derivation hint: These are the first and second infinitesimal conditional moments; Taylor-expand the conditional moment generating function and keep $O(h)$ terms. Equivalently, $X_t$ solves the Itô stochastic differential equation

4

\quad dX_t=\mathbf a(X_t,t)\,dt+\boldsymbol\sigma(X_t,t)\,dW_t,\qquad b_{ij}=\sum_k\sigma_{ik}\sigma_{jk}=(\boldsymbol\sigma\boldsymbol\sigma^\top)_{ij},

Derivation hint: $W_t$ is a $d$ -dimensional Brownian motion. Match infinitesimal moments: $\mathbb E[dX]=\mathbf a\,dt$ because $\mathbb E[dW]=0$ , and $\mathbb E[dX\,dX^\top]=\boldsymbol\sigma\boldsymbol\sigma^\top dt$ using the Itô rule $dW_idW_j=\delta_{ij}dt$ . where $W_t$ is standard Brownian motion ( $\mathbb E[W_t]=0$ , $\mathbb E[W_sW_t]=\min(s,t)$ ).

TheoremFokker-Planck (Kolmogorov Forward) Equation

Let $X_t$ solve the Itô SDE [4] with smooth, suitably bounded coefficients, and let $p(x,t)$ be the probability density of $X_t$ (assumed to exist). Then $p$ satisfies

5

\quad \frac{\partial p}{\partial t}=-\sum_{i=1}^d\frac{\partial}{\partial x_i}\big[a_i(x,t)\,p\big]+\frac12\sum_{i,j=1}^d\frac{\partial^2}{\partial x_i\partial x_j}\big[b_{ij}(x,t)\,p\big].

Derivation hint: Apply the adjoint of the generator to a test function and integrate by parts twice; the boundary terms vanish. See proof below. In one dimension with $D(x,t)=\tfrac12 b(x,t)$ this reads

6

\quad \frac{\partial p}{\partial t}=-\frac{\partial}{\partial x}\big[a(x,t)\,p\big]+\frac{\partial^2}{\partial x^2}\big[D(x,t)\,p\big]=-\frac{\partial J}{\partial x},\quad J=a\,p-\frac{\partial}{\partial x}(D\,p).

Derivation hint: Rewrite [5] as a continuity equation $\partial_t p+\partial_x J=0$ by grouping all spatial derivatives into the probability current $J$ . The adjoint (Kolmogorov backward) equation for the transition density $p(y,t\mid x,s)$ as a function of the initial data $(x,s)$ is

7

\quad -\frac{\partial p}{\partial s}=\sum_i a_i(x,s)\frac{\partial p}{\partial x_i}+\frac12\sum_{i,j}b_{ij}(x,s)\frac{\partial^2 p}{\partial x_i\partial x_j}=:\mathcal L p.

Derivation hint: $\mathcal L$ is the infinitesimal generator; the forward operator in [5] is its formal $L^2$ -adjoint $\mathcal L^\dagger$ . Backward evolution acts on the starting point.

ProofForward Equation via the Generator and Itô's Lemma

Step 1 — The generator. For a $C^2_b$ test function $f$ , define the infinitesimal generator

8

\quad (\mathcal L f)(x,t)=\lim_{h\downarrow0}\frac{\mathbb E[f(X_{t+h})\mid X_t=x]-f(x)}{h}.

Derivation hint: This is the time derivative of the conditional expectation; it measures how the average of $f$ changes per unit time along trajectories.

Step 2 — Itô's lemma. For $f(X_t)$ with $X_t$ solving [4], Itô's formula gives

9

\quad df(X_t)=\Big(\sum_i a_i\partial_i f+\tfrac12\sum_{ij}b_{ij}\partial_i\partial_j f\Big)dt+\sum_{ik}\partial_i f\,\sigma_{ik}\,dW^k_t.

Derivation hint: Taylor-expand $f(X_{t+dt})$ to second order; replace $dX_idX_j\to b_{ij}\,dt$ via the Itô multiplication table and discard $dt\,dW$ and higher terms. Taking conditional expectation kills the martingale term, so $(\mathcal L f)(x,t)=\sum_i a_i\partial_i f+\tfrac12\sum_{ij}b_{ij}\partial_i\partial_j f$ .

Step 3 — Duality. Evolution of the expectation $u(t)=\mathbb E[f(X_t)]=\int f(x)\,p(x,t)\,dx$ satisfies

10

\quad \frac{d}{dt}\int f\,p\,dx=\int (\mathcal L f)\,p\,dx.

Derivation hint: Differentiate under the integral and use that $\mathbb E[f(X_t)]$ advances by the generator; this is the weak form of the FPE.

Step 4 — Integrate by parts. Substituting $\mathcal L f$ and integrating by parts (boundary terms vanish for compactly supported $f$ or fast-decaying $p$ ):

11

\quad \int(\mathcal L f)p\,dx=\int f\Big[-\partial_i(a_i p)+\tfrac12\partial_i\partial_j(b_{ij}p)\Big]dx=\int f\,(\mathcal L^\dagger p)\,dx.

Derivation hint: Move one derivative off $f$ in the drift term (one integration by parts) and two derivatives off $f$ in the diffusion term (two integrations by parts), each producing a sign and a derivative landing on the coefficient times $p$ .

Step 5 — Conclude. Since [10] equals $\int f\,\partial_t p\,dx$ and must hold for all test $f$ ,

12

\quad \partial_t p=\mathcal L^\dagger p=-\partial_i(a_i p)+\tfrac12\partial_i\partial_j(b_{ij}p),

Derivation hint: Equate the integrands by the fundamental lemma of calculus of variations (arbitrariness of $f$ ). $\blacksquare$

∎

AF

Adriaan Fokker & Max Planck

1914–1917

Adriaan Fokker (1887–1972), a Dutch physicist and musician (he built the 31-tone "Fokker organ"), derived in his 1914 doctoral work an equation for the probability distribution of a Brownian particle's velocity under radiation and collisions. Max Planck (1858–1947), founder of quantum theory, generalized and gave the equation rigorous standing in 1917 while studying fluctuation phenomena. Neither had the modern stochastic-calculus machinery; the rigorous probabilistic underpinning came only with Andrei Kolmogorov's 1931 paper, which is why physicists say "Fokker-Planck" while mathematicians often say "Kolmogorov forward equation." The equation crowned a decade of fluctuation physics opened by Einstein and Smoluchowski.

🧠 Intuition

Imagine an enormous swarm of identical particles, each independently obeying the same noisy law of motion. The Fokker-Planck equation does not track any single particle — it tracks the shape of the swarm's cloud. The drift term $-\partial_x(ap)$ is a conveyor belt: it bodily transports the cloud along the deterministic flow $\dot x=a$ , conserving area but shifting and shearing it. The diffusion term $\partial_x^2(Dp)$ is a blurring lens: it spreads probability from regions of high density to low, exactly like heat smoothing out. Equilibrium is the standoff where the deterministic conveyor pushing probability "uphill" toward a potential minimum exactly balances the diffusive blur pushing it back out — yielding the Boltzmann distribution. The probability current $J$ in [6] is the bookkeeping that makes "probability is never created or destroyed, only moved" precise.

Figure

Drift-diffusion: a Gaussian packet advects and spreads while conserving area

ExampleFree Brownian Motion — the Heat Kernel

Given: $dX_t=\sigma\,dW_t$ (zero drift, constant $\sigma$ ), initial condition $X_0=x_0$ , i.e. $p(x,0)=\delta(x-x_0)$ . Here $a=0$ , $D=\tfrac12\sigma^2$ .

Step 1 — Write the FPE. From [6]: $\partial_t p=\tfrac12\sigma^2\partial_x^2 p$ . This is the heat equation with diffusivity $\tfrac12\sigma^2$ .

Step 2 — Fourier transform. With $\hat p(k,t)=\int e^{-ikx}p\,dx$ : $\partial_t\hat p=-\tfrac12\sigma^2 k^2\hat p$ , giving $\hat p(k,t)=e^{-ikx_0}e^{-\sigma^2 k^2 t/2}$ .

Step 3 — Invert. This is a Gaussian; transform back:

13

\quad p(x,t)=\frac{1}{\sqrt{2\pi\sigma^2 t}}\exp\!\Big(-\frac{(x-x_0)^2}{2\sigma^2 t}\Big).

Derivation hint: The inverse Fourier transform of a Gaussian in $k$ is a Gaussian in $x$ with variance $\sigma^2 t$ .

Step 4 — Numbers. Take $\sigma^2=4\,\mathrm{cm^2/s}$ , $x_0=0$ , $t=2\,\mathrm s$ . Variance $=\sigma^2 t=8\,\mathrm{cm^2}$ , so spread $\sqrt{8}\approx 2.83\,\mathrm{cm}$ .

\boxed{p(x,2)=\frac{1}{\sqrt{16\pi}}\,e^{-x^2/16}\,\mathrm{cm^{-1}},\quad \mathrm{std}=2.83\ \mathrm{cm}}

ExampleOrnstein-Uhlenbeck Process — Relaxation to Equilibrium

Given: $dX_t=-\gamma X_t\,dt+\sigma\,dW_t$ (linear restoring drift $a=-\gamma x$ , constant $D=\tfrac12\sigma^2$ ), with $\gamma>0$ . Model a particle in a harmonic trap or velocity of a Brownian particle (Langevin).

Step 1 — FPE. $\partial_t p=\gamma\,\partial_x(x p)+\tfrac12\sigma^2\partial_x^2 p$ .

Step 2 — Gaussian ansatz. Means and variances close: $\dot m=-\gamma m$ , $\dot V=-2\gamma V+\sigma^2$ .

14

\quad m(t)=m_0 e^{-\gamma t},\qquad V(t)=\frac{\sigma^2}{2\gamma}\big(1-e^{-2\gamma t}\big)+V_0e^{-2\gamma t}.

Derivation hint: Multiply the FPE by $x$ and $x^2$ , integrate, and integrate by parts to get closed ODEs for the moments.

Step 3 — Stationary distribution. As $t\to\infty$ , $m\to0$ , $V\to V_\infty=\sigma^2/(2\gamma)$ :

15

\quad p_{\mathrm{st}}(x)=\sqrt{\frac{\gamma}{\pi\sigma^2}}\exp\!\Big(-\frac{\gamma x^2}{\sigma^2}\Big).

Derivation hint: Set $\partial_t p=0$ and require zero probability current $J=0$ ; solve the resulting first-order ODE, recovering a Boltzmann form $\propto e^{-U/D}$ with $U=\tfrac12\gamma x^2$ .

Step 4 — Numbers. Take $\gamma=2\,\mathrm{s^{-1}}$ , $\sigma^2=8\,\mathrm{(units)^2/s}$ , $m_0=5$ , $V_0=0$ . Relaxation time $\tau=1/\gamma=0.5\,\mathrm s$ . Equilibrium variance $V_\infty=8/4=2$ .

\boxed{m(0.5)=5e^{-1}\approx1.84,\quad V(0.5)=2(1-e^{-2})\approx1.73,\quad V_\infty=2}

⚠️ Itô vs. Stratonovich — the FPE depends on the calculus convention

When the diffusion coefficient is state-dependent ( $b=b(x)$ ), the SDE is ambiguous until you specify how the stochastic integral is interpreted. The Itô convention gives FPE [5] directly. The Stratonovich convention (denoted $\circ\,dW$ ) produces an extra "spurious drift": the Stratonovich SDE $dX=a\,dt+b\circ dW$ is equivalent to the Itô SDE with drift $a+\tfrac12 b\,b'$ , so its FPE is

16

\quad \partial_t p=-\partial_x\Big[\big(a+\tfrac12 b b'\big)p\Big]+\tfrac12\partial_x^2(b^2 p).

Derivation hint: Convert Stratonovich to Itô via the drift correction $\tfrac12 b\,\partial_x b$ , then apply the standard FPE [6]. Failing to state the convention makes the equation ill-defined. Physicists modeling multiplicative noise from a smooth physical process should usually use Stratonovich (Wong-Zakai theorem); modelers wanting the martingale/no-anticipation property use Itô.

CounterexampleNot every Markov process has a Fokker-Planck equation

The FPE requires continuous paths and the vanishing-large-jump condition [2]. A Poisson process or any jump (Lévy) process is Markov but violates [2]: it makes finite jumps in arbitrarily short times. Its evolution is governed instead by a master equation / integro-differential Kolmogorov-Feller equation containing a jump kernel, not by a second-order PDE. Attempting to fit a pure-jump process with an FPE — the so-called Kramers-Moyal truncation at second order — is generally inconsistent: by Pawula's theorem, the Kramers-Moyal expansion must either stop at the second term (yielding the FPE) or contain infinitely many terms; truncating at any finite order $\ge 3$ can produce negative probabilities.

connection

The FPE sits at a crossroads of analysis, probability, and physics. It is the forward dual of the backward Kolmogorov equation, which via the Feynman-Kac Formula connects to expectations and to the Schrödinger equation under Wick rotation. The associated SDE is the realm of Itô Calculus and Brownian Motion. In overdamped form (the Smoluchowski equation) it reduces from the full phase-space Kramers equation, the prototype of Kinetic Theory transport equations. Its stationary solutions reproduce equilibrium Statistical Mechanics (the Boltzmann distribution), while detailed balance vs. its violation is the gateway to stochastic thermodynamics and the Fluctuation-Dissipation Theorem. Numerically, the FPE is a parabolic PDE solvable by the same finite-difference and spectral tools as the Heat Equation, to which free diffusion literally reduces.

🔬 Where this appears

⏳ History

- 1827 — Robert Brown observes erratic motion of pollen grains in water; phenomenon unexplained for decades.

- 1900 — Louis Bachelier, in Théorie de la spéculation, models stock prices with Brownian motion and writes a diffusion equation — the first FPE, in finance, five years before Einstein.

- 1905 — Albert Einstein derives the diffusion equation for Brownian particles, linking diffusivity to temperature and molecular size (

D=k_BT/6\pi\eta a

).

- 1906 — Marian Smoluchowski independently develops the kinetic theory of Brownian motion and the overdamped (Smoluchowski) equation.

- 1908 — Paul Langevin introduces the stochastic differential equation viewpoint via a fluctuating force.

- 1914–1917 — Adriaan Fokker (thesis) and Max Planck establish the equation bearing their names for velocity/probability distributions.

- 1923 — Norbert Wiener gives the first rigorous mathematical construction of Brownian motion (the Wiener process/measure).

- 1931 — Andrei Kolmogorov publishes Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung, deriving the forward and backward equations rigorously and founding the analytic theory of Markov processes.

- 1940 — Hendrik Kramers analyzes barrier escape (the Kramers problem) and the full phase-space equation; 1944–1951 Kiyosi Itô builds stochastic calculus, completing the SDE↔FPE correspondence.

open-problem

Several deep issues persist. (1) Existence and smoothness of densities: Hörmander's hypoellipticity theorem guarantees a smooth density even for degenerate diffusion (rank-deficient $\boldsymbol\sigma$ , as in the Kramers equation) provided a Lie-bracket spanning condition holds — but sharp conditions for general non-smooth or unbounded coefficients remain active research (the Stroock-Varadhan martingale problem, well-posedness for low-regularity drift à la DiPerna-Lions/Figalli). (2) Boundary conditions: absorbing, reflecting, and sticky boundaries each modify the current $J$ ; classifying boundary behavior (Feller's classification: regular, exit, entrance, natural) is delicate. (3) Long-time behavior and rates of convergence to equilibrium for non-reversible (current-carrying) FPEs are governed by hypocoercivity (Villani), where the operator is non-self-adjoint and spectral-gap arguments fail. (4) Non-Markovian generalizations: systems with memory require generalized Langevin equations and fractional Fokker-Planck operators whose probabilistic foundations are still incomplete. (5) High-dimensional numerics: solving the FPE directly suffers the curse of dimensionality; tensor methods and neural-network surrogates are open engineering frontiers.

Stochastic Processes and the Fokker-Planck Equation

Formal Statement

Why It Holds / Derivation

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also