The Riesz Representation Theorem

⚡ Key Takeaways

The Riesz Representation Theorem identifies the dual of a Hilbert space with the space itself: every continuous linear functional $f$ on a Hilbert space $H$ is given by inner product with a unique vector $y_f \in H$ , i.e. $f(x) = \langle x, y_f \rangle$ . Applies to all (real or complex) Hilbert spaces; foundational in functional analysis, PDE, quantum mechanics, and probability. Proved by Frigyes Riesz and Maurice Fréchet (1907); a separate measure-theoretic "Riesz representation theorem" for $C(X)^*$ is due to Riesz (1909) and refined by Markov–Kakutani–Banach.

💡 The Core Insight

A Hilbert space possesses orthogonal projection: for any closed subspace $M$ , every vector splits uniquely as $x = Px + (x - Px)$ with $Px \in M$ and $x-Px \perp M$ . Given a nonzero continuous functional $f$ , its kernel is a closed hyperplane. The one-dimensional orthogonal complement of the kernel singles out a direction; rescaling a unit vector in that direction by $\overline{f}$ of itself produces the representing vector. Geometry (perpendicularity) thus encodes the entirely algebraic notion of a linear functional.

DefinitionContinuous Dual and Inner Product Conventions

Let $H$ be a Hilbert space over $\mathbb{K}\in\{\mathbb{R},\mathbb{C}\}$ with inner product $\langle\cdot,\cdot\rangle$ , linear in the first argument and conjugate-linear in the second (the physics convention is opposite; see the warning). The continuous (topological) dual $H^*$ is the space of bounded linear functionals $f:H\to\mathbb{K}$ with operator norm

1

\quad \|f\| \;=\; \sup_{\|x\|\le 1}\,|f(x)|.

Derivation hint: $\|f\|$ is the smallest constant $C$ with $|f(x)|\le C\|x\|$ for all $x$ ; boundedness is equivalent to continuity for linear maps. The norm on $H$ is induced by the inner product:

2

\quad \|x\| \;=\; \langle x, x\rangle^{1/2}.

Derivation hint: positive-definiteness of $\langle\cdot,\cdot\rangle$ guarantees $\langle x,x\rangle \ge 0$ with equality iff $x=0$ ; the square root defines a genuine norm via Cauchy–Schwarz and the parallelogram law.

TheoremRiesz–Fréchet Representation Theorem

Let $H$ be a Hilbert space. For every $f \in H^*$ there exists a unique $y_f \in H$ such that

3

\quad f(x) \;=\; \langle x, y_f\rangle \qquad \text{for all } x \in H,

and moreover

4

\quad \|f\|_{H^*} \;=\; \|y_f\|_{H}.

The map $\Phi: H^* \to H$ , $\Phi(f) = y_f$ , is a conjugate-linear, isometric bijection. In the real case $\Phi$ is linear, and $H \cong H^*$ as Banach spaces; in the complex case $H^*$ is conjugate-linearly isometric to $H$ . Derivation hint for [3]–[4]: existence via orthogonal projection onto $(\ker f)^\perp$ ; uniqueness because $\langle x, y\rangle=\langle x, y'\rangle\ \forall x$ forces $y-y'\perp H$ ; the norm identity follows from Cauchy–Schwarz with equality attained at $x=y_f$ .

ProofExistence, Uniqueness, and Isometry

Let $f \in H^*$ .

Step 1 — Trivial case. If $f = 0$ , take $y_f = 0$ ; then $f(x) = \langle x, 0\rangle = 0$ . Assume henceforth $f \neq 0$ .

Step 2 — The kernel is a proper closed subspace. Since $f$ is continuous, $M := \ker f = f^{-1}(\{0\})$ is closed; since $f\neq 0$ , $M \neq H$ . By the projection theorem (valid because $H$ is complete), $H = M \oplus M^\perp$ with $M^\perp \neq \{0\}$ .

Step 3 — The complement is one-dimensional. Pick $z \in M^\perp$ with $z \neq 0$ ; rescale so $f(z) = 1$ is unnecessary, but note for any $x \in H$ ,

5

\quad u \;:=\; f(x)\,z - f(z)\,x \;\in\; M, \qquad\text{since } f(u) = f(x)f(z) - f(z)f(x) = 0.

Derivation hint: linearity of $f$ collapses the combination to zero; this is the standard trick exhibiting any $x$ modulo the kernel as a multiple of $z$ .

Step 4 — Project onto the kernel. Because $u \in M$ and $z \in M^\perp$ , we have $\langle u, z\rangle = 0$ . Expanding:

6

\quad 0 \;=\; \langle f(x)z - f(z)x,\; z\rangle \;=\; f(x)\,\|z\|^2 - f(z)\,\langle x, z\rangle.

Derivation hint: use linearity of the inner product in the first slot and $\langle z,z\rangle = \|z\|^2$ .

Step 5 — Solve for $f(x)$ . Rearranging [6],

7

\quad f(x) \;=\; \frac{f(z)}{\|z\|^2}\,\langle x, z\rangle \;=\; \Big\langle x,\; \frac{\overline{f(z)}}{\|z\|^2}\,z \Big\rangle.

Derivation hint: divide by $\|z\|^2\neq0$ ; the scalar $f(z)/\|z\|^2$ moves into the conjugate-linear second argument as its complex conjugate. Define

8

\quad y_f \;:=\; \frac{\overline{f(z)}}{\|z\|^2}\,z.

Derivation hint: this is the unique representing vector read off from [7]; it lies in $M^\perp$ , the direction orthogonal to the kernel. Then $f(x) = \langle x, y_f\rangle$ for all $x$ , proving existence.

Step 6 — Uniqueness. If $\langle x, y_f\rangle = \langle x, y'\rangle$ for all $x$ , then $\langle x, y_f - y'\rangle = 0$ for all $x$ ; choosing $x = y_f - y'$ gives $\|y_f - y'\|^2 = 0$ , hence $y_f = y'$ .

Step 7 — Isometry [4]. By Cauchy–Schwarz, $|f(x)| = |\langle x, y_f\rangle| \le \|x\|\,\|y_f\|$ , so $\|f\| \le \|y_f\|$ . Conversely, taking $x = y_f$ (assuming $y_f\neq0$ ),

9

\quad \|f\| \;\ge\; \frac{|f(y_f)|}{\|y_f\|} \;=\; \frac{\langle y_f, y_f\rangle}{\|y_f\|} \;=\; \|y_f\|.

Derivation hint: the supremum defining $\|f\|$ is attained (or approached) precisely along the representing direction, forcing equality. Hence $\|f\| = \|y_f\|$ .

Step 8 — Conjugate-linearity of $\Phi$ . For $f,g\in H^*$ and scalar $\alpha$ , $\Phi(\alpha f + g)$ satisfies $\langle x, \Phi(\alpha f+g)\rangle = \alpha f(x) + g(x) = \langle x, \overline{\alpha}\,y_f + y_g\rangle$ wait — carefully: $\alpha f(x) = \alpha\langle x,y_f\rangle = \langle x, \overline\alpha y_f\rangle$ . Thus $\Phi(\alpha f + g) = \overline\alpha\, y_f + y_g$ , i.e. $\Phi$ is conjugate-linear. Surjectivity is immediate since every $y\in H$ defines $f_y(x)=\langle x,y\rangle\in H^*$ . $\blacksquare$

∎

⚠️ Completeness is essential

Step 2 invokes the projection theorem, which requires $H$ to be complete. On a non-complete inner product space the theorem fails: there exist bounded functionals with no representing vector. Completeness is not merely a convenience — it is logically necessary.

mathematician · Frigyes Riesz | 1880–1956

Hungarian mathematician, a founder of functional analysis. In 1907 Riesz and, independently, Maurice Fréchet established the representation of continuous linear functionals on $L^2$ via inner products — the prototype of the modern theorem. Riesz also proved the $C(X)^*$ representation by measures (1909), introduced the spaces now bearing the names $L^p$ , and developed the theory of compact (completely continuous) operators. His textbook with Béla Szőkefalvi-Nagy, Leçons d'analyse fonctionnelle (1952), shaped generations. The breadth of his contributions means "the Riesz theorem" can refer to several distinct results; context disambiguates.

🧠 Intuition

Think of a linear functional as a "measuring device" that assigns a number to each vector. In finite dimensions every such device is dotting against some fixed vector — its gradient. Riesz says this picture survives intact in infinite dimensions provided the space is complete: the functional still has a gradient, a single arrow $y_f$ , and the functional reads off the (signed) length of the projection of $x$ onto that arrow, scaled by $\|y_f\|$ . The kernel of $f$ is the hyperplane perpendicular to $y_f$ ; the further $x$ sticks out beyond that hyperplane, the larger $f(x)$ . The norm identity $\|f\| = \|y_f\|$ says: a steeper functional corresponds to a longer gradient arrow.

Figure

Geometry of Riesz representation: the functional as projection onto its gradient direction

y_f

ExampleSequence space

\ell^2

Given. Define $f:\ell^2(\mathbb{C})\to\mathbb{C}$ by $f(x) = \sum_{n=1}^\infty \dfrac{x_n}{n}$ for $x=(x_n)$ .

Step 1 — Boundedness. By Cauchy–Schwarz, $|f(x)| \le \big(\sum |x_n|^2\big)^{1/2}\big(\sum 1/n^2\big)^{1/2}$ , and $\sum 1/n^2 = \pi^2/6$ . So $f$ is bounded with $\|f\| \le \pi/\sqrt6$ .

Step 2 — Identify $y_f$ . Write $f(x) = \langle x, y_f\rangle = \sum x_n \overline{(y_f)_n}$ . Matching coefficients, $\overline{(y_f)_n} = 1/n$ , i.e. $(y_f)_n = 1/n$ (real). Then $y_f = (1, \tfrac12, \tfrac13, \dots) \in \ell^2$ since $\sum 1/n^2 < \infty$ .

Step 3 — Norm. $\|y_f\| = \big(\sum 1/n^2\big)^{1/2} = \pi/\sqrt6$ , and by [4], $\|f\| = \|y_f\|$ (the Cauchy–Schwarz bound is achieved).

\boxed{\,y_f = \left(\tfrac1n\right)_{n\ge1},\qquad \|f\| = \|y_f\| = \dfrac{\pi}{\sqrt{6}} \approx 1.2825\,}

⚠️ Linear vs. conjugate-linear; convention clash

With the inner product linear in the first slot, $\Phi:H^*\to H$ is conjugate-linear. Physicists use $\langle\cdot,\cdot\rangle$ linear in the second slot (Dirac), which swaps where the conjugation lands; then the bra $\langle\psi|$ is the Riesz functional of the ket $|\psi\rangle$ , and the map ket $\mapsto$ bra is antilinear. Both communities are consistent internally — always state your convention. A second pitfall: $\|f\| = \|y_f\|$ is an isometry, but $\Phi$ is not an isometric linear isomorphism over $\mathbb{C}$ (it reverses scalar multiplication by conjugation).

CounterexampleFailure on an incomplete inner product space

Let $H_0$ be the inner product space of finitely-supported sequences (a dense, non-complete subspace of $\ell^2$ ), with the $\ell^2$ inner product. Define $f(x) = \sum_n x_n/n$ , bounded with $\|f\| = \pi/\sqrt6$ . Its only candidate representative is $y_f = (1/n)_n$ , which is not finitely supported, hence $y_f \notin H_0$ . So $f$ is a bounded functional on $H_0$ with no representing vector in $H_0$ . Completeness is genuinely required; Riesz can fail on pre-Hilbert spaces.

connection · Where Riesz sits in functional analysis

The theorem is the linchpin connecting several pillars. It yields adjoint operators: given bounded $T:H\to H$ , the functional $x\mapsto \langle Tx, y\rangle$ is represented by $T^*y$ , defining $T^*$ — the gateway to the Spectral Theorem for self-adjoint and normal operators. It powers the Lax–Milgram theorem and hence existence/uniqueness of weak solutions to elliptic Partial Differential Equations. Within Banach Space Duality it shows Hilbert spaces are reflexive and self-dual, a sharp contrast with $L^1$ , $C(X)$ , etc. It also undergirds Reproducing Kernel Hilbert Spaces, where bounded point evaluation forces a kernel function, and connects to the Radon–Nikodym Theorem (Riesz functional ⟷ density), which von Neumann used to prove Radon–Nikodym via Riesz.

🔬 Named uses across science

⏳ History

- 1902–1906 — Lebesgue's integration theory creates the function spaces (

L^2

) on which the theorem will live.

- 1907 — Frigyes Riesz and, independently, Maurice Fréchet publish the representation of continuous linear functionals on

L^2

as integrals against an

L^2

function — the original Riesz–Fréchet theorem.

- 1909 — Riesz proves the measure-theoretic representation: positive linear functionals on

C[0,1]

are integrals against (Stieltjes) measures.

- 1910–1913 — Riesz develops

L^p

spaces and the duality

L^p{}^* \cong L^{q}

; the

p=2

case is the inner-product theorem.

- 1927 — John von Neumann axiomatizes Hilbert space; the abstract projection theorem makes the modern, geometry-based proof possible and universal.

- 1932 — Stefan Banach's Théorie des opérations linéaires systematizes dual spaces, placing Riesz within general duality theory.

- 1940s–50s — Kakutani, Markov, Banach generalize the

C(X)^*

theorem to locally compact Hausdorff

X

with Radon measures (the modern "Riesz–Markov–Kakutani" theorem).

- 1950 — Lax & Milgram extend the representation to bounded coercive sesquilinear forms, enabling the variational theory of PDE.

- 1955 — Riesz–Szőkefalvi-Nagy textbook canonizes the proof and terminology used today.

open-problem · Boundaries of the principle

The Hilbert-space theorem is complete and not open, but its boundaries are subtle and active. (i) Non-Hilbert duality is irregular: $L^1(\mu)^* = L^\infty(\mu)$ only under $\sigma$ -finiteness; $C(X)^*$ requires the full Radon-measure machinery; spaces like $L^\infty$ and $\ell^\infty$ are not even reflexive, and their precise duals invoke finitely-additive measures and Stone–Čech compactifications — describing these "exotic" functionals concretely is genuinely hard. (ii) Riesz on non-self-adjoint / indefinite forms. Krein-space and Pontryagin-space analogues replace positive-definiteness with an indefinite metric; the representing element exists but the clean isometry [4] degrades, and open questions persist about operator representations on indefinite inner-product spaces. (iii) Quantitative/effective versions. In computable and constructive analysis, the non-constructive projection step means the representative $y_f$ may not be effectively computable from $f$ without additional modulus-of-continuity data — characterizing exactly when it is computable remains a research theme. (iv) Operator-valued and rigged-Hilbert-space extensions (Gelfand triples) handle unbounded functionals like point evaluation and the Dirac delta, but the precise distributional duality is delicate.

Formal Statement

Why It Holds / Derivation

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also