Spectral Theory of Compact Operators

⚡ Key Takeaways

Compact operators on a Banach (or Hilbert) space have spectra that behave almost like those of matrices: the nonzero spectrum consists of at most countably many eigenvalues of finite multiplicity, accumulating only at 00. The central result is the Riesz–Schauder theory and, for self-adjoint compact operators, the spectral theorem giving an orthonormal eigenbasis. Applies throughout integral equations, PDE eigenvalue problems, and quantum mechanics. Developed by Fredholm, Hilbert, Schmidt, F. Riesz, and Schauder (1900–1930).

💡 The Core Insight

Compactness forces the operator to "almost factor through finite dimensions." The Fredholm alternative for T−λIT - \lambda I (λ≠0\lambda \neq 0) then holds verbatim as in linear algebra: either T−λIT - \lambda I is invertible, or λ\lambda is an eigenvalue with finite-dimensional eigenspace and finite Riesz index. The infinitude of XX is squeezed into a single accumulation point at the origin.

Formal Statement

DefinitionCompact Operator

Let X,YX, Y be Banach spaces. A linear map T:X→YT: X \to Y is compact if T(BX)‾\overline{T(B_X)} is compact in YY, where BX={x:∥x∥≤1}B_X = \{x : \|x\| \le 1\}. Equivalently, TT is compact iff for every bounded sequence (xn)⊂X(x_n) \subset X, the sequence (Txn)(Tx_n) has a convergent subsequence. We write T∈K(X,Y)T \in \mathcal{K}(X,Y).

DefinitionSpectrum and Its Parts

For a bounded operator TT on a complex Banach space XX, the resolvent set is

1
ρ(T)={λ∈C:(T−λI)−1∈B(X)},\quad \rho(T) = \{\lambda \in \mathbb{C} : (T - \lambda I)^{-1} \in \mathcal{B}(X)\},

Derivation hint: λ∈ρ(T)\lambda \in \rho(T) iff T−λIT-\lambda I is a bijection of XX; boundedness of the inverse is then automatic by the open mapping theorem. and the spectrum is σ(T)=C∖ρ(T)\sigma(T) = \mathbb{C} \setminus \rho(T). It decomposes as

2
σ(T)=σp(T) ∪ σc(T) ∪ σr(T),\quad \sigma(T) = \sigma_p(T) \,\cup\, \sigma_c(T) \,\cup\, \sigma_r(T),

Derivation hint: classify T−λIT-\lambda I by injectivity and density/closedness of range — point spectrum (not injective), continuous spectrum (injective, dense non-closed range), residual spectrum (injective, non-dense range). where σp\sigma_p (point/eigenvalues), σc\sigma_c (continuous), σr\sigma_r (residual).

TheoremRiesz–Schauder Spectral Theorem for Compact Operators

Let XX be an infinite-dimensional complex Banach space and T∈K(X)T \in \mathcal{K}(X). Then: 1. 0∈σ(T)0 \in \sigma(T). 2. σ(T)∖{0}\sigma(T) \setminus \{0\} consists entirely of eigenvalues. 3. Each nonzero λ∈σ(T)\lambda \in \sigma(T) has finite algebraic and geometric multiplicity:

3
dim⁡ker⁡(T−λI)k<∞for all k≥1,\quad \dim \ker(T - \lambda I)^k < \infty \quad \text{for all } k \ge 1,

Derivation hint: ker⁡(T−λI)k\ker(T-\lambda I)^k is a closed subspace on which TT acts as λI\lambda I + nilpotent; compactness restricted to it forces finite dimension since the identity on it must be compact. 4. σ(T)\sigma(T) is at most countable, and its only possible accumulation point is 00:

4
∀ε>0,#{λ∈σ(T):∣λ∣≥ε}<∞.\quad \forall \varepsilon > 0,\quad \#\{\lambda \in \sigma(T) : |\lambda| \ge \varepsilon\} < \infty.

Derivation hint: an infinite sequence of distinct eigenvalues bounded away from 00 produces, via near-orthonormal eigenvectors and Riesz's lemma, a bounded sequence whose images have no convergent subsequence — contradicting compactness.

TheoremFredholm Alternative

For T∈K(X)T \in \mathcal{K}(X) and λ≠0\lambda \neq 0, exactly one holds: (a) T−λIT - \lambda I is bijective (so λ∈ρ(T)\lambda \in \rho(T) and the equation (T−λI)u=f(T-\lambda I)u = f has a unique solution for every ff); (b) ker⁡(T−λI)≠{0}\ker(T - \lambda I) \neq \{0\}, with

5
dim⁡ker⁡(T−λI)=dim⁡ker⁡(T∗−λˉI)=codim⁡ ran⁡(T−λI)<∞.\quad \dim \ker(T - \lambda I) = \dim \ker(T^* - \bar\lambda I) = \operatorname{codim}\,\operatorname{ran}(T - \lambda I) < \infty.

Derivation hint: T−λI=−λ(I−λ−1T)T-\lambda I = -\lambda(I - \lambda^{-1}T) is a "compact perturbation of the identity"; its index is 00 by the Riesz theory, equating kernel and cokernel dimensions, with solvability of (T−λI)u=f(T-\lambda I)u=f governed by the orthogonality ⟨f,w⟩=0\langle f, w\rangle = 0 for all w∈ker⁡(T∗−λˉI)w \in \ker(T^*-\bar\lambda I).

TheoremHilbert–Schmidt / Spectral Theorem for Compact Self-Adjoint Operators

Let HH be a separable Hilbert space and T=T∗∈K(H)T = T^* \in \mathcal{K}(H). Then there exist real eigenvalues (λn)(\lambda_n) with ∣λ1∣≥∣λ2∣≥⋯→0|\lambda_1| \ge |\lambda_2| \ge \cdots \to 0 and an orthonormal system (en)(e_n) of eigenvectors, Ten=λnenTe_n = \lambda_n e_n, such that

6
Tx=∑nλn⟨x,en⟩ en∀x∈H,\quad Tx = \sum_{n} \lambda_n \langle x, e_n\rangle\, e_n \qquad \forall x \in H,

Derivation hint: existence of a largest eigenvalue follows from ∥T∥=sup⁡∥x∥=1∣⟨Tx,x⟩∣\|T\| = \sup_{\|x\|=1}|\langle Tx,x\rangle| being attained by a compactness/weak-limit argument; iterate on the orthogonal complement and use that eigenvectors for distinct eigenvalues are orthogonal. and the (en)(e_n) together with an orthonormal basis of ker⁡T\ker T form an orthonormal basis of HH. Moreover ∥T∥=max⁡n∣λn∣=∣λ1∣\|T\| = \max_n |\lambda_n| = |\lambda_1|.

Why It Holds

ProofRiesz Theory: discreteness of nonzero spectrum

Let T∈K(X)T \in \mathcal{K}(X), λ≠0\lambda \neq 0. Set S=T−λIS = T - \lambda I.

Step 1 — Kernel is finite-dimensional. On N:=ker⁡S=ker⁡(T−λI)N := \ker S = \ker(T - \lambda I) we have Tx=λxTx = \lambda x, so T∣N=λINT|_N = \lambda I_N. Since TT is compact and λ≠0\lambda \neq 0, the identity IN=λ−1T∣NI_N = \lambda^{-1} T|_N is compact, forcing dim⁡N<∞\dim N < \infty (a normed space with compact unit ball is finite-dimensional, by Riesz's lemma).

Step 2 — Range is closed. Write X=N⊕MX = N \oplus M with MM closed complement (possible since NN is finite-dimensional). The restriction S∣M:M→ran⁡SS|_M : M \to \operatorname{ran} S is injective; one shows ∥Sx∥≥c∥x∥\|Sx\| \ge c\|x\| on MM for some c>0c>0, otherwise a unit sequence xn∈Mx_n \in M with Sxn→0Sx_n \to 0 gives, via compactness of TT, a convergent subsequence xnk→x∈Mx_{n_k} \to x \in M with Sx=0Sx = 0, contradicting injectivity on MM. Hence ran⁡S\operatorname{ran} S is closed.

Step 3 — Finiteness of the spectrum off any disk. Suppose (λn)(\lambda_n) are distinct eigenvalues with ∣λn∣≥ε>0|\lambda_n| \ge \varepsilon > 0 and eigenvectors unu_n. The unu_n are linearly independent; let Xn=span⁡(u1,…,un)X_n = \operatorname{span}(u_1,\dots,u_n), a strictly increasing chain of closed subspaces. By Riesz's lemma pick yn∈Xny_n \in X_n, ∥yn∥=1\|y_n\|=1, dist⁡(yn,Xn−1)≥12\operatorname{dist}(y_n, X_{n-1}) \ge \tfrac12. For m<nm < n one computes

7
∥Tyn−Tym∥=∥λnyn−(λnyn−Tyn+Tym)∥≥∣λn∣2≥ε2,\quad \|Ty_n - Ty_m\| = \|\lambda_n y_n - (\lambda_n y_n - Ty_n + Ty_m)\| \ge \tfrac{|\lambda_n|}{2} \ge \tfrac{\varepsilon}{2},

Derivation hint: (λnI−T)yn(\lambda_n I - T)y_n and TymTy_m both lie in Xn−1X_{n-1}, while λnyn\lambda_n y_n projects to ≥1/2\ge 1/2 distance from Xn−1X_{n-1}; combine with TT acting triangularly on the chain. so (Tyn)(Ty_n) has no Cauchy subsequence, contradicting compactness. Thus only finitely many ∣λn∣≥ε|\lambda_n| \ge \varepsilon.

Step 4 — Index zero / Fredholm. The ascending kernels ker⁡Sk\ker S^k stabilize at finite index pp (the Riesz index), and X=ker⁡Sp⊕ran⁡SpX = \ker S^p \oplus \operatorname{ran} S^p. On the finite-dimensional ker⁡Sp\ker S^p, SS is nilpotent; on ran⁡Sp\operatorname{ran} S^p, SS is bijective. This yields dim⁡ker⁡S=codim⁡ran⁡S\dim\ker S = \operatorname{codim}\operatorname{ran} S, the Fredholm alternative. ■\blacksquare

∎
ProofSpectral theorem for compact self-adjoint TT

Step 1 — Largest eigenvalue. For self-adjoint TT, ∥T∥=sup⁡∥x∥=1∣⟨Tx,x⟩∣\|T\| = \sup_{\|x\|=1}|\langle Tx,x\rangle|. Take ∥xn∥=1\|x_n\|=1 with ⟨Txn,xn⟩→λ1\langle Tx_n,x_n\rangle \to \lambda_1 where ∣λ1∣=∥T∥|\lambda_1|=\|T\|. By compactness Txn→yTx_n \to y (subsequence) and one shows ∥Txn−λ1xn∥2=∥Txn∥2−2λ1⟨Txn,xn⟩+λ12→0\|Tx_n - \lambda_1 x_n\|^2 = \|Tx_n\|^2 - 2\lambda_1\langle Tx_n,x_n\rangle + \lambda_1^2 \to 0, so xn→λ1−1y=:e1x_n \to \lambda_1^{-1} y =: e_1 is a unit eigenvector with Te1=λ1e1Te_1 = \lambda_1 e_1 (assuming T≠0T\neq 0).

Step 2 — Iterate. The orthogonal complement {e1}⊥\{e_1\}^\perp is TT-invariant (self-adjointness), and T∣{e1}⊥T|_{\{e_1\}^\perp} is again compact self-adjoint with norm ∣λ2∣≤∣λ1∣|\lambda_2| \le |\lambda_1|. Repeat to extract e2,e3,…e_2, e_3, \dots.

Step 3 — Convergence to zero. If infinitely many λn\lambda_n occur, ∣λn∣=∥T∣{e1,…,en−1}⊥∥→0|\lambda_n| = \|T|_{\{e_1,\dots,e_{n-1}\}^\perp}\| \to 0, since otherwise Step 3 of the Riesz proof is violated.

Step 4 — Completeness on (ker⁡T)⊥(\ker T)^\perp. For x∈Hx \in H, x−∑n⟨x,en⟩enx - \sum_n \langle x,e_n\rangle e_n lies in ⋂n{en}⊥\bigcap_n \{e_n\}^\perp where TT has norm →0\to 0, hence TT vanishes there: the residual lies in ker⁡T\ker T. Equation [6] follows. ■\blacksquare

∎
DH
David Hilbert
1862–1943

Hilbert's six papers on integral equations (1904–1910) introduced the spectral viewpoint that now bears his name. He treated kernels K(s,t)K(s,t) as infinite "matrices," developed eigenvalue expansions, and coined the language of bilinear and quadratic forms in infinitely many variables. His student Erhard Schmidt then geometrized the theory into the language of orthonormal systems and what we now call Hilbert spaces, making the compact self-adjoint spectral theorem a clean geometric statement.

Building Intuition

🧠 Intuition

Think of a compact operator as a matrix whose entries decay fast enough that it is "almost finite." A diagonal operator Ten=λnenT e_n = \lambda_n e_n on ℓ2\ell^2 is compact iff λn→0\lambda_n \to 0 — the eigenvalues must drain toward zero. The accumulation at 00 is unavoidable: there simply is not "room" in a bounded set's image to keep large eigenvalues spread out, because compactness demands convergent subsequences. The single point 00 is where all the infinite-dimensional complexity gets dumped; everything else looks like ordinary linear algebra, complete with eigenvalues, multiplicities, and a Jordan-like structure (the Riesz index pp).

Figure
Spectrum of a compact operator: eigenvalues accumulating only at the origin
Re Im 0 λ₁ λ₂ λ₃ |λ|≥ε: finitely many accumulation only at 0

Worked Examples

ExampleDiagonal compact operator on ℓ2\ell^2

Given. T:ℓ2→ℓ2T: \ell^2 \to \ell^2, T(x1,x2,x3,… )=(x1,x22,x33,… )T(x_1, x_2, x_3, \dots) = (x_1, \tfrac{x_2}{2}, \tfrac{x_3}{3}, \dots), i.e. Ten=1nenTe_n = \tfrac1n e_n.

Step 1 — Compactness. The finite-rank truncations TN(x)=(x11,…,xNN,0,… )T_N(x) = (\tfrac{x_1}{1}, \dots, \tfrac{x_N}{N}, 0, \dots) satisfy ∥T−TN∥=1N+1→0\|T - T_N\| = \tfrac{1}{N+1} \to 0. A norm-limit of finite-rank operators is compact, so T∈K(ℓ2)T \in \mathcal{K}(\ell^2).

Step 2 — Eigenvalues. σp(T)={1,12,13,… }\sigma_p(T) = \{1, \tfrac12, \tfrac13, \dots\}, each simple, with eigenvector ene_n.

Step 3 — Spectrum. The accumulation point 00 must be included: σ(T)={1n:n≥1}∪{0}\sigma(T) = \{\tfrac1n : n\ge1\} \cup \{0\}. Note 00 is not an eigenvalue (TT is injective) but lies in σc(T)\sigma_c(T) since ran⁡T\operatorname{ran} T is dense but not closed.

Answer.

σ(T)={1,12,13,… }∪{0},0∈σc(T), ∥T∥=1.\boxed{\sigma(T) = \{1, \tfrac12, \tfrac13, \dots\}\cup\{0\}, \quad 0 \in \sigma_c(T),\ \|T\| = 1.}
ExampleSolving an integral equation via the Fredholm alternative

Given. The Fredholm equation u(s)−μ∫01st u(t) dt=f(s)u(s) - \mu \int_0^1 st\, u(t)\,dt = f(s) on L2[0,1]L^2[0,1], with kernel K(s,t)=stK(s,t) = st.

Step 1 — Identify the operator. Tu(s)=∫01st u(t) dt=s⟨u,t⟩L2T u(s) = \int_0^1 st\,u(t)\,dt = s\langle u, t\rangle_{L^2}. This is rank one (range =span⁡{s}= \operatorname{span}\{s\}), hence compact and self-adjoint.

Step 2 — Eigenvalue. Tu=λuTu = \lambda u forces u(s)=c su(s) = c\,s. Then T(s)=s∫01t⋅t dt=s⋅13T(s) = s\int_0^1 t\cdot t\,dt = s\cdot \tfrac13. So the single nonzero eigenvalue is λ1=13\lambda_1 = \tfrac13 with eigenvector e1(s)=3 se_1(s) = \sqrt{3}\,s.

Step 3 — Apply Fredholm alternative for μTu−u\mu T u - u. We solve (I−μT)u=f(I - \mu T)u = f. This is uniquely solvable iff 1μ∉σp(T)∖{0}\tfrac1\mu \notin \sigma_p(T)\setminus\{0\}, i.e. iff μ≠1λ1=3\mu \neq \tfrac{1}{\lambda_1} = 3.

Step 4 — Explicit solution for μ≠3\mu \neq 3. Write u=f+μs cu = f + \mu s\,c with c=⟨u,t⟩c = \langle u, t\rangle. Then c=⟨f,t⟩+μc⟨s,t⟩=⟨f,t⟩+μ3cc = \langle f,t\rangle + \mu c\langle s,t\rangle = \langle f,t\rangle + \tfrac{\mu}{3}c, giving c=⟨f,t⟩1−μ/3c = \dfrac{\langle f,t\rangle}{1 - \mu/3}.

Answer.

u(s)=f(s)+μ s1−μ/3∫01t f(t) dt,μ≠3;\boxed{u(s) = f(s) + \frac{\mu\,s}{1 - \mu/3}\int_0^1 t\,f(t)\,dt, \qquad \mu \neq 3;}

for μ=3\mu = 3 the equation is solvable iff ∫01tf(t) dt=0\int_0^1 t f(t)\,dt = 0 (Fredholm orthogonality).

Common Misconceptions

⚠️ Common mistake

"00 is always an eigenvalue of a compact operator." False. 00 always lies in the spectrum (in infinite dimensions), but it need not be an eigenvalue: the diagonal operator Ten=1nenTe_n = \tfrac1n e_n is injective, so ker⁡T={0}\ker T = \{0\}, yet 0∈σc(T)0 \in \sigma_c(T). The statement "0∈σ(T)0 \in \sigma(T)" holds because a compact operator on an infinite-dimensional space cannot be invertible — its inverse would make the identity compact.

⚠️ Common mistake

"Compact operators always have at least one eigenvalue." False in general Banach (and even Hilbert) spaces if TT is not self-adjoint or normal. The nonzero spectrum can be empty — see the counterexample below. The spectral theorem's guaranteed eigenbasis requires self-adjointness (or normality, via σp\sigma_p on C\mathbb{C}).

CounterexampleCompact operator with no nonzero eigenvalues

The Volterra operator on L2[0,1]L^2[0,1],

8
(Vu)(s)=∫0su(t) dt,\quad (Vu)(s) = \int_0^s u(t)\,dt,

Derivation hint: VV is Hilbert–Schmidt with kernel K(s,t)=1{t≤s}K(s,t)=\mathbf 1_{\{t\le s\}}, hence compact; a suspected eigenfunction Vu=λuVu = \lambda u with λ≠0\lambda\neq0 would be differentiable with u′=λ−1uu' = \lambda^{-1}u, u(0)=0u(0)=0, forcing u≡0u\equiv 0. is compact but quasinilpotent: σ(V)={0}\sigma(V) = \{0\} and it has no eigenvalues at all. This shows the Riesz theory guarantees only that the nonzero spectrum consists of eigenvalues — it does not guarantee any exist. (VV is non-self-adjoint; V+V∗V + V^* is the rank-one projection-like operator with full real eigenvalue structure.)

Connections

connection

The compact spectral theorem sits inside a hierarchy. It is the cleanest case of the Spectral Theorem for Bounded Self-Adjoint Operators, which for non-compact operators replaces the discrete sum [6] by an integral against a Projection-Valued Measure. Compact operators form a closed two-sided ideal in B(X)\mathcal{B}(X); quotienting yields the Calkin Algebra, where invertibility encodes Fredholm Operators of arbitrary index — the Riesz theory is exactly the index-zero, compact-perturbation case. On Hilbert space the compact operators are the closure of finite-rank operators, and the refined classes (trace class, Hilbert–Schmidt Operators, Schatten pp-classes) are defined by summability of the singular values sn(T)s_n(T) — the eigenvalues of ∣T∣=(T∗T)1/2|T| = (T^*T)^{1/2} from the Singular Value Decomposition.

Real-World Applications

🔬 Where this appears

Historical Development

⏳ History
- 1900–1903 — Ivar Fredholm solves the integral equation u−λKu=fu - \lambda Ku = f using infinite determinants, establishing the "Fredholm alternative" for continuous kernels.
- 1904–1910 — David Hilbert publishes his series on integral equations, introducing eigenvalue expansions and the theory of infinitely many variables (quadratic forms, "vollstetig" = completely continuous operators).
- 1907 — Erhard Schmidt recasts Hilbert's theory geometrically with orthonormal systems, proving the eigenfunction expansion (the Hilbert–Schmidt expansion).
- 1909 — Frigyes Riesz and Maurice Fréchet independently prove the L2L^2 representation theorem, anchoring Hilbert-space methods.
- 1916 — Frigyes Riesz develops the abstract theory of completely continuous (compact) operators on C[a,b]C[a,b], proving discreteness of the spectrum and finite multiplicity — the Riesz theory in essentially modern form.
- 1918 — Riesz proves what is now Riesz's lemma, the key compactness tool for the spectral discreteness argument.
- 1930 — Juliusz Schauder extends the Fredholm alternative to general Banach spaces and proves compactness of the adjoint (Schauder's theorem: TT compact   ⟺  T∗\iff T^* compact).
- 1932 — John von Neumann's Mathematical Foundations of Quantum Mechanics and Stone's work place the spectral theorem on rigorous Hilbert-space footing, distinguishing compact (discrete) from continuous spectra.
- 1940s–1950s — Development of Schatten–von Neumann classes (trace class, Hilbert–Schmidt) quantifies compactness by singular-value summability.

Subtleties & Limits

open-problem

Where the clean theory ends. Several genuinely hard or open issues lurk:

  • Invariant subspace problem. Whether every bounded operator on a separable infinite-dimensional Hilbert space has a nontrivial closed invariant subspace remains open. For compact operators the answer is famously yes — Aronszajn–Smith (1954), extended by Lomonosov (1973) to operators commuting with a nonzero compact operator — making compactness a rare island of resolution within an open ocean.
  • Eigenvalue vs. singular-value asymptotics. The relation between the eigenvalues λn(T)\lambda_n(T) and singular values sn(T)s_n(T) is subtle: Weyl's inequality ∑∣λn∣p≤∑snp\sum|\lambda_n|^p \le \sum s_n^p holds, but precise asymptotics of eigenvalues for non-self-adjoint compact operators (Volterra-type, pseudodifferential) remain delicate and active.
  • Completeness of eigenvectors for non-self-adjoint compact operators is not guaranteed; root-vector completeness (Keldysh-type theorems) requires extra structure and is sharp only under decay conditions on sns_n.
  • Non-quasi-analytic perturbations. Small non-compact perturbations can dissolve the discrete spectrum into continuous spectrum, and pinpointing the essential spectrum under such perturbations connects to deep Fredholm-theoretic stability questions.

See Also

Singular Value Decomposition · Calkin Algebra · Mercer's Theorem · Volterra Operator · Resolvent Identity · Schatten Classes · Weyl's Inequality