The Arzela-Ascoli Theorem
The Arzelà–Ascoli Theorem characterizes the relatively compact subsets of , the space of continuous functions on a compact space: a family is relatively compact (in the uniform norm) if and only if it is uniformly bounded and equicontinuous. It is the principal tool for extracting uniformly convergent subsequences. Applies in: ODE/PDE existence theory, functional analysis, harmonic analysis, dynamical systems. Originated with Cesare Arzelà and Giulio Ascoli, Italy, 1880s–1890s.
Boundedness gives you control at each point; equicontinuity transfers that control uniformly across points. The marriage of the two lets a diagonal argument pick out a subsequence that converges first on a countable dense set, and then equicontinuity spreads that pointwise convergence into uniform convergence on the whole compact domain. Compactness = (pointwise pre-compactness on a dense set) + (uniform regularity that interpolates the rest).
Formal Statement
Let and be metric spaces and a family of continuous functions.
- is equicontinuous at a point if
Derivation hint: This is ordinary continuity at , but with a single valid for ALL simultaneously — the quantifier sits inside, not outside.
- is (pointwise) equicontinuous if it is equicontinuous at every .
- is uniformly equicontinuous if may be chosen independent of :
Derivation hint: Move the out from after to before it; on a compact the two notions coincide (proved below).
is:
- pointwise bounded if for each , ;
- uniformly bounded if .
On a compact , pointwise boundedness + equicontinuity automatically upgrades to uniform boundedness.
Let be a compact metric space and let . If 1. is uniformly bounded: , and 2. is equicontinuous, then has a subsequence converging uniformly on (i.e. in the norm ).
Let be a compact Hausdorff space. A subset is relatively compact (its closure is compact) in if and only if is pointwise bounded and equicontinuous. Equivalently: is relatively compact it is uniformly bounded and equicontinuous. Since is a complete metric space, relative compactness total boundedness of .
If is compact and is pointwise equicontinuous, then is uniformly equicontinuous.
Why It Holds — Derivation
Step 1 — A countable dense set. Since is a compact metric space, it is separable. Choose a countable dense subset .
Step 2 — Diagonal extraction of pointwise convergence on . At , the sequence lies in a bounded subset of (by uniform boundedness), hence by Bolzano–Weierstrass has a convergent subsequence . From it, the values at are bounded, giving a further subsequence converging at (and still at ). Iterate. Define the diagonal sequence
Derivation hint: is, after the -th term, a subsequence of , so it converges at for every — the classic Cantor diagonal trick. Thus converges for every .
Step 3 — Cauchy estimate via equicontinuity (the spreading). Fix . By equicontinuity (uniform, since compact) pick so that
Derivation hint: Use Definition [2] with the single valid for the whole family . By compactness, is covered by finitely many balls , , with (density lets us put centers in ).
Step 4 — Uniform Cauchy. For each , converges, hence is Cauchy: choose such that for all . For arbitrary , pick with . Then for :
Derivation hint: Triangle inequality; first and third terms controlled by [4], middle by Step 4's pointwise Cauchy choice — and depends on but the bound does not. Therefore is uniformly Cauchy. Since is complete, uniformly, and (uniform limit of continuous functions is continuous).
∎Suppose is compact in .
Bounded. A compact subset of a metric space is bounded, so — uniform boundedness.
Equicontinuous. Compactness total boundedness: given there exist forming an -net, i.e. every satisfies for some . Each is uniformly continuous on compact , so there is with . Let . Then for any and :
Derivation hint: The finitely many "anchor" the whole family; total boundedness converts a continuity statement for each anchor into equicontinuity for all of .
∎Assume pointwise equicontinuous on compact ; fix . For each pick so that for all . The balls cover ; extract a finite subcover with centers and set . If , then for some , and , so both lie within of ; hence
Derivation hint: A Lebesgue-number / finite-subcover argument; the same trick that promotes continuity to uniform continuity on a compact set.
∎Giulio Ascoli (Trieste, Milan) introduced the notion of equicontinuity in 1883–84 while studying the question of when a set of curves admits a "limit curve," giving the sufficiency of equicontinuity for extracting convergent sequences. Cesare Arzelà (Bologna) sharpened and completed the theory in the 1880s–1895, establishing the necessary and sufficient characterization and applying it to the existence of solutions of differential equations and to the calculus of variations. Arzelà's work on the term-by-term integration of series and on functions of lines (functionals) places him among the founders of functional analysis, alongside Vito Volterra. The theorem fuses their contributions: Ascoli's concept, Arzelà's completeness.
Building Intuition
Picture each as a wiggly graph over . Uniform boundedness keeps all the graphs trapped in a horizontal band — they can't run off to infinity. Equicontinuity caps how fast any of them can wiggle: no matter which function you pick, moving a little in changes the height by only a little, with the same "little" working for the whole family. A bounded but wildly oscillating family (frequencies ) escapes compactness because no subsequence settles down. Equicontinuity forbids the runaway oscillation, so the graphs are "tame" enough that a diagonal-selected subsequence — which already agrees at a dense scaffold of points — has nowhere to misbehave in the gaps. In finite dimensions, bounded relatively compact (Heine–Borel). In that fails; equicontinuity is exactly the extra ingredient that restores it.
Worked Examples
Given. For define by
Question. Show has a uniformly convergent subsequence and estimate the equicontinuity modulus.
Step 1 — Uniform bound. Since ,
So the family is uniformly bounded by .
Step 2 — Equicontinuity via a common Lipschitz constant. For ,
Every is -Lipschitz, so given choose (independent of ): equicontinuous.
Step 3 — Conclude. By Arzelà–Ascoli, a subsequence uniformly on . (Here in fact uniformly by Riemann–Lebesgue–type cancellation, consistent with .)
Boxed answer. is uniformly bounded () and -Lipschitz-equicontinuous relatively compact; a uniformly convergent subsequence exists, with modulus .
Given. The ODE , , with continuous and bounded on a box , .
Step 1 — Euler/approximate solutions. Construct piecewise-linear approximations with mesh satisfying and slopes from . Each is -Lipschitz in .
Step 2 — Uniform bound. , so . Uniformly bounded.
Step 3 — Equicontinuity. From the -Lipschitz property, for all . Choose : equicontinuous, independent of .
Step 4 — Apply A–A. A subsequence uniformly on . Passing to the limit in the integral form
gives , i.e. solves the ODE.
Boxed answer. A solution exists on with — Peano's theorem, proved purely by compactness, with no Lipschitz / uniqueness assumption on .
Common Misconceptions
Pointwise boundedness is not uniform boundedness in general, and pointwise convergence of a subsequence does not give uniform convergence — equicontinuity is what bridges them. Two further traps: 1. Dropping compactness of the domain. On a non-compact domain (e.g. ) uniform boundedness + equicontinuity does not imply a uniformly convergent subsequence — mass can escape to infinity. One needs a locally uniform / -compact version with a diagonal argument over an exhaustion. 2. Equicontinuity is a property of the family, not of single functions. Every can be uniformly continuous while fails to be equicontinuous.
Let on . Each is smooth, (uniformly bounded). But is not equicontinuous: near any point the slope blows up, so no single works for all . Indeed has no uniformly (nor even pointwise) convergent subsequence — by for , no subsequence is Cauchy in , hence none in sup norm. Compactness fails precisely because equicontinuity fails.
Escape-to-infinity counterexample on a non-compact domain. on , a fixed bump. Uniformly bounded and equicontinuous, yet the only pointwise limit is and convergence is not uniform; no subsequence converges uniformly on . Compactness of the domain is essential.
Connections
Arzelà–Ascoli is the prototype of all compactness-by-extraction theorems and sits in a web of related results:
- <span class="wiki-link-missing">Heine–Borel Theorem</span> — finite-dimensional ancestor; A–A is its replacement in , with equicontinuity standing in for the boundedness that no longer suffices.
- <span class="wiki-link-missing">Stone–Weierstrass Theorem</span> — companion structural theorem on : density (approximation) versus A–A's compactness (selection).
- <span class="wiki-link-missing">Banach–Alaoglu Theorem</span> — the dual phenomenon: weak-* compactness of bounded sets; A–A can be derived as a special case in suitable settings.
- <span class="wiki-link-missing">Rellich–Kondrachov Theorem</span> — Sobolev-space analogue: compact embedding on bounded domains, proved using A–A-type equicontinuity estimates via Sobolev bounds.
- <span class="wiki-link-missing">Montel's Theorem</span> — complex-analytic refinement: a locally bounded family of holomorphic functions is normal, because Cauchy estimates supply equicontinuity automatically.
- <span class="wiki-link-missing">Modulus of Continuity</span> — equicontinuity = a common modulus of continuity for the whole family.
Real-World Applications
Historical Development
Subtleties & Limits
Beyond classical compact domains. The theorem's reach depends delicately on the target and domain structure:
- Infinite-dimensional or non-locally-compact targets. For maps into a general metric space , one must add that for each the set is relatively compact in — "uniform boundedness" alone is insufficient when is infinite-dimensional. Finding sharp, easily-checkable target conditions in Banach-valued settings remains delicate.
- Vector-valued and operator-valued analogues. Characterizing compactness of families of operators or of -valued maps in the strong/weak topologies blends A–A with weak-compactness theory (Dunford–Pettis, Eberlein–Šmulian); clean criteria are case-specific.
- Quantitative / effective versions. Translating "a subsequence converges" into explicit rates (effective Arzelà–Ascoli) requires modulus-of-continuity bookkeeping and is an active topic in computable analysis and reverse mathematics, where the theorem is known to be non-constructive (it implies weak König's lemma).
- Optimal regularity substitutes. In PDE, replacing equicontinuity by fractional Sobolev or Besov compactness (Aubin–Lions–Simon lemmas for time-dependent problems) continues to be refined for nonlinear evolution equations.
See Also
Heine–Borel Theorem · Stone–Weierstrass Theorem · Banach–Alaoglu Theorem · Montel's Theorem · Rellich–Kondrachov Theorem · Modulus of Continuity · Uniform Convergence · Peano Existence Theorem · Aubin–Lions Lemma