Compactness and the Heine-Borel Theorem

⚡ Key Takeaways

Compactness is a topological property that generalizes "closed and bounded." The Heine–Borel Theorem states that a subset of $\mathbb{R}^n$ is compact if and only if it is closed and bounded. Applies throughout real analysis, topology, and optimization wherever existence of maxima, uniform continuity, or convergent subsequences is needed. Named after Eduard Heine (who used the underlying idea c. 1872) and Émile Borel (who proved the covering form in 1895).

💡 The Core Insight

Compactness is finiteness in disguise. It says you can always replace "infinitely many open sets covering $K$ " with "finitely many of them." This single trick lets local information (defined patchwise on the cover) be glued into global, uniform information. Heine–Borel identifies exactly which subsets of Euclidean space enjoy this trick: precisely the closed and bounded ones.

DefinitionOpen Cover and Subcover

Let $K$ be a subset of a topological space $X$ . A collection $\mathcal{U} = \{U_\alpha\}_{\alpha \in A}$ of open sets is an open cover of $K$ if

1

\quad K \subseteq \bigcup_{\alpha \in A} U_\alpha.

Derivation hint: This is the defining inclusion — every point of $K$ lies in at least one $U_\alpha$ . A finite subcover is a finite subcollection $\{U_{\alpha_1}, \dots, U_{\alpha_n}\} \subseteq \mathcal{U}$ that still covers:

2

\quad K \subseteq \bigcup_{i=1}^{n} U_{\alpha_i}.

Derivation hint: Restrict the index set $A$ to a finite subset $\{\alpha_1,\dots,\alpha_n\}$ while preserving the covering inclusion. Here $X$ is the ambient space, $K$ the subset under study, $A$ an arbitrary (possibly uncountable) index set, and each $U_\alpha$ an open set of $X$ .

DefinitionCompactness

A subset $K \subseteq X$ is compact if every open cover of $K$ has a finite subcover. Symbolically,

3

\quad \forall\, \mathcal{U}\ \text{open cover of } K,\ \exists\, \text{finite } F \subseteq A : K \subseteq \bigcup_{\alpha \in F} U_\alpha.

Derivation hint: Universally quantify over covers, existentially over finite subcollections — this is the literal reading of the definition.

DefinitionBoundedness and Total Boundedness

A set $K$ in a metric space $(X,d)$ is bounded if it lies inside some ball:

4

\quad \exists\, x_0 \in X,\ R > 0 :\ K \subseteq B(x_0, R) = \{x : d(x,x_0) < R\}.

Derivation hint: One reference point and one finite radius enclose the whole set. It is totally bounded if for every $\varepsilon > 0$ it can be covered by finitely many $\varepsilon$ -balls:

5

\quad \forall\, \varepsilon > 0,\ \exists\, x_1,\dots,x_m \in X :\ K \subseteq \bigcup_{i=1}^{m} B(x_i, \varepsilon).

Derivation hint: Total boundedness strengthens boundedness by demanding finite covers at every scale $\varepsilon$ , not just one large ball.

TheoremHeine–Borel

Let $K \subseteq \mathbb{R}^n$ with the standard Euclidean metric. The following are equivalent: 1. $K$ is compact (every open cover has a finite subcover); 2. $K$ is sequentially compact (every sequence in $K$ has a subsequence converging to a point of $K$ ); 3. $K$ is closed and bounded; 4. $K$ is complete and totally bounded.

6

\quad K \subseteq \mathbb{R}^n \text{ compact} \iff K \text{ closed and bounded}.

Derivation hint: The headline equivalence (1) ⇔ (3) is the classical Heine–Borel statement; the other equivalences hold in any metric space and the dimensional finiteness of $\mathbb{R}^n$ is what links them to "closed and bounded."

⚠️ Common mistake

The equivalence (3) ⇔ compactness is special to $\mathbb{R}^n$ (and finite-dimensional normed spaces). In a general metric space, "closed and bounded" does not imply compact. The correct general equivalence is complete + totally bounded, statement (4).

ProofClosed and Bounded ⟹ Compact in ℝⁿ

We prove the harder direction of [6] for $\mathbb{R}^n$ .

Step 1 — Reduce to a closed box. Since $K$ is bounded, $K \subseteq Q_0$ for some closed cube

7

\quad Q_0 = [-R, R]^n, \qquad R > 0.

Derivation hint: Boundedness [4] places $K$ in a ball, which sits inside a cube of side $2R$ . It suffices to show $Q_0$ is compact: a closed subset of a compact set is compact (a cover of $K$ together with the open set $\mathbb{R}^n \setminus K$ covers $Q_0$ ; extract a finite subcover and discard $\mathbb{R}^n\setminus K$ ).

Step 2 — Bisection / nested boxes. Suppose, for contradiction, that some open cover $\mathcal{U}$ of $Q_0$ has no finite subcover. Bisect $Q_0$ into $2^n$ congruent subcubes by halving each side. If all $2^n$ pieces admitted finite subcovers, their union $Q_0$ would too. Hence at least one subcube $Q_1$ has no finite subcover. Iterate to obtain nested cubes

8

\quad Q_0 \supseteq Q_1 \supseteq Q_2 \supseteq \cdots,\qquad \operatorname{diam}(Q_k) = \frac{\operatorname{diam}(Q_0)}{2^k} = \frac{2R\sqrt{n}}{2^k}.

Derivation hint: Each bisection halves the side length, hence halves the diameter; the diameter tends to $0$ .

Step 3 — Nested interval / completeness. Each $Q_k$ is a nonempty compact box, and the diameters shrink to $0$ . By completeness of $\mathbb{R}^n$ (Cantor's nested-set property),

9

\quad \bigcap_{k=0}^{\infty} Q_k = \{p\}\quad\text{for a unique point } p \in Q_0.

Derivation hint: A decreasing sequence of nonempty closed sets with diameter $\to 0$ in a complete space has a single common point.

Step 4 — Contradiction. Since $\mathcal{U}$ covers $Q_0$ , some $U \in \mathcal{U}$ contains $p$ ; as $U$ is open there is $\delta>0$ with $B(p,\delta) \subseteq U$ . Choose $k$ so large that $\operatorname{diam}(Q_k) < \delta$ . Then $Q_k \subseteq B(p,\delta) \subseteq U$ , so $\{U\}$ alone is a finite subcover of $Q_k$ — contradicting that $Q_k$ had no finite subcover. Hence $Q_0$ (and therefore $K$ ) is compact. $\blacksquare$

∎

ProofCompact ⟹ Closed and Bounded — in any metric space

Bounded. Fix $x_0 \in K$ and cover $K$ by the expanding balls $\{B(x_0, m)\}_{m \in \mathbb{N}}$ . A finite subcover has a largest radius $M$ , so $K \subseteq B(x_0, M)$ : $K$ is bounded, satisfying [4].

Closed. Let $y \notin K$ . For each $x \in K$ , set $r_x = \tfrac{1}{2}d(x,y) > 0$ ; the balls $\{B(x, r_x)\}_{x\in K}$ cover $K$ . Extract a finite subcover $B(x_1,r_{x_1}),\dots,B(x_m,r_{x_m})$ , and let $r = \min_i r_{x_i} > 0$ . Then $B(y, r)$ is disjoint from every $B(x_i, r_{x_i})$ , hence disjoint from $K$ . So $\mathbb{R}^n \setminus K$ is open and $K$ is closed. $\blacksquare$

∎

mathematician · Émile Borel | 1871–1956

French mathematician who, in his 1894 thesis and 1895 paper, proved that a countable open cover of a closed bounded interval has a finite subcover — the first explicit "covering" statement. The result was later extended to arbitrary (uncountable) covers by Lebesgue, Schoenflies, and others. Borel went on to found modern measure theory (Borel sets, Borel measure) and made early contributions to probability and game theory. The "Heine" half of the name honors Eduard Heine, who in 1872 used the underlying compactness idea to prove that continuous functions on closed intervals are uniformly continuous.

🧠 Intuition

Think of an open cover as a fleet of overlapping "spotlights," each illuminating an open region. Compactness says: no matter how you arrange infinitely many spotlights to light up $K$ , you can switch off all but finitely many and still keep $K$ fully lit. A set fails compactness when it can "escape to the boundary or to infinity" — either by leaking out through a missing endpoint (not closed) or stretching off forever (not bounded). The bisection proof is a "divide and conquer": if no finite team of spotlights works, keep cutting the region in half, always keeping a troublesome piece; these pieces zoom in on a single point $p$ , but the one spotlight covering $p$ floods a whole neighborhood — large enough to swallow a tiny piece. Contradiction.

Figure

Bisection argument: nested boxes shrinking to the limit point p inside a covering open set U

ExampleTesting compactness of three subsets of ℝ

Given. Decide whether each set is compact: (a) $A = [2, 5]$ , (b) $B = (0, 1]$ , (c) $C = \{0\} \cup \{1/n : n \in \mathbb{N}\}$ .

Steps.

(a) $A=[2,5]$ is closed (contains both endpoints) and bounded (lies in $B(0,6)$ ). By Heine–Borel [6], compact.
(b) $B=(0,1]$ is bounded but not closed — the point $0$ is a limit point not in $B$ . Explicit escaping cover: $\mathcal{U} = \{(1/n,\,2) : n \in \mathbb{N}\}$ . Any finite subcollection has a largest $n=N$ , covering only $(1/N,2)$ , missing points near $0$ . No finite subcover ⟹ not compact.
(c) $C$ is bounded (in $[0,1]$ ) and closed (its only limit point $0$ is included). Given any cover, one set $U_0$ contains $0$ , hence all but finitely many $1/n$ ; cover the remaining finitely many points with one set each. Finite subcover exists.

Answer.

\boxed{A \text{ compact},\quad B \text{ not compact},\quad C \text{ compact.}}

ExampleExtreme Value: bounding a continuous function via compactness

Given. $f(x,y) = x^2 + 2y^2 - x$ on the closed disk $K = \{(x,y): x^2+y^2 \le 1\}$ . Show $f$ attains a maximum and find it.

Steps.

$K$ is closed and bounded in $\mathbb{R}^2$ , hence compact by [6]. Since $f$ is continuous, the Extreme Value Theorem guarantees a max and min are attained on $K$ .
Interior critical points: $\nabla f = (2x-1,\ 4y) = (0,0)\Rightarrow (x,y)=(\tfrac12,0)$ , inside $K$ . There $f=\tfrac14-\tfrac12=-\tfrac14$ .
Boundary $x^2+y^2=1$ : substitute $y^2 = 1-x^2$ , so $f = x^2 + 2(1-x^2) - x = -x^2 - x + 2$ for $x\in[-1,1]$ . Maximize $g(x)=-x^2-x+2$ : $g'(x)=-2x-1=0\Rightarrow x=-\tfrac12$ , giving $g(-\tfrac12)= -\tfrac14+\tfrac12+2 = \tfrac{9}{4}$ . Check endpoints: $g(1)=0,\ g(-1)=2$ .

Answer.

\boxed{\max_K f = \tfrac{9}{4}\ \text{at } \left(-\tfrac12, \pm\tfrac{\sqrt3}{2}\right);\quad \min_K f = -\tfrac14 \text{ at } (\tfrac12,0).}

Compactness is exactly what licenses the assertion that these extrema exist before we compute them.

⚠️ Common mistake

"Closed and bounded means compact, always." False outside finite-dimensional spaces. The correct general characterization is complete + totally bounded [5]. In $\mathbb{R}^n$ closed ⇒ complete and bounded ⇒ totally bounded, which is why the simpler criterion works there — but this implication "bounded ⇒ totally bounded" fails in infinite dimensions.

⚠️ Common mistake

"Compactness = bounded." Boundedness alone is never enough: $(0,1)$ is bounded but not compact. And closedness alone is never enough: $[0,\infty)$ is closed but not compact. You need both in $\mathbb{R}^n$ .

CounterexampleThe closed unit ball in ℓ² is not compact

Let $\ell^2$ be the space of square-summable real sequences with $\|x\| = (\sum x_i^2)^{1/2}$ , and let $K$ be its closed unit ball. Consider the standard basis vectors $e_n = (0,\dots,0,1,0,\dots)$ (the $1$ in position $n$ ). Each $\|e_n\|=1$ , so $e_n \in K$ , and for $m \ne n$ ,

10

\quad \|e_m - e_n\| = \sqrt{1^2 + 1^2} = \sqrt 2.

Derivation hint: The two unit entries sit in different coordinates, so the difference has two nonzero components each equal to $1$ . No subsequence of $(e_n)$ is Cauchy (all pairwise distances are $\sqrt 2$ ), so none converges. Thus $K$ is closed and bounded yet not sequentially compact, hence not compact. This shows Heine–Borel genuinely uses finite dimension. (In fact, Riesz's theorem: a normed space has compact closed unit ball iff it is finite-dimensional.)

connection

Compactness threads through the whole of analysis. Via Sequential Compactness and the Bolzano–Weierstrass Theorem, it guarantees convergent subsequences. It underwrites the Extreme Value Theorem (continuous functions on compact sets attain extrema) and the Uniform Continuity Theorem (continuous on compact ⇒ uniformly continuous). The metric characterization "complete + totally bounded" links it to Completeness of Metric Spaces and Cauchy Sequences. Topologically it generalizes to Tychonoff's Theorem for products and interacts with Connectedness (continuous images of compact connected sets are compact and connected). The failure in infinite dimensions motivates Weak Topologies and Banach–Alaoglu Theorem, the right substitute in functional analysis.

🔬 Where this appears

⏳ History

- 1817 — Bernard Bolzano proves an early version of the least-upper-bound and intermediate-value properties, implicitly using boundedness arguments.

- 1872 — Eduard Heine, building on Dirichlet's lectures, uses the covering/uniform-continuity idea to show continuous functions on closed intervals are uniformly continuous; this is the conceptual seed of "Heine."

- 1872 — Karl Weierstrass and Heine rigorize the real numbers and the notion of limit points (Bolzano–Weierstrass property).

- 1894–1895 — Émile Borel proves, in his thesis and a published paper, that a countable open cover of

[a,b]

admits a finite subcover.

- 1900–1904 — Pierre Cousin, Arthur Schoenflies, and Henri Lebesgue extend the result to arbitrary (uncountable) covers; Lebesgue's lectures popularize the modern statement.

- 1906 — Maurice Fréchet introduces abstract metric spaces and the term compact (initially meaning sequentially compact), framing the property abstractly.

- 1914–1924 — Felix Hausdorff and the Polish school formalize topology; the open-cover definition becomes standard, and "compact" is fixed to mean the finite-subcover property.

- 1918 — Frigyes Riesz proves that the closed unit ball is compact iff the normed space is finite-dimensional, pinpointing where Heine–Borel must fail.

- 1930 — Andrey Tychonoff proves arbitrary products of compact spaces are compact, the deepest general compactness theorem.

open-problem

Compactness has subtle set-theoretic and infinite-dimensional dependencies that remain pedagogically and foundationally delicate:

Choice dependence. Tychonoff's theorem (arbitrary products of compacts are compact) is equivalent to the Axiom of Choice. Even the equivalence of "compact" and "sequentially compact" can fail in general topological spaces and depends on countable choice in some metric arguments. Determining the precise choice strength of various compactness statements is the domain of reverse mathematics; many such calibrations are ongoing research.
Infinite-dimensional substitutes. Since norm-compactness is too strong in function spaces, one replaces it with weak and weak-\* compactness (Banach–Alaoglu, Eberlein–Šmulian). Characterizing which sets are weakly compact, and how compactness interacts with reflexivity, drives modern functional analysis.
Quantitative compactness. Replacing the qualitative finite-subcover property with quantitative measures (entropy numbers, Kolmogorov widths, metric entropy of totally bounded sets) is central to approximation theory and statistical learning; sharp entropy estimates for many natural classes remain open.

Compactness and the Heine-Borel Theorem

Formal Statement

Why It Holds

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also