Sequences: Convergence, Cauchy Sequences, Subsequences

⚡ Key Takeaways

A sequence (an)(a_n) converges to a limit LL if its terms get arbitrarily close to LL for all large nn; it is Cauchy if its terms get arbitrarily close to each other. In R\mathbb{R} (and any complete space) these two notions coincide. Subsequences are selections of terms in order, and the Bolzano–Weierstrass theorem guarantees every bounded real sequence has a convergent subsequence. These ideas, formalized by Cauchy and Weierstrass in the 19th century, are the bedrock of analysis.

💡 The Core Insight

Convergence is an external condition (closeness to a fixed target LL), while the Cauchy condition is an internal one (mutual closeness of terms). The theorem that the two are equivalent — completeness — is what makes R\mathbb{R} a usable arena for analysis. Subsequences let us extract order out of chaos: even when a sequence wanders, boundedness forces some thread of it to settle down.

Formal Statement

DefinitionSequence

A sequence in a set XX is a function a:N→Xa:\mathbb{N}\to X, denoted (an)n≥1(a_n)_{n\ge 1} where an=a(n)a_n = a(n). We mostly take X=RX=\mathbb{R} or X=CX=\mathbb{C}. The range {an:n∈N}\{a_n : n\in\mathbb{N}\} is a set (may be finite), while the sequence itself is an ordered, possibly-repeating list. A sequence is bounded if there exists M>0M>0 with ∣an∣≤M|a_n|\le M for all nn.

DefinitionConvergence (ε\varepsilon–NN)

A sequence (an)(a_n) in R\mathbb{R} converges to L∈RL\in\mathbb{R}, written an→La_n\to L or lim⁡n→∞an=L\lim_{n\to\infty}a_n = L, if:

1
∀ ε>0  ∃ N∈N  ∀ n≥N: ∣an−L∣<ε.\quad \forall\,\varepsilon>0\ \ \exists\,N\in\mathbb{N}\ \ \forall\,n\ge N:\ |a_n - L| < \varepsilon.

Derivation hint: read left to right — given a tolerance ε\varepsilon, you can name a threshold index NN past which all terms lie within ε\varepsilon of LL. Here ε\varepsilon is an arbitrary positive tolerance, NN the threshold index (depends on ε\varepsilon), and ∣an−L∣|a_n-L| the distance from term to limit. A sequence that does not converge diverges.

DefinitionCauchy Sequence

A sequence (an)(a_n) is Cauchy if:

2
∀ ε>0  ∃ N∈N  ∀ m,n≥N: ∣am−an∣<ε.\quad \forall\,\varepsilon>0\ \ \exists\,N\in\mathbb{N}\ \ \forall\,m,n\ge N:\ |a_m - a_n| < \varepsilon.

Derivation hint: same structure as [1], but the distance is between two terms of the sequence — no external limit LL appears.

DefinitionSubsequence

Given (an)(a_n) and a strictly increasing function k↦nkk\mapsto n_k (so n1<n2<n3<⋯n_1<n_2<n_3<\cdots, all in N\mathbb{N}), the sequence

3
(ank)k≥1=an1,an2,an3,…\quad (a_{n_k})_{k\ge 1} = a_{n_1}, a_{n_2}, a_{n_3}, \dots

Derivation hint: nk≥kn_k\ge k always, by induction on the strict increase of the index map. is a subsequence of (an)(a_n). A point LL is a subsequential limit (or cluster point) if some subsequence converges to LL.

TheoremFundamental Theorems on Sequences

Let (an)(a_n) be a real sequence. 1. (Uniqueness) If an→La_n\to L and an→L′a_n\to L', then L=L′L=L'. 2. (Convergent ⇒\Rightarrow bounded) If (an)(a_n) converges, it is bounded. 3. (Convergent ⇒\Rightarrow Cauchy) Every convergent sequence is Cauchy. 4. (Cauchy ⇒\Rightarrow bounded) Every Cauchy sequence is bounded. 5. (Completeness of R\mathbb{R}) Every Cauchy sequence in R\mathbb{R} converges. 6. (Monotone Convergence) A monotone bounded sequence converges (to its sup if increasing, inf if decreasing). 7. (Bolzano–Weierstrass) Every bounded real sequence has a convergent subsequence. 8. (Subsequence inheritance) If an→La_n\to L, then every subsequence ank→La_{n_k}\to L. 9. (Cluster characterization) an→La_n\to L iff (an)(a_n) is bounded and LL is its only subsequential limit.

Why It Holds

ProofConvergent ⇒\Rightarrow Cauchy (Theorem 3)

1. Suppose an→La_n\to L. Fix ε>0\varepsilon>0. 2. Apply [1] with tolerance ε/2\varepsilon/2: there is NN such that n≥N⇒∣an−L∣<ε/2n\ge N\Rightarrow |a_n - L| < \varepsilon/2. 3. Take any m,n≥Nm,n\ge N. By the triangle inequality:

4
∣am−an∣=∣(am−L)−(an−L)∣≤∣am−L∣+∣an−L∣<ε2+ε2=ε.\quad |a_m - a_n| = |(a_m - L) - (a_n - L)| \le |a_m - L| + |a_n - L| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.

Derivation hint: insert −L+L-L+L and split via ∣x+y∣≤∣x∣+∣y∣|x+y|\le|x|+|y|; each piece is below ε/2\varepsilon/2. 4. Thus [2] holds, so (an)(a_n) is Cauchy. ■\blacksquare

∎
ProofBolzano–Weierstrass (Theorem 7) via bisection

1. Let (an)(a_n) satisfy ∣an∣≤M|a_n|\le M, so all terms lie in I0=[−M,M]I_0 = [-M, M]. 2. Bisect I0I_0 into two halves; at least one half contains ana_n for infinitely many nn. Call it I1I_1; pick n1n_1 with an1∈I1a_{n_1}\in I_1. 3. Inductively bisect IkI_k, choosing the half Ik+1I_{k+1} containing infinitely many terms, and pick nk+1>nkn_{k+1}>n_k with ank+1∈Ik+1a_{n_{k+1}}\in I_{k+1}. This is possible because Ik+1I_{k+1} holds infinitely many terms. 4. The interval lengths satisfy

5
∣Ik∣=2M2k=M2k−1→k→∞0.\quad |I_k| = \frac{2M}{2^k} = \frac{M}{2^{k-1}} \xrightarrow[k\to\infty]{} 0.

Derivation hint: each bisection halves the length; start from length 2M2M. 5. The nested closed intervals I0⊇I1⊇⋯I_0\supseteq I_1\supseteq\cdots with lengths →0\to 0 have, by the Nested Interval Property, a unique common point L=⋂kIkL=\bigcap_k I_k. 6. Since ank,L∈Ika_{n_k}, L\in I_k, we get ∣ank−L∣≤∣Ik∣→0|a_{n_k}-L|\le |I_k|\to 0, so ank→La_{n_k}\to L. ■\blacksquare

∎
ProofCauchy ⇒\Rightarrow Convergent in R\mathbb{R} (Theorem 5)

1. Let (an)(a_n) be Cauchy. By Theorem 4 it is bounded. 2. By Bolzano–Weierstrass it has a subsequence ank→La_{n_k}\to L for some LL. 3. Fix ε>0\varepsilon>0. Choose N1N_1 so that m,n≥N1⇒∣am−an∣<ε/2m,n\ge N_1\Rightarrow |a_m-a_n|<\varepsilon/2 (Cauchy). Choose kk large so that nk≥N1n_k\ge N_1 and ∣ank−L∣<ε/2|a_{n_k}-L|<\varepsilon/2 (subsequence limit). 4. For any n≥N1n\ge N_1:

6
∣an−L∣≤∣an−ank∣+∣ank−L∣<ε2+ε2=ε.\quad |a_n - L| \le |a_n - a_{n_k}| + |a_{n_k} - L| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.

Derivation hint: triangle inequality bridging the term, a deep subsequence term, and the limit. 5. Hence an→La_n\to L. The boundedness in step 1 plus B–W requires the completeness of R\mathbb{R} (Nested Interval Property), which fails in Q\mathbb{Q}. ■\blacksquare

∎
ProofCauchy ⇒\Rightarrow bounded (Theorem 4)

1. Apply [2] with ε=1\varepsilon=1: there is NN with ∣am−an∣<1|a_m-a_n|<1 for m,n≥Nm,n\ge N. 2. In particular ∣an−aN∣<1|a_n - a_N| < 1, so ∣an∣<∣aN∣+1|a_n| < |a_N| + 1 for all n≥Nn\ge N. 3. Let M=max⁡{∣a1∣,…,∣aN−1∣, ∣aN∣+1}M = \max\{|a_1|,\dots,|a_{N-1}|,\ |a_N|+1\}. Then ∣an∣≤M|a_n|\le M for all nn. ■\blacksquare

∎
mathematician · Augustin-Louis Cauchy | 1789–1857

Cauchy gave analysis its modern rigor in his Cours d'analyse (1821), introducing the convergence criterion now bearing his name and insisting on ε\varepsilon-style bounds where his predecessors relied on intuition about "infinitely small" quantities. Though his own proof that Cauchy sequences converge implicitly assumed completeness of R\mathbb{R} (a property not yet axiomatized), his formulation isolated exactly the right internal condition. Weierstrass and later Cantor and Dedekind supplied the missing foundation by constructing R\mathbb{R} so that Cauchy sequences would necessarily converge.

Building Intuition

🧠 Intuition

Think of convergence as a homing missile: LL is the target, and for any shrinking circle of radius ε\varepsilon around it, the sequence eventually enters and never leaves. The Cauchy condition removes the target: instead, you watch the terms huddle together — past some point they all crowd into a region of diameter ε\varepsilon. In R\mathbb{R}, huddling guarantees a home: there's always a real number for the huddle to converge to. In Q\mathbb{Q}, the huddle can form around a "hole" (an irrational), and no rational target exists — the sequence is Cauchy but stranded. A subsequence is choosing which terms to watch, in order, skipping freely; Bolzano–Weierstrass says a bounded sequence may bounce around, but you can always pick out a calm thread that settles.

Figure
Convergence funnel: terms enter the ε\varepsilon-band past threshold NN
L L+ε L−ε aₙ n → N terms wander freely for n < N all inside ε-band for n ≥ N

Worked Examples

ExampleProving an=2n+1n+3→2a_n = \tfrac{2n+1}{n+3}\to 2 by ε\varepsilon–NN

Given: an=2n+1n+3a_n = \dfrac{2n+1}{n+3}, candidate limit L=2L=2, target tolerance demonstration for general ε>0\varepsilon>0.

Step 1 — compute the distance.

7
∣an−2∣=∣2n+1n+3−2∣=∣2n+1−2n−6n+3∣=5n+3.\quad |a_n - 2| = \left|\frac{2n+1}{n+3} - 2\right| = \left|\frac{2n+1 - 2n - 6}{n+3}\right| = \frac{5}{n+3}.

Derivation hint: combine over a common denominator; numerator simplifies to −5-5.

Step 2 — solve 5n+3<ε\dfrac{5}{n+3} < \varepsilon. This holds iff n+3>5/εn+3 > 5/\varepsilon, i.e. n>5ε−3n > \dfrac{5}{\varepsilon} - 3.

Step 3 — choose NN. Take N=⌈5ε⌉N = \left\lceil \dfrac{5}{\varepsilon} \right\rceil (a safe choice, since N>5/ε−3N > 5/\varepsilon - 3). Then for all n≥Nn\ge N, ∣an−2∣=5n+3<ε|a_n-2| = \frac{5}{n+3} < \varepsilon.

Numerical check: for ε=0.01\varepsilon = 0.01, N=⌈500⌉=500N = \lceil 500\rceil = 500. At n=500n=500: a500=1001503≈1.98807a_{500} = \frac{1001}{503} \approx 1.98807, and ∣a500−2∣≈0.01193|a_{500}-2|\approx 0.01193... slightly over, so we verify n=503n=503: a503=1007506≈1.99012a_{503}=\frac{1007}{506}\approx 1.99012, ∣⋅∣≈0.00988<0.01|{\cdot}|\approx 0.00988<0.01. ✓ (the −3-3 slack confirms the bound is comfortably satisfied past NN).

 lim⁡n→∞2n+1n+3=2,N(ε)=⌈5ε⌉ \boxed{\ \lim_{n\to\infty}\frac{2n+1}{n+3} = 2,\quad N(\varepsilon)=\left\lceil \tfrac{5}{\varepsilon}\right\rceil\ }
ExampleA Cauchy sequence in Q\mathbb{Q} with no rational limit

Given: Define (an)(a_n) by truncating the decimal expansion of 2=1.41421356…\sqrt 2 = 1.41421356\dots: a1=1.4, a2=1.41, a3=1.414,…a_1=1.4,\ a_2=1.41,\ a_3=1.414,\dots, so each ana_n has nn decimal places.

Step 1 — show Cauchy. For m>nm>n, both share the first nn digits, so they differ only beyond the nn-th decimal place:

8
∣am−an∣≤10−n.\quad |a_m - a_n| \le 10^{-n}.

Derivation hint: truncations agree to nn places; the maximal disagreement is in the (n+1)(n{+}1)th place onward, bounded by a geometric tail ∑k>n9⋅10−k=10−n\sum_{k>n}9\cdot10^{-k}=10^{-n}.

Step 2 — verify [2]. Given ε>0\varepsilon>0, choose NN with 10−N<ε10^{-N}<\varepsilon, i.e. N>log⁡10(1/ε)N > \log_{10}(1/\varepsilon). For m,n≥Nm,n\ge N, ∣am−an∣≤10−min⁡(m,n)≤10−N<ε|a_m-a_n|\le 10^{-\min(m,n)}\le 10^{-N}<\varepsilon. So (an)(a_n) is Cauchy in Q\mathbb{Q}.

Step 3 — no rational limit. If an→q∈Qa_n\to q\in\mathbb{Q}, then since an2→2a_n^2\to 2 (and an2a_n^2 rational), q2=2q^2=2 — impossible for rational qq (classical irrationality of 2\sqrt 2).

Numerical check: a5=1.41421a_5 = 1.41421, a8=1.41421356a_8 = 1.41421356, ∣a8−a5∣=0.00000356<10−5|a_8-a_5| = 0.00000356 < 10^{-5}. ✓ The terms huddle, but the home 2\sqrt 2 lives outside Q\mathbb{Q}.

 (an) is Cauchy in Q but diverges in Q; converges to 2 in R \boxed{\ (a_n)\text{ is Cauchy in }\mathbb{Q}\text{ but diverges in }\mathbb{Q};\ \text{converges to }\sqrt2\text{ in }\mathbb{R}\ }

Common Misconceptions

⚠️ Common mistake

"Cauchy always means convergent." False in a general metric space. Cauchy ⇒\Rightarrow convergent only in complete spaces. The implication is the definition of completeness, not a free theorem. In Q\mathbb{Q}, (0,1](0,1] with usual metric, or the space of continuous functions under the L1L^1 norm, Cauchy sequences can fail to converge.

"∣an+1−an∣→0|a_{n+1}-a_n|\to 0 implies Cauchy." Decisively false. Consecutive gaps shrinking does not control cumulative drift over far-apart indices.

CounterexampleConsecutive differences vanish, yet the sequence diverges

Let an=∑k=1n1ka_n = \sum_{k=1}^{n}\frac{1}{k} (harmonic partial sums). Then

9
∣an+1−an∣=1n+1→0,buta2n−an=∑k=n+12n1k≥n⋅12n=12.\quad |a_{n+1}-a_n| = \frac{1}{n+1}\to 0,\qquad\text{but}\qquad a_{2n}-a_n = \sum_{k=n+1}^{2n}\frac1k \ge n\cdot\frac{1}{2n} = \frac12.

Derivation hint: each of the nn terms in the block exceeds 1/(2n)1/(2n); summing gives a fixed lower bound 1/21/2, blocking the Cauchy condition for ε=1/2\varepsilon=1/2. Since ∣a2n−an∣↛0|a_{2n}-a_n|\not\to 0, (an)(a_n) is not Cauchy, hence diverges (in fact an→∞a_n\to\infty). The vanishing of consecutive gaps is far too weak.

CounterexampleA bounded divergent sequence — with two subsequential limits

an=(−1)na_n = (-1)^n is bounded by 11 but does not converge: the even-indexed subsequence a2k=1→1a_{2k}=1\to 1 while the odd-indexed a2k+1=−1→−1a_{2k+1}=-1\to -1. Two distinct subsequential limits violate Theorem 8 if the sequence converged, so it cannot. This illustrates that Bolzano–Weierstrass guarantees a convergent subsequence (here two), not convergence of the whole sequence.

Connections

connection

Sequence convergence is the engine beneath nearly all of analysis. Series and Convergence Tests defines a series as the sequence of partial sums, so every convergence test is secretly a sequence statement. Limits of Functions can be characterized sequentially (Heine's criterion: f(x)→Lf(x)\to L as x→ax\to a iff f(xn)→Lf(x_n)\to L for every sequence xn→ax_n\to a). Continuity then becomes "sequence-preserving." The Cauchy criterion generalizes to Metric Spaces, where completeness distinguishes well-behaved spaces, and to Banach Spaces (complete normed vector spaces) underlying functional analysis. Bolzano–Weierstrass is the prototype of sequential compactness, linking to Compactness and the Heine–Borel theorem.

Real-World Applications

🔬 Where this appears

Historical Development

⏳ History
- c. 450 BCE — Zeno's paradoxes implicitly probe infinite sequences and sums, foreshadowing limit puzzles.
- c. 1665 — Newton and Leibniz use convergent series and "ultimate ratios" in calculus, without rigorous limits.
- 1734 — Berkeley's The Analyst attacks the logical vagueness of infinitesimals ("ghosts of departed quantities"), exposing the need for rigor.
- 1817 — Bolzano proves (in obscurity) an intermediate-value-style result and the essence of what becomes the Bolzano–Weierstrass theorem.
- 1821 — Cauchy's Cours d'analyse formalizes convergence and the Cauchy criterion, anchoring analysis in inequalities.
- 1872 — Weierstrass, Cantor, Dedekind, and Heine independently rigorize the real numbers; Cantor builds R\mathbb{R} from Cauchy sequences; Dedekind from cuts.
- 1872 — Weierstrass popularizes the ε\varepsilon–δ\delta / ε\varepsilon–NN formalism in lectures, the form taught today.
- 1906 — Fréchet introduces abstract metric spaces, generalizing Cauchy sequences and completeness beyond R\mathbb{R}.
- 1922 — Banach's thesis establishes complete normed spaces and the contraction mapping principle, embedding sequence convergence at the heart of functional analysis.

Subtleties & Limits

open-problem

Completeness is space-dependent, not absolute. Whether a Cauchy sequence converges depends entirely on the ambient space; (Q,∣⋅∣)(\mathbb{Q},|\cdot|) is incomplete, but Q\mathbb{Q} can be re-metrized pp-adically (the pp-adic absolute value) so that entirely different sequences become Cauchy, yielding the field Qp\mathbb{Q}_p — a separate, equally valid completion. Ostrowski's theorem classifies all completions of Q\mathbb{Q}: up to equivalence, exactly the real and the pp-adic ones. Open and active areas include the geometry of completions in non-Archimedean analysis, convergence in non-metrizable topological spaces (where sequences must be replaced by nets/filters because they no longer detect closure), and the constructive/computable content of completeness — Bishop-style constructive analysis questions which existence proofs (like Bolzano–Weierstrass) yield algorithms, since the classical bisection proof is not fully constructive without extra choice principles.

See Also

The Real Number System · Series and Convergence Tests · Metric Spaces · Compactness · Limits of Functions · Continuity · Banach Spaces · Uniform Convergence