Sequences of Real Numbers — Convergence and Cauchy

⚡ Key Takeaways

A sequence (an)(a_n) of real numbers converges to a limit LL if its terms become and stay arbitrarily close to LL; it is Cauchy if its terms become arbitrarily close to each other. Key result: in R\mathbb{R} these two notions are equivalent (completeness), so convergence can be verified without knowing the limit. Applies throughout analysis — series, continuity, integration, numerical methods. Formalized by Cauchy (1821) and Weierstrass (1870s).

💡 The Core Insight

Convergence is a statement about the relationship between terms and an external limit point LL. Cauchy is a statement entirely internal to the sequence. In a complete ordered field — which is precisely what R\mathbb{R} is — the internal condition forces the existence of the external limit. Completeness is the hidden engine of all of real analysis.

Formal Statement

DefinitionSequence

A sequence of real numbers is a function a:N→Ra:\mathbb{N}\to\mathbb{R}, n↦ann\mapsto a_n. The value ana_n is the nn-th term. We denote the sequence by (an)n≥1(a_n)_{n\ge1} or simply (an)(a_n). A sequence is bounded if there is M>0M>0 with ∣an∣≤M|a_n|\le M for all nn.

DefinitionConvergence

A sequence (an)(a_n) converges to L∈RL\in\mathbb{R} if

1
∀ ε>0  ∃ N∈N  ∀ n≥N: ∣an−L∣<ε.\quad \forall\,\varepsilon>0\ \ \exists\,N\in\mathbb{N}\ \ \forall\,n\ge N:\ |a_n - L| < \varepsilon.

Derivation hint: this is the formal reading of "terms get and stay within any prescribed tolerance ε\varepsilon of LL"; NN is allowed to depend on ε\varepsilon. We write lim⁡n→∞an=L\lim_{n\to\infty}a_n = L or an→La_n\to L. Symbols: ε\varepsilon = tolerance (any positive real), NN = threshold index, LL = limit, ∣an−L∣|a_n-L| = distance from term to limit. A sequence is divergent if no such LL exists.

DefinitionCauchy Sequence

A sequence (an)(a_n) is a Cauchy sequence if

2
∀ ε>0  ∃ N∈N  ∀ m,n≥N: ∣an−am∣<ε.\quad \forall\,\varepsilon>0\ \ \exists\,N\in\mathbb{N}\ \ \forall\,m,n\ge N:\ |a_n - a_m| < \varepsilon.

Derivation hint: replace the external LL in [1] with another term ama_m; the condition becomes purely internal to the sequence. Here ∣an−am∣|a_n-a_m| measures the mutual closeness of two late terms. Note the two quantified indices m,nm,n.

TheoremCauchy Completeness of R\mathbb{R}

A sequence of real numbers converges if and only if it is Cauchy:

3
(an) converges in R   ⟺   (an) is Cauchy.\quad (a_n)\ \text{converges in }\mathbb{R}\ \iff\ (a_n)\ \text{is Cauchy}.

Derivation hint: forward direction is the triangle inequality; backward direction uses boundedness + Bolzano–Weierstrass + the completeness axiom. This is equivalent to the Least Upper Bound Property of R\mathbb{R} and characterizes R\mathbb{R} as a complete ordered field.

TheoremUniqueness of Limits

If an→La_n\to L and an→L′a_n\to L' then L=L′L=L'.

4
∣L−L′∣≤∣L−an∣+∣an−L′∣<ε⟹L=L′.\quad |L-L'|\le |L-a_n|+|a_n-L'|<\varepsilon \quad\Longrightarrow\quad L=L'.

Derivation hint: choose NN large enough for both convergences with tolerance ε/2\varepsilon/2; since ∣L−L′∣<ε|L-L'|<\varepsilon for every ε\varepsilon, it is 00.

Why It Holds

ProofConvergent ⟹ Cauchy

Assume an→La_n\to L. Fix ε>0\varepsilon>0.

Step 1. Apply [1] with tolerance ε/2\varepsilon/2: there is NN such that ∣an−L∣<ε/2|a_n-L|<\varepsilon/2 for all n≥Nn\ge N.

Step 2. Take any m,n≥Nm,n\ge N. By the triangle inequality,

5
∣an−am∣≤∣an−L∣+∣L−am∣<ε2+ε2=ε.\quad |a_n-a_m| \le |a_n-L| + |L-a_m| < \tfrac{\varepsilon}{2} + \tfrac{\varepsilon}{2} = \varepsilon.

Derivation hint: insert ±L\pm L inside the absolute value and split.

Step 3. Since ε>0\varepsilon>0 was arbitrary, [2] holds. Thus (an)(a_n) is Cauchy. ■\blacksquare

∎
ProofCauchy ⟹ Convergent (in R\mathbb{R})

Assume (an)(a_n) is Cauchy.

Step 1 — Cauchy sequences are bounded. Apply [2] with ε=1\varepsilon=1: there is NN with ∣an−aN∣<1|a_n-a_N|<1 for n≥Nn\ge N, hence ∣an∣<∣aN∣+1|a_n|<|a_N|+1. Then

6
∣an∣≤max⁡{ ∣a1∣,…,∣aN−1∣, ∣aN∣+1 }=:Mfor all n.\quad |a_n|\le \max\{\,|a_1|,\dots,|a_{N-1}|,\ |a_N|+1\,\}=:M \quad\text{for all }n.

Derivation hint: only finitely many early terms are unconstrained; take the max with the tail bound.

Step 2 — A convergent subsequence exists. By the Bolzano–Weierstrass Theorem, the bounded sequence (an)(a_n) has a subsequence (ank)(a_{n_k}) converging to some L∈RL\in\mathbb{R} (this step uses completeness of R\mathbb{R}).

Step 3 — The whole sequence converges to LL. Fix ε>0\varepsilon>0. By [2] get N1N_1 with ∣an−am∣<ε/2|a_n-a_m|<\varepsilon/2 for m,n≥N1m,n\ge N_1. By subsequence convergence get kk with nk≥N1n_k\ge N_1 and ∣ank−L∣<ε/2|a_{n_k}-L|<\varepsilon/2. Then for all n≥N1n\ge N_1,

7
∣an−L∣≤∣an−ank∣+∣ank−L∣<ε2+ε2=ε.\quad |a_n-L|\le |a_n-a_{n_k}| + |a_{n_k}-L| < \tfrac{\varepsilon}{2}+\tfrac{\varepsilon}{2}=\varepsilon.

Derivation hint: the term anka_{n_k} acts as a bridge — close to all late terms by Cauchy, close to LL by the subsequence. Hence an→La_n\to L. ■\blacksquare

∎
⚠️ Completeness is essential

Step 2 is where R\mathbb{R} is irreplaceable. In Q\mathbb{Q}, Bolzano–Weierstrass fails and there exist Cauchy sequences of rationals with no rational limit. The theorem [3] is a property of R\mathbb{R}, not a logical tautology about sequences.

mathematician · Augustin-Louis Cauchy | 1789–1857

Cauchy introduced the rigorous ε\varepsilon-style treatment of limits in his Cours d'analyse (1821) and Résumé des leçons (1823). He formulated the criterion now bearing his name to test convergence of series without summing them, though he (and his era) lacked an axiomatic construction of R\mathbb{R} and so implicitly assumed completeness. The gap was closed by Weierstrass, Dedekind, and Cantor in the 1870s, who constructed the reals precisely so that Cauchy's criterion would be a theorem rather than an assumption.

Building Intuition

🧠 Intuition

Picture the terms as dots landing on a number line as nn grows.

  • Convergence says: draw any tiny band of half-width ε\varepsilon around the target LL. Eventually all dots fall inside that band and never leave.
  • Cauchy says: eventually all the dots are within ε\varepsilon of each other — they huddle into an arbitrarily small cluster, regardless of whether you've marked a target.

The miracle of R\mathbb{R}: a cluster that keeps shrinking must be shrinking toward a point that genuinely exists. There are no "holes" for the cluster to vanish into. In Q\mathbb{Q} there are holes (the irrationals), so a shrinking rational cluster can converge to a missing point like 2\sqrt2.

Figure
Convergence band vs. Cauchy clustering

```svg

Terms a_n approaching limit L n L L+ε L-ε N For n ≥ N: all terms inside the ε-band (convergence) and within ε of each other (Cauchy).

```

Worked Examples

ExampleA convergent sequence — an=3n+1na_n = \tfrac{3n+1}{n}

Given: an=3n+1n=3+1na_n = \dfrac{3n+1}{n}=3+\dfrac1n. Claim L=3L=3.

Step 1. Compute the distance: ∣an−3∣=∣3+1n−3∣=1n|a_n - 3| = \left|3+\tfrac1n-3\right| = \dfrac1n.

Step 2. Demand 1n<ε\dfrac1n<\varepsilon, i.e. n>1εn>\dfrac1\varepsilon. Choose

8
N=⌊1ε⌋+1.\quad N = \left\lfloor \tfrac1\varepsilon\right\rfloor + 1.

Derivation hint: solve 1/n<ε1/n<\varepsilon for nn, then round up to the next integer to guarantee strictness.

Step 3. For all n≥Nn\ge N we have n>1/εn>1/\varepsilon, hence ∣an−3∣=1/n<ε|a_n-3|=1/n<\varepsilon, satisfying [1].

Numerical check: for ε=0.01\varepsilon = 0.01, N=⌊100⌋+1=101N = \lfloor 100\rfloor+1 = 101. Then a101=3+1/101≈3.0099a_{101}=3+1/101\approx 3.0099, distance ≈0.0099<0.01\approx 0.0099<0.01. ✓

 lim⁡n→∞3n+1n=3 \boxed{\ \lim_{n\to\infty}\frac{3n+1}{n} = 3\ }
ExampleVerifying Cauchy directly — an=∑k=1n12ka_n = \sum_{k=1}^n \tfrac{1}{2^k}

Given: partial sums an=12+14+⋯+12n=1−12na_n = \dfrac12+\dfrac14+\cdots+\dfrac1{2^n} = 1-\dfrac1{2^n}.

Step 1. For n>mn>m compute the gap:

9
∣an−am∣=∣ 1−12n−(1−12m)∣=12m−12n<12m.\quad |a_n - a_m| = \left|\,1-\tfrac1{2^n} - \left(1-\tfrac1{2^m}\right)\right| = \frac1{2^m}-\frac1{2^n} < \frac1{2^m}.

Derivation hint: the geometric tail telescopes; bound it by its leading term.

Step 2. Demand 12m<ε\dfrac1{2^m}<\varepsilon, i.e. 2m>1ε2^m>\dfrac1\varepsilon, i.e. m>log⁡2(1/ε)m>\log_2(1/\varepsilon). Choose N=⌊log⁡2(1/ε)⌋+1N=\lfloor \log_2(1/\varepsilon)\rfloor+1.

Step 3. For all m,n≥Nm,n\ge N (say n>mn>m), ∣an−am∣<1/2m≤1/2N<ε|a_n-a_m|<1/2^m\le 1/2^N<\varepsilon. Condition [2] holds, so (an)(a_n) is Cauchy, hence convergent by [3] without computing the limit.

Numerical check: ε=0.001⇒N=⌊log⁡21000⌋+1=⌊9.97⌋+1=10\varepsilon=0.001 \Rightarrow N = \lfloor\log_2 1000\rfloor+1 = \lfloor 9.97\rfloor+1 = 10. Indeed 1/210=0.000977<0.0011/2^{10}=0.000977<0.001. ✓ (The limit happens to be 11.)

 (an) is Cauchy, hence convergent;  lim⁡an=1 \boxed{\ (a_n)\ \text{is Cauchy, hence convergent; }\ \lim a_n = 1\ }

Common Misconceptions

⚠️ Consecutive terms close ≠ Cauchy

A frequent error: believing ∣an+1−an∣→0|a_{n+1}-a_n|\to 0 implies (an)(a_n) is Cauchy. It does not. The Cauchy condition [2] requires all pairs m,n≥Nm,n\ge N to be close, not just adjacent ones. The harmonic partial sums Hn=∑k=1n1/kH_n=\sum_{k=1}^n 1/k satisfy ∣Hn+1−Hn∣=1/(n+1)→0|H_{n+1}-H_n|=1/(n+1)\to0 yet (Hn)(H_n) diverges to +∞+\infty.

CounterexampleCauchy in Q\mathbb{Q} that fails to converge in Q\mathbb{Q}

Define rational truncations of 2\sqrt2: a1=1.4, a2=1.41, a3=1.414,…a_1=1.4,\ a_2=1.41,\ a_3=1.414,\dots, each the decimal expansion of 2\sqrt2 to nn places.

10
∣an−am∣≤10−min⁡(m,n) → m,n→∞  0,\quad |a_n-a_m| \le 10^{-\min(m,n)}\ \xrightarrow{\ m,n\to\infty\ }\ 0,

Derivation hint: two truncations agreeing to min⁡(m,n)\min(m,n) places differ only beyond that decimal place. so (an)(a_n) is Cauchy. Its only possible limit is 2∉Q\sqrt2\notin\mathbb{Q}. Thus inside Q\mathbb{Q} it is Cauchy but divergent — the field Q\mathbb{Q} is not complete. This is exactly the defect that the construction of R\mathbb{R} via Cauchy sequences (Cantor) or cuts (Dedekind) repairs.

CounterexampleBounded but not convergent

an=(−1)na_n=(-1)^n is bounded (∣an∣=1|a_n|=1) but not convergent: ∣an+1−an∣=2|a_{n+1}-a_n|=2 for all nn, violating [2]. Boundedness alone is insufficient; one needs Cauchy (or monotone + bounded).

Connections

connection
  • Algebra of limits. If an→Aa_n\to A, bn→Bb_n\to B then an±bn→A±Ba_n\pm b_n\to A\pm B, anbn→ABa_nb_n\to AB, and an/bn→A/Ba_n/b_n\to A/B (if B≠0B\ne0). These follow from [1] plus the triangle inequality — see Limit Laws for Sequences.
  • Monotone Convergence. A monotone bounded sequence converges; this is logically equivalent to [3] and to the Least Upper Bound Property. See Monotone Convergence Theorem.
  • Series. A series ∑ak\sum a_k converges iff its partial sums Sn=∑k≤nakS_n=\sum_{k\le n}a_k form a Cauchy sequence — the Cauchy Criterion for Series is just [2] applied to (Sn)(S_n).
  • Subsequences. Every subsequence of a convergent sequence converges to the same limit; conversely Bolzano–Weierstrass Theorem extracts convergent subsequences from bounded ones.
  • Topology. Cauchy and convergence are unified by Complete Metric Spaces, where [3] becomes the definition of completeness.
  • limsup/liminf. Convergence is equivalent to lim inf⁡an=lim sup⁡an∈R\liminf a_n=\limsup a_n\in\mathbb{R}; see Limit Superior and Limit Inferior.

Real-World Applications

🔬 Where this appears

Historical Development

⏳ History
- c. 450 BCE — Zeno of Elea: paradoxes of motion implicitly probe infinite sums and convergence.
- c. 1660s — Newton & Leibniz: calculus uses limiting processes informally ("ultimate ratios," infinitesimals) without rigor.
- 1734 — Berkeley's The Analyst: attacks the logical foundations ("ghosts of departed quantities"), spurring demand for rigor.
- 1821 — Cauchy, Cours d&#39;analyse: introduces a rigorous treatment of limits and convergence; states the Cauchy criterion for series.
- 1817 / rediscovered 1860s — Bolzano: proves what became the Bolzano–Weierstrass theorem and an ε\varepsilon-style continuity, but his work was largely unread for decades.
- 1854–1865 — Weierstrass (lectures): crystallizes the modern ε\varepsilon–NN/ε\varepsilon–δ\delta definitions, removing reliance on intuition and infinitesimals.
- 1872 — Cantor & Dedekind: independently construct R\mathbb{R} — Cantor via Cauchy sequences of rationals, Dedekind via cuts — turning completeness into a theorem.
- 1872 — Heine: systematizes uniform continuity and works closely with Cantor's framework, popularizing the sequence-based approach.
- 1906 — Fréchet: abstracts these ideas into metric spaces, generalizing Cauchy/convergence beyond R\mathbb{R} into Complete Metric Spaces.

Subtleties & Limits

open-problem

The equivalence [3] is special to complete spaces; deciding completeness or constructing completions raises deep issues.

  • Effective/constructive content. A classically Cauchy sequence may have no computable rate of convergence (a "modulus"). Constructive mathematics (Bishop) therefore defines Cauchy with an explicit modulus N(ε)N(\varepsilon), and not every classical theorem survives.
  • Order of completion. R\mathbb{R} is the metric completion of Q\mathbb{Q} under ∣⋅∣|\cdot|. Choosing a different metric — the pp-adic absolute value — completes Q\mathbb{Q} to the totally different field Qp\mathbb{Q}_p. "Cauchy" is metric-dependent.
  • Rate vs. existence. Knowing a sequence converges (via Cauchy) gives no a priori bound on how fast; quantitative analysis and proof mining (Kohlenbach) extract explicit rates from classical existence proofs — an active research program.
  • Beyond metrics. In general topological spaces "Cauchy" is not even well-defined without a uniformity; nets and filters replace sequences, and convergence/completeness become genuinely subtler.

See Also

Bolzano–Weierstrass Theorem · Monotone Convergence Theorem · Limit Superior and Limit Inferior · Cauchy Criterion for Series · Complete Metric Spaces · Banach Fixed Point Theorem · The Real Number System · Limit Laws for Sequences