Analysis

⚡ Key Takeaways

Analysis is the rigorous study of limits, continuity, differentiation, integration, and infinite processes on the real and complex numbers. Its central achievement is replacing intuitive notions of "approaching" and "infinitesimal" with the precise ε–δ definition of a limit, founded on the completeness of the real numbers. It applies wherever continuous change, approximation, or convergence appears — in physics, engineering, probability, and pure mathematics. Built by Cauchy, Bolzano, Weierstrass, Riemann, and Dedekind in the 19th century.

💡 The Core Insight

Every concept in analysis — continuity, the derivative, the integral, the sum of a series — is secretly a statement about limits. To make any of them rigorous, you must first pin down what " $x_n \to L$ " means with no appeal to motion or infinitesimals: for every tolerance $\varepsilon>0$ , eventually all terms lie within $\varepsilon$ of $L$ . The completeness axiom then guarantees that limits which "ought" to exist actually do. Master the quantifier dance $\forall\varepsilon\,\exists N$ and you hold the master key to the entire subject.

DefinitionLimit of a Sequence (ε–N)

A sequence $(x_n)_{n\in\mathbb{N}}$ of real numbers converges to $L\in\mathbb{R}$ if:

1

\quad \forall\,\varepsilon>0\ \ \exists\,N\in\mathbb{N}\ \ \text{s.t.}\ \ n\ge N \implies |x_n - L| < \varepsilon.

Derivation hint: read this as a game — an adversary picks $\varepsilon$ , you must produce a threshold $N$ past which every term is trapped in the band $(L-\varepsilon,\,L+\varepsilon)$ . Here $\varepsilon$ is the error tolerance (any positive real), $N$ is the threshold index (may depend on $\varepsilon$ ), $|x_n-L|$ is the distance from the $n$ -th term to the candidate limit $L$ . We write $\lim_{n\to\infty}x_n=L$ or $x_n\to L$ .

DefinitionLimit of a Function (ε–δ)

Let $f$ be defined on a punctured neighbourhood of $a$ . Then $\lim_{x\to a}f(x)=L$ means:

2

\quad \forall\,\varepsilon>0\ \ \exists\,\delta>0\ \ \text{s.t.}\ \ 0<|x-a|<\delta \implies |f(x)-L|<\varepsilon.

Derivation hint: shrink the output band to half-width $\varepsilon$ ; completeness/continuity of $f$ lets you find a corresponding input band of half-width $\delta$ around $a$ (excluding $a$ itself). Symbols: $\delta$ is the input radius (depends on $\varepsilon$ and $a$ ), $a$ the limit point, $L$ the target value. Continuity at $a$ is the special case $L=f(a)$ , which additionally requires $f$ to be defined at $a$ .

DefinitionCompleteness — Least Upper Bound Property

Every nonempty subset $S\subseteq\mathbb{R}$ that is bounded above has a least upper bound (supremum) $\sup S\in\mathbb{R}$ :

3

\quad \big(\forall x\in S:\ x\le \sup S\big)\ \wedge\ \big(\forall \varepsilon>0\ \exists x\in S:\ x>\sup S-\varepsilon\big).

Derivation hint: the first clause says $\sup S$ is an upper bound; the second says nothing smaller can be — any attempt to lower it by $\varepsilon$ is beaten by some element of $S$ . This axiom is what distinguishes $\mathbb{R}$ from $\mathbb{Q}$ : the set $\{q\in\mathbb{Q}:q^2<2\}$ has no rational supremum, but has supremum $\sqrt 2$ in $\mathbb{R}$ .

TheoremThe Derivative as a Limit

A function $f$ is differentiable at $a$ with derivative $f'(a)$ if the limit

4

\quad f'(a)=\lim_{h\to 0}\frac{f(a+h)-f(a)}{h}

exists. Differentiability at $a$ implies continuity at $a$ (but not conversely). Derivation hint: write $f(a+h)-f(a)=\frac{f(a+h)-f(a)}{h}\cdot h$ ; the first factor tends to $f'(a)$ and the second to $0$ , so the product $\to 0$ , forcing continuity.

TheoremRiemann Integral as a Limit of Sums

For a bounded $f$ on $[a,b]$ with partition $P=\{a=x_0<\dots<x_n=b\}$ and tags $\xi_i\in[x_{i-1},x_i]$ , $f$ is Riemann integrable with integral $I$ if

5

\quad I=\int_a^b f(x)\,dx=\lim_{\|P\|\to 0}\sum_{i=1}^{n} f(\xi_i)\,(x_i-x_{i-1}),

where $\|P\|=\max_i(x_i-x_{i-1})$ is the mesh. Equivalently, the upper and lower Darboux sums share a common limit. Derivation hint: integrability $\iff$ for every $\varepsilon>0$ there is a partition with $U(f,P)-L(f,P)<\varepsilon$ ; continuous functions on compact $[a,b]$ are uniformly continuous, which delivers this.

ProofBounded Monotone Sequences Converge (from Completeness)

Claim: Every sequence $(x_n)$ that is increasing and bounded above converges. 1. The set $S=\{x_n:n\in\mathbb{N}\}$ is nonempty and bounded above, so by Equation [3] it has a supremum $L=\sup S$ . 2. Fix $\varepsilon>0$ . By the second clause of [3], there exists an index $N$ with $x_N>L-\varepsilon$ . 3. Since the sequence is increasing, for all $n\ge N$ we have $x_n\ge x_N>L-\varepsilon$ . 4. Since $L$ is an upper bound, $x_n\le L<L+\varepsilon$ for all $n$ . 5. Combining steps 3–4: for $n\ge N$ , $\ L-\varepsilon<x_n\le L$ , hence $|x_n-L|<\varepsilon$ . 6. This is exactly Equation [1], so $x_n\to L$ . $\blacksquare$ This single proof shows completeness is the engine: without it, increasing bounded sequences (like rational approximations to $\sqrt2$ ) could fail to converge inside the space.

∎

ProofContinuity ⟹ Boundedness on a Closed Interval (sketch)

Claim (Extreme Value Theorem, core step): A continuous $f:[a,b]\to\mathbb{R}$ is bounded. 1. Suppose not; then for each $n$ there is $x_n\in[a,b]$ with $|f(x_n)|>n$ . 2. $[a,b]$ is bounded, so by Bolzano–Weierstrass $(x_n)$ has a convergent subsequence $x_{n_k}\to c$ . 3. Since $[a,b]$ is closed, $c\in[a,b]$ , where $f$ is defined and continuous. 4. Continuity gives $f(x_{n_k})\to f(c)$ , so $(f(x_{n_k}))$ is bounded. 5. But $|f(x_{n_k})|>n_k\to\infty$ — contradiction. 6. Hence $f$ is bounded; a second supremum argument yields it attains its max and min. $\blacksquare$

∎

mathematician · Karl Weierstrass | 1815–1897

The "father of modern analysis," Weierstrass spent years as a provincial schoolteacher before his rigorous lectures at Berlin transformed the field. He banished vague talk of "infinitely small quantities" by founding everything on the ε–δ formalism (refining ideas of Bolzano and Cauchy). His 1872 construction of a continuous, nowhere-differentiable function $\sum a^n\cos(b^n\pi x)$ stunned mathematicians and proved that geometric intuition is an unreliable guide. He also formalized uniform convergence, the Bolzano–Weierstrass theorem, and the Weierstrass Approximation Theorem.

🧠 Intuition

Think of $\varepsilon$ as a target dartboard of shrinking radius around $L$ . Convergence means: no matter how tiny I make the board, you can promise me that all darts from some point on land inside it. The cleverness is that $N$ is allowed to grow as $\varepsilon$ shrinks — you get more "warm-up throws" for harder targets. Continuity is the same game played on inputs and outputs simultaneously: squeeze the output window to width $\varepsilon$ , and continuity guarantees a matching input window of width $\delta$ exists. Completeness is the silent referee ensuring the limit point is actually on the field — that the real line has no missing points where a sequence "wants to land" but cannot.

Figure

The ε–δ definition of a function limit: outputs trapped in the ε-band force inputs into the δ-band

ExampleProving a Limit by ε–N

Given: Show $\displaystyle\lim_{n\to\infty}\frac{3n+1}{n+2}=3$ .

Steps: 1. Compute the distance: $\left|\dfrac{3n+1}{n+2}-3\right|=\left|\dfrac{3n+1-3n-6}{n+2}\right|=\dfrac{5}{n+2}$ . 2. We need $\dfrac{5}{n+2}<\varepsilon$ , i.e. $n+2>\dfrac{5}{\varepsilon}$ , i.e. $n>\dfrac{5}{\varepsilon}-2$ . 3. Choose $N=\left\lceil \dfrac{5}{\varepsilon}\right\rceil$ (any integer exceeding $\tfrac5\varepsilon-2$ works). 4. Then $n\ge N\implies \dfrac{5}{n+2}<\varepsilon$ , verifying Equation [1]. For a numerical check, take $\varepsilon=0.01$ : then $N=\lceil 500\rceil=500$ . At $n=500$ , the term is $\frac{1501}{502}\approx 2.9900$ , indeed within $0.01$ of $3$ .

\boxed{\lim_{n\to\infty}\frac{3n+1}{n+2}=3,\quad N(\varepsilon)=\left\lceil 5/\varepsilon\right\rceil}

ExampleDerivative from First Principles

Given: Compute $f'(2)$ for $f(x)=x^2+3x$ using Equation [4].

Steps: 1. $f(2+h)=(2+h)^2+3(2+h)=4+4h+h^2+6+3h=10+7h+h^2$ . 2. $f(2)=4+6=10$ . 3. Difference quotient: $\dfrac{f(2+h)-f(2)}{h}=\dfrac{7h+h^2}{h}=7+h$ (for $h\ne0$ ). 4. Take the limit: $\displaystyle\lim_{h\to0}(7+h)=7$ . Sanity check against the rule $f'(x)=2x+3$ at $x=2$ : $2(2)+3=7$ . ✓

\boxed{f'(2)=7\ \text{(dimensionless slope, units: output per input)}}

⚠️ Common mistake

"Pointwise convergence is enough to swap limits and integrals." It is not. If $f_n\to f$ pointwise, you cannot in general conclude $\int f_n\to\int f$ , nor that the limit $f$ is continuous, nor that $\frac{d}{dx}\lim f_n=\lim f_n'$ . You need stronger hypotheses — uniform convergence (for continuity and integration) or the Dominated/Monotone Convergence Theorems (in Lebesgue theory). Confusing pointwise and uniform convergence is the single most common error in introductory analysis.

CounterexampleContinuous but Nowhere Differentiable

The Weierstrass function

W(x)=\sum_{n=0}^{\infty} a^n\cos(b^n\pi x),\quad 0<a<1,\ b\ \text{odd},\ ab>1+\tfrac{3\pi}{2},

is continuous everywhere (the series converges uniformly by the Weierstrass M-test, since $\sum a^n<\infty$ ) yet differentiable at no point. It demolishes the intuition that continuous functions are "mostly smooth." A simpler counterexample for the limit-swap warning: $f_n(x)=x^n$ on $[0,1]$ converges pointwise to the discontinuous function that is $0$ on $[0,1)$ and $1$ at $x=1$ — continuity is not preserved without uniform convergence.

CounterexamplePointwise Limit Kills the Integral

Let $f_n(x)=n$ on $(0,1/n)$ and $0$ elsewhere on $[0,1]$ . Then $f_n(x)\to 0$ pointwise for every fixed $x$ (eventually $x>1/n$ ), so $\int_0^1\lim f_n = 0$ . But $\int_0^1 f_n\,dx = n\cdot\frac1n = 1$ for all $n$ , so $\lim\int f_n = 1\ne 0$ . The "spike escaping to infinity" carries area that vanishes pointwise but not in the integral.

connection

Analysis is the trunk from which many branches grow. The ε–δ framework generalizes to abstract distances in Metric Spaces and to open-set structures in Topology, where continuity becomes "preimages of open sets are open." The Riemann integral (Equation [5]) is superseded by the more powerful Lebesgue Integration, which handles wild functions and limit-swapping gracefully. Differentiation extends to several variables in Multivariable Calculus and to the complex plane in Complex Analysis, where differentiability is astonishingly rigid. The study of infinite sums links to Power Series and Fourier Analysis, and the completeness of $\mathbb{R}$ is itself constructed in Construction of the Real Numbers via Dedekind cuts or Cauchy sequences.

🔬 Where this appears

⏳ History

- c. 1665–1684 — Newton and Leibniz independently develop calculus, using intuitive but logically shaky "infinitesimals" and "fluxions."

- 1734 — Bishop Berkeley's The Analyst attacks infinitesimals as "ghosts of departed quantities," exposing the foundational crisis.

- 1817 — Bolzano gives an early rigorous proof of the Intermediate Value Theorem and an ε-style definition of continuity, largely unnoticed.

- 1821 — Cauchy's Cours d'analyse systematizes limits, continuity, and convergence, bringing rigor toward the mainstream.

- 1854 — Riemann defines his integral precisely (Equation [5]) and studies trigonometric series, prompting questions about integrability.

- 1872 — Weierstrass publishes his continuous nowhere-differentiable function; Dedekind and Cantor independently construct

\mathbb{R}

from

\mathbb{Q}

, securing completeness.

- 1902 — Lebesgue's thesis introduces measure and the Lebesgue integral, resolving the limit-swap defects of Riemann's theory.

- 1906–1932 — Fréchet, Hausdorff, and Banach abstract analysis into metric, topological, and normed spaces — the birth of functional analysis.

open-problem

While the foundations of real analysis are settled, deep questions persist at its frontiers. The Riemann Hypothesis — concerning the zeros of the analytic continuation of $\zeta(s)=\sum n^{-s}$ — remains open and is the most famous problem in complex analysis. In measure theory, the existence of non-measurable sets depends on the Axiom of Choice, and the continuum hypothesis (is there a cardinality strictly between $|\mathbb{N}|$ and $|\mathbb{R}|$ ?) is independent of standard set theory, touching the very fabric of the real line. Nonstandard analysis (Robinson, 1960s) rehabilitated infinitesimals rigorously via hyperreal numbers, showing the "ghosts" can be exorcised in more than one way — a reminder that the ε–δ framework, while dominant, is not the only logically valid route.

Formal Statement

Why It Holds / Derivation

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also