Multivariable Functions

⚡ Key Takeaways

A multivariable function maps several real inputs to one or more real outputs, $f:\mathbb{R}^n\to\mathbb{R}^m$ . Its values depend jointly on all input variables, so it encodes surfaces, fields, and transformations rather than mere curves. Used across calculus, physics, economics, machine learning, and engineering wherever a quantity depends on more than one independent variable. Studied systematically since the 18th–19th centuries (Euler, Cauchy, Jacobi, Weierstrass).

💡 The Core Insight

The central conceptual leap from one variable to many is that there is no single "rate of change": variation depends on the direction in which you move. A scalar field over $\mathbb{R}^n$ has infinitely many directional derivatives at each point, organized by a single linear object—the gradient or, more generally, the derivative (Jacobian) matrix. Local behavior is governed by linear approximation in all directions at once, and limits must respect every path of approach, not just coordinate lines.

DefinitionMultivariable Function

Let $D\subseteq\mathbb{R}^n$ be nonempty. A multivariable function is a rule

1

\quad f: D\subseteq\mathbb{R}^n \to \mathbb{R}^m,\qquad \mathbf{x}=(x_1,\dots,x_n)\mapsto f(\mathbf{x})=\big(f_1(\mathbf{x}),\dots,f_m(\mathbf{x})\big)

Derivation hint: a function is a set of ordered pairs $(\mathbf{x},\mathbf{y})$ with $\mathbf{x}\in D$ , $\mathbf{y}\in\mathbb{R}^m$ , in which each $\mathbf{x}$ appears at most once; the component form follows by projecting onto coordinates. Here:

$n$ = number of independent variables (dimension of the domain),
$m$ = number of output components (dimension of the codomain),
each $f_i:D\to\mathbb{R}$ is a scalar component function,
the range is $\{f(\mathbf{x}):\mathbf{x}\in D\}\subseteq\mathbb{R}^m$ .

When $m=1$ , $f$ is a scalar field and its graph is the set

2

\quad \Gamma_f=\{(\mathbf{x},f(\mathbf{x}))\in\mathbb{R}^{n+1}:\mathbf{x}\in D\}

Derivation hint: replace the last output coordinate of the codomain $\mathbb{R}^{n+1}$ with the function value; this generalizes $y=f(x)$ to a hypersurface of dimension $n$ .

DefinitionLevel Sets

For a scalar field $f:D\to\mathbb{R}$ and constant $c\in\mathbb{R}$ , the level set at value $c$ is

3

\quad L_c=f^{-1}(\{c\})=\{\mathbf{x}\in D : f(\mathbf{x})=c\}

Derivation hint: take the preimage of a single point under $f$ ; in $\mathbb{R}^2$ this is a level curve (contour), in $\mathbb{R}^3$ a level surface.

DefinitionLimit of a Multivariable Function

Let $\mathbf{a}$ be a limit point of $D$ . We write $\lim_{\mathbf{x}\to\mathbf{a}}f(\mathbf{x})=\mathbf{L}$ if

4

\quad \forall\varepsilon>0\ \exists\delta>0:\ 0<\|\mathbf{x}-\mathbf{a}\|<\delta,\ \mathbf{x}\in D \implies \|f(\mathbf{x})-\mathbf{L}\|<\varepsilon

Derivation hint: replace absolute values in the single-variable $\varepsilon$ – $\delta$ definition by the Euclidean norm $\|\cdot\|$ ; the punctured ball of radius $\delta$ must lie entirely inside $D$ 's relevant neighborhood for every direction simultaneously.

TheoremContinuity and Component Decomposition

A function $f:D\to\mathbb{R}^m$ is continuous at $\mathbf{a}\in D$ if and only if every component function $f_i$ is continuous at $\mathbf{a}$ . Moreover $\lim_{\mathbf{x}\to\mathbf{a}}f(\mathbf{x})=\mathbf{L}$ iff $\lim_{\mathbf{x}\to\mathbf{a}}f_i(\mathbf{x})=L_i$ for each $i$ . The vector limit (when it exists) is unique and must agree along every path approaching $\mathbf{a}$ .

ProofComponent Reduction of Limits

We show vector convergence is equivalent to coordinatewise convergence. 1. Forward direction. Suppose $\lim_{\mathbf{x}\to\mathbf{a}}f(\mathbf{x})=\mathbf{L}$ . For each $i$ , the projection $\pi_i(\mathbf{y})=y_i$ satisfies $|y_i-L_i|\le\|\mathbf{y}-\mathbf{L}\|$ . Hence given $\varepsilon>0$ , the same $\delta$ from $[4]$ forces $|f_i(\mathbf{x})-L_i|\le\|f(\mathbf{x})-\mathbf{L}\|<\varepsilon$ . 2. Reverse direction. Suppose each $f_i\to L_i$ . Given $\varepsilon>0$ , choose $\delta_i$ so $|f_i(\mathbf{x})-L_i|<\varepsilon/\sqrt{m}$ on the punctured $\delta_i$ -ball. Let $\delta=\min_i\delta_i$ . 3. Then on the punctured $\delta$ -ball,

5

\quad \|f(\mathbf{x})-\mathbf{L}\| = \Big(\sum_{i=1}^m |f_i(\mathbf{x})-L_i|^2\Big)^{1/2} < \Big(\sum_{i=1}^m \tfrac{\varepsilon^2}{m}\Big)^{1/2}=\varepsilon

Derivation hint: square and sum the componentwise bounds, then take the square root; the bound $\varepsilon/\sqrt m$ is chosen precisely so the sum of $m$ terms collapses to $\varepsilon^2$ . 4. Uniqueness follows from the Hausdorff property of $\mathbb{R}^m$ : two distinct limits $\mathbf{L}\ne\mathbf{L}'$ would force $\|f(\mathbf{x})-\mathbf{L}\|$ and $\|f(\mathbf{x})-\mathbf{L}'\|$ both below $\|\mathbf{L}-\mathbf{L}'\|/2$ , contradicting the triangle inequality. $\blacksquare$

∎

DefinitionDirectional Derivative and Gradient

For scalar $f$ , the directional derivative at $\mathbf{a}$ along a unit vector $\mathbf{u}$ is

6

\quad D_{\mathbf{u}}f(\mathbf{a})=\lim_{t\to 0}\frac{f(\mathbf{a}+t\mathbf{u})-f(\mathbf{a})}{t}

Derivation hint: restrict $f$ to the line $t\mapsto\mathbf{a}+t\mathbf{u}$ , producing a one-variable function whose ordinary derivative at $t=0$ is $D_{\mathbf u}f(\mathbf a)$ . The gradient collects all first partials, and for differentiable $f$ ,

7

\quad \nabla f(\mathbf{a})=\Big(\tfrac{\partial f}{\partial x_1},\dots,\tfrac{\partial f}{\partial x_n}\Big)\Big|_{\mathbf{a}},\qquad D_{\mathbf{u}}f(\mathbf{a})=\nabla f(\mathbf{a})\cdot\mathbf{u}

Derivation hint: apply the multivariable chain rule to $g(t)=f(\mathbf{a}+t\mathbf{u})$ ; $g'(0)=\sum_i \partial_i f\, u_i$ , which is the dot product.

TheoremBest Linear Approximation / Differentiability

$f:D\to\mathbb{R}^m$ is differentiable at an interior point $\mathbf{a}$ if there exists a linear map $Df(\mathbf{a})\in\mathbb{R}^{m\times n}$ (the Jacobian) with

8

\quad \lim_{\mathbf{h}\to\mathbf{0}}\frac{\big\|f(\mathbf{a}+\mathbf{h})-f(\mathbf{a})-Df(\mathbf{a})\,\mathbf{h}\big\|}{\|\mathbf{h}\|}=0

Derivation hint: this demands the error of the affine approximation $f(\mathbf a)+Df(\mathbf a)\mathbf h$ vanish faster than $\|\mathbf h\|$ ; it is the exact multivariable analogue of $f(a+h)=f(a)+f'(a)h+o(h)$ . The Jacobian entries are the partials $[Df(\mathbf{a})]_{ij}=\partial f_i/\partial x_j$ . Existence of all partials does not imply differentiability, but if the partials exist and are continuous near $\mathbf{a}$ , then $f$ is differentiable there ( $C^1\Rightarrow$ differentiable).

mathematician · Augustin-Louis Cauchy | 1789–1857

Cauchy gave the modern rigorous footing for limits, continuity, and convergence that multivariable analysis rests upon. His insistence on the $\varepsilon$ – $\delta$ spirit (later formalized by Weierstrass) turned vague talk of "infinitely small" multivariable increments into precise statements. Cauchy also contributed foundational results on systems of functions and the determinant theory that underlies the Jacobian, the key object measuring how a multivariable map distorts volume locally.

🧠 Intuition

Picture a scalar field $f(x,y)$ as a landscape: the height above each point $(x,y)$ is the function value. The graph $[2]$ is the terrain surface. Level curves $[3]$ are the contour lines on a topographic map—walking along one keeps your altitude fixed. The gradient $[7]$ points in the direction of steepest ascent, and its magnitude tells you how steep. Crucially, the gradient is always perpendicular to the level curve through your point: along a contour the height doesn't change, so the "uphill" arrow can have no component tangent to it. For a vector field $f:\mathbb{R}^2\to\mathbb{R}^2$ , drop the landscape picture and imagine an arrow attached to every point—like wind velocity over a map. The Jacobian $[8]$ then tells you how a tiny disk of points near $\mathbf{a}$ gets stretched, rotated, and sheared into a tiny ellipse near $f(\mathbf{a})$ .

Figure

Graph, level curves, and gradient of

f(x,y)=x^2+y^2

TF

The Field Picture

Physicists meet multivariable functions as fields. A scalar field like temperature $T(x,y,z)$ or electric potential $V(\mathbf r)$ assigns one number to each point of space; its gradient $-\nabla V=\mathbf E$ gives the electric field, a vector field. The recurring theme is that physical laws are statements about how fields vary in space and time: $\nabla\cdot\mathbf E$ , $\nabla\times\mathbf B$ , and $\nabla^2\phi$ all package directional rates of change of multivariable functions. The Jacobian's determinant appears when changing coordinates in integrals (e.g., to spherical coordinates) and measures local volume scaling.

ExampleComputing a Gradient and Steepest-Ascent Rate

Given: $f(x,y)=x^2 y + 3y$ (a dimensionless potential), evaluate at $\mathbf{a}=(2,1)$ , and find the maximum rate of increase and its direction.

Steps: 1. Partials: $\dfrac{\partial f}{\partial x}=2xy$ , $\dfrac{\partial f}{\partial y}=x^2+3$ . 2. At $(2,1)$ : $\partial_x f = 2(2)(1)=4$ , $\partial_y f = 4+3=7$ . 3. Gradient: $\nabla f(2,1)=(4,7)$ via $[7]$ . 4. Maximum directional derivative equals $\|\nabla f\|$ (achieved when $\mathbf u\parallel\nabla f$ ):

9

\quad \max_{\|\mathbf u\|=1} D_{\mathbf u}f = \|\nabla f(2,1)\| = \sqrt{4^2+7^2}=\sqrt{65}

Derivation hint: $D_{\mathbf u}f=\nabla f\cdot\mathbf u=\|\nabla f\|\cos\theta$ is maximized at $\theta=0$ , giving $\|\nabla f\|$ . 5. Unit direction of steepest ascent: $\mathbf u^*=\tfrac{1}{\sqrt{65}}(4,7)$ .

Answer: $\boxed{\nabla f(2,1)=(4,7),\quad \text{max rate}=\sqrt{65}\approx 8.06\ \text{(units of }f\text{ per unit length)},\quad \mathbf u^*=\tfrac{1}{\sqrt{65}}(4,7)}$

ExampleA Limit That Fails (Path Dependence)

Given: $f(x,y)=\dfrac{xy}{x^2+y^2}$ for $(x,y)\ne(0,0)$ . Does $\lim_{(x,y)\to(0,0)}f$ exist?

Steps: 1. Along $y=0$ : $f(x,0)=0/x^2=0$ , so the limit along the $x$ -axis is $0$ . 2. Along $x=0$ : $f(0,y)=0$ likewise gives $0$ . 3. Along $y=x$ : $f(x,x)=\dfrac{x^2}{2x^2}=\dfrac12$ for all $x\ne0$ . 4. Compute the candidate values:

10

\quad \lim_{x\to0}f(x,0)=0 \ \ne\ \tfrac12=\lim_{x\to0}f(x,x)

Derivation hint: substitute the path equation into $f$ to reduce it to a single-variable limit; differing path limits violate uniqueness from the <span class="wiki-link-missing">Continuity and Component Decomposition</span> theorem. 5. Because two paths give different values, the joint limit cannot exist.

Answer: $\boxed{\text{The limit does not exist; } f \text{ is discontinuous at } (0,0)\text{ regardless of how it is defined there.}}$

⚠️ Common mistake

Existence of all partial derivatives does NOT imply continuity or differentiability. Partials probe only the coordinate-axis directions. A function can have $\partial_x f$ and $\partial_y f$ defined everywhere yet not be continuous, let alone differentiable, at a point. The correct local linearization criterion is the limit $[8]$ , not the mere existence of partials. The reliable shortcut is the $C^1$ theorem: continuous partials guarantee differentiability.

CounterexamplePartials Exist, Function Is Discontinuous

Let

11

\quad f(x,y)=\begin{cases}\dfrac{xy}{x^2+y^2}, & (x,y)\ne(0,0)\\[2mm] 0,& (x,y)=(0,0)\end{cases}

Derivation hint: this is the function of $[10]$ with the value $0$ assigned at the origin. Both partials at the origin exist:

12

\quad f_x(0,0)=\lim_{t\to0}\frac{f(t,0)-0}{t}=\lim_{t\to0}\frac{0}{t}=0,\qquad f_y(0,0)=0

Derivation hint: along each axis $f\equiv0$ , so the difference quotient defining each partial is identically zero. Yet $f$ is not continuous at $(0,0)$ , since the limit along $y=x$ is $\tfrac12\ne f(0,0)=0$ . Existence of partials therefore fails to control behavior off the axes—the essential warning of multivariable calculus.

connection

Multivariable functions sit at the crossroads of analysis and geometry. The single-variable theory of Differentiation generalizes to the Jacobian Matrix and the differentiability criterion $[8]$ . Integration extends to Multiple Integrals via Fubini's theorem, where the Change of Variables Theorem uses the Jacobian determinant. The directional structure $[7]$ launches the study of Gradient Vector Fields, Divergence and Curl, and ultimately Vector Calculus. Level sets $[3]$ connect to Implicit Function Theorem and the geometry of Manifolds. In optimization, $\nabla f=\mathbf 0$ characterizes critical points, linking to Lagrange Multipliers and the Hessian Matrix second-derivative test.

🔬 Where this appears

⏳ History

- 1667–1684: Newton and Leibniz develop single-variable calculus, laying the conceptual groundwork for rates of change later extended to many variables.

- 1734: Euler systematically studies functions of several variables and introduces notation for partial differentiation in mechanics and fluid problems.

- 1748: Euler's Introductio in analysin infinitorum treats functions abstractly, broadening the function concept beyond single inputs.

- 1797–1813: Lagrange develops the calculus of variations and the multiplier method for constrained multivariable optimization.

- 1821: Cauchy's Cours d'analyse gives rigorous limit and continuity definitions adaptable to multivariable settings.

- 1841: Jacobi publishes on functional determinants—the Jacobian—formalizing how multivariable maps transform volumes.

- 1854–1868: Riemann's work on manifolds and multivariable integration reframes functions on curved domains.

- 1870s: Weierstrass cements the

\varepsilon

–

\delta

formalism, and pathological examples (nowhere-differentiable, path-dependent limits) sharpen the distinction between partial and total differentiability.

- 1900s: Fréchet and others generalize differentiability to abstract normed spaces, with

[8]

as the template (the Fréchet derivative).

open-problem

While the theory of multivariable functions is classical and complete, practical and computational frontiers remain open. High-dimensional optimization (where $n$ is in the millions) is dominated by the geometry of saddle points and non-convex loss landscapes, whose structure is not fully understood. The behavior of generic smooth functions in very high dimensions—where almost all critical points are saddles and the curse of dimensionality makes sampling intractable—drives active research in optimization theory and statistics. Even classifying singularities of smooth maps $\mathbb R^n\to\mathbb R^m$ (catastrophe and singularity theory, following Whitney and Thom) yields rich, still-expanding taxonomies, and questions about the regularity of solutions to nonlinear PDEs involving multivariable fields (e.g., Navier–Stokes smoothness) remain among the deepest unsolved problems in mathematics.

Formal Statement

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also