Tensor Algebra and Index Notation

⚡ Key Takeaways

Tensor Algebra and Index Notation is the systematic calculus of multilinear objects expressed through indexed components, where covariant and contravariant indices transform oppositely under change of basis. Key result: Tensors are defined intrinsically as multilinear maps, but index notation with the Einstein summation convention provides a coordinate-free-equivalent computational machinery in which contraction, raising/lowering, and symmetrization become algebraic operations. Applies in: differential geometry, general relativity, continuum mechanics, quantum field theory, machine learning. Who/when: Ricci-Curbastro and Levi-Civita (1900) systematized the "absolute differential calculus"; Einstein popularized index notation (1916).

💡 The Core Insight

A tensor is an invariant object; its components are not. The genius of index notation is that it tracks how components must transform by attaching to each index a transformation slot. An expression is a valid tensor equation if and only if every free index matches in position (up/down) and name on both sides, and every repeated index appears exactly once up and once down. This "index balance" is a syntactic guarantee of geometric meaning — a typechecker for physics.

DefinitionTensor of type

(p,q)

Let $V$ be an $n$ -dimensional vector space over $\mathbb{R}$ with dual $V^*$ . A tensor of type $(p,q)$ (contravariant rank $p$ , covariant rank $q$ ) is a multilinear map

1

\quad T:\underbrace{V^*\times\cdots\times V^*}_{p}\times\underbrace{V\times\cdots\times V}_{q}\longrightarrow \mathbb{R}.

Derivation hint: Multilinearity means linearity in each argument separately; the space of all such maps is canonically isomorphic to $V^{\otimes p}\otimes (V^*)^{\otimes q}$ . Given a basis $\{e_i\}$ of $V$ and dual basis $\{e^j\}$ of $V^*$ with $e^j(e_i)=\delta^j_i$ , the components are

2

\quad T^{i_1\cdots i_p}{}_{j_1\cdots j_q}=T(e^{i_1},\dots,e^{i_p},e_{j_1},\dots,e_{j_q}).

Derivation hint: Evaluate the multilinear map on basis covectors (upper slots) and basis vectors (lower slots); multilinearity recovers $T$ on arbitrary arguments.

DefinitionEinstein Summation Convention

Whenever an index appears once as a superscript and once as a subscript in a single term, summation over its range $1,\dots,n$ is implied:

3

\quad v^i e_i \equiv \sum_{i=1}^n v^i e_i,\qquad A^i{}_j v^j \equiv \sum_{j=1}^n A^i{}_j v^j.

Derivation hint: This is purely notational; it suppresses $\sum$ for contractions. A repeated index is "dummy" (summed); an unrepeated index is "free" and labels a component.

TheoremTransformation Law

Under a change of basis $e_{i'}=A^i{}_{i'}e_i$ with inverse Jacobian $\tilde A^{i'}{}_i$ (so $A^i{}_{i'}\tilde A^{i'}{}_k=\delta^i_k$ ), the components of a $(p,q)$ -tensor transform as

4

\quad T^{i'_1\cdots i'_p}{}_{j'_1\cdots j'_q}=\tilde A^{i'_1}{}_{i_1}\cdots\tilde A^{i'_p}{}_{i_p}\,A^{j_1}{}_{j'_1}\cdots A^{j_q}{}_{j'_q}\,T^{i_1\cdots i_p}{}_{j_1\cdots j_q}.

Derivation hint: Substitute the basis change into [2] and use multilinearity; upper indices pull the inverse Jacobian (contravariant), lower indices pull the Jacobian (covariant). Conversely, any indexed array obeying [4] defines a unique tensor.

TheoremQuotient Theorem

Let $X^{i_1\cdots i_p}{}_{j_1\cdots j_q}$ be an array. If for every tensor $A$ the contraction $X^{\cdots}{}_{\cdots}A^{\cdots}{}_{\cdots}$ (summed over a complementary set of indices) yields a tensor, then $X$ is itself a tensor.

5

\quad \big(X^{ij}A_j=B^i \text{ a tensor }\forall\, A_j \text{ tensor}\big)\ \Rightarrow\ X^{ij}\text{ is a tensor}.

Derivation hint: Write the transformation of $B^i$ and $A_j$ , equate, and exploit arbitrariness of $A_j$ to peel off its transformation matrix, leaving the tensor law for $X$ .

ProofIndex Balance Forces Invariance

We show that an equation $L^{i}{}_{j}=R^{i}{}_{j}$ with matched free indices is frame-independent.

Step 1. Suppose both $L^i{}_j$ and $R^i{}_j$ are components of $(1,1)$ -tensors $\mathcal{L},\mathcal{R}$ . By [4],

6

\quad L^{i'}{}_{j'}=\tilde A^{i'}{}_i A^{j}{}_{j'}L^i{}_j,\qquad R^{i'}{}_{j'}=\tilde A^{i'}{}_i A^{j}{}_{j'}R^i{}_j.

Derivation hint: Apply the $(1,1)$ specialization of [4] to each side independently.

Step 2. If $L^i{}_j=R^i{}_j$ in one frame, subtract: $(L^i{}_j-R^i{}_j)=0$ . Multiply by $\tilde A^{i'}{}_i A^{j}{}_{j'}$ :

7

\quad L^{i'}{}_{j'}-R^{i'}{}_{j'}=\tilde A^{i'}{}_i A^{j}{}_{j'}\,(L^i{}_j-R^i{}_j)=0.

Derivation hint: Linearity of the transformation in the components; a zero array maps to a zero array.

Step 3. Hence $L^{i'}{}_{j'}=R^{i'}{}_{j'}$ in every frame. The equation is invariant. $\blacksquare$

Contraction is tensorial. Set $j=i$ in $T^i{}_j$ and sum:

8

\quad T^i{}_i=\tilde A^{i'}{}_i A^{j}{}_{i'}T'^{?}\ \Longrightarrow\ \text{trace transforms as a scalar}.

The key identity $\tilde A^{i'}{}_i A^{i}{}_{j'}=\delta^{i'}_{j'}$ collapses the two transformation matrices, leaving a $(0,0)$ -tensor (scalar). This is why contraction lowers type by $(1,1)$ and yields an invariant. Derivation hint: Contracting one upper with one lower index pairs a Jacobian with its inverse, which annihilate to a Kronecker delta.

∎

mathematician · Gregorio Ricci-Curbastro | 1853–1925

Ricci-Curbastro developed the absolute differential calculus between 1884 and 1900, the systematic theory of how differential expressions could be made invariant under arbitrary coordinate changes. With his student Tullio Levi-Civita, he published Méthodes de calcul différentiel absolu et leurs applications (1900), introducing the covariant/contravariant index machinery and what would become the Ricci tensor. The work languished until 1912–1915, when Einstein, guided by his friend Marcel Grossmann, recognized that this calculus was precisely the mathematics needed for a generally covariant theory of gravitation. Ricci's notation — upper and lower indices — survives essentially unchanged in modern physics.

🧠 Intuition

Think of a vector $v$ as an arrow that exists independently of any grid you draw. When you switch from a coarse grid to a fine grid, the basis vectors shrink but the arrow is unchanged, so its components must grow to compensate — they transform contra (against) the basis. Hence "contravariant," upper index. A covector (gradient, a stack of level surfaces) does the opposite: refine the grid and its components shrink with the basis — "covariant," lower index. The Einstein convention's "one up, one down" rule is the algebraic statement that an upper-index growth and a lower-index shrinkage cancel, producing a number everyone agrees on. Raising and lowering indices with the metric $g_{ij}$ is just the geometric act of converting "arrow" descriptions to "stack" descriptions using the inner product to measure projection.

Figure

Covariant vs. contravariant index placement and the contraction that produces an invariant scalar

ExampleContracting the Inertia Tensor with Angular Velocity

Given: A rigid body has inertia tensor (in kg·m², a $(0,2)$ -symmetric tensor; here Cartesian so up/down coincide)

I_{ij}=\begin{pmatrix} 2 & 0 & 1\\ 0 & 3 & 0\\ 1 & 0 & 4\end{pmatrix},\qquad \omega^j=(1,\,2,\,1)\ \text{rad/s}.

Find: Angular momentum $L_i=I_{ij}\omega^j$ and rotational kinetic energy $E=\tfrac12 I_{ij}\omega^i\omega^j$ .

Step 1 — contract once (lower one free index $i$ remains):

9

\quad L_i=I_{ij}\omega^j.

Derivation hint: Sum over $j=1,2,3$ for each fixed $i$ ; one free index ⇒ result is a covector. $L_1=2(1)+0(2)+1(1)=3$ $L_2=0(1)+3(2)+0(1)=6$ $L_3=1(1)+0(2)+4(1)=5$

Step 2 — contract again with $\omega^i$ (no free index ⇒ scalar):

10

\quad 2E=\omega^i L_i=1(3)+2(6)+1(5)=20.

Derivation hint: Full contraction of a $(0,2)$ -tensor with two copies of a vector gives an invariant scalar.

Answer: $\boxed{L_i=(3,\,6,\,5)\ \text{kg}\,\cdot\,\text{m}^2/\text{s}, \quad E=10\ \text{J}}$

ExampleVerifying a Tensor Equation by Index Balance

Given: Claim — in Cartesian coordinates the Maxwell stress combination $T^{ij}=E^iE^j-\tfrac12\delta^{ij}E^kE_k$ is symmetric and its divergence-related contraction is well posed.

Step 1 — check index balance. $T^{ij}$ has two free upper indices on both sides:

$E^iE^j$ : free $i,j$ . ✓
$\delta^{ij}E^kE_k$ : $\delta^{ij}$ supplies free $i,j$ ; $E^kE_k$ has $k$ up and down (dummy, summed). ✓

Both terms carry exactly free $(i,j)$ — the equation is well formed.

11

\quad T^{ij}=E^iE^j-\tfrac12\delta^{ij}E^kE_k.

Derivation hint: Every free index appears in the same position on every additive term; dummy index $k$ is balanced up/down.

Step 2 — symmetry. Swap $i\leftrightarrow j$ : $E^jE^i-\tfrac12\delta^{ji}E^kE_k=T^{ij}$ since $E^iE^j$ and $\delta^{ij}$ are symmetric.

12

\quad T^{ij}=T^{ji}.

Derivation hint: Product of components commutes; Kronecker delta is symmetric.

Step 3 — trace. $T^i{}_i=E^iE_i-\tfrac12\delta^i{}_i\,E^kE_k$ . With $\delta^i{}_i=3$ in 3D:

13

\quad T^i{}_i=E^2-\tfrac32 E^2=-\tfrac12 E^2.

Derivation hint: $\delta^i{}_i$ sums the diagonal of the identity = dimension $n=3$ .

Answer: $\boxed{T^{ij}\text{ is symmetric, } \operatorname{tr}T=-\tfrac12 E^2.}$

⚠️ Common mistake

A repeated index summed twice up or twice down is NOT a tensor contraction. Writing $A^{ii}$ (both up) or $g^{ij}g^{ij}$ (no balance) violates the convention. In Cartesian coordinates where the metric is the identity, such expressions accidentally give the right number, masking the error — but they fail to transform correctly under general coordinate changes. Always pair one upper with one lower index. Equally, a free index must appear in the same position on both sides: $v^i = w_i$ is meaningless (a vector cannot equal a covector); you need $v^i=g^{ij}w_j$ .

Counterexample

Consider in 2D the array $\Gamma^i{}_{jk}$ of Christoffel symbols. It carries three indices and looks like a $(1,2)$ -tensor, but it is not a tensor. Under coordinate change it picks up an inhomogeneous second-derivative term:

14

\quad \Gamma'^{i'}{}_{j'k'}=\tilde A^{i'}{}_i A^{j}{}_{j'}A^{k}{}_{k'}\Gamma^i{}_{jk}+\tilde A^{i'}{}_i\,\frac{\partial^2 x^i}{\partial x^{j'}\partial x^{k'}}.

Derivation hint: Differentiate the basis transformation; the extra term comes from the derivative acting on the position-dependent Jacobian. The presence of the second term means $\Gamma$ violates [4]. This is precisely why partial derivatives of tensors are not tensors, motivating the covariant derivative, whose Christoffel correction cancels the inhomogeneous piece. A correct array passing index balance can still fail to be a tensor.

connection

Tensor algebra is the static, point-wise skeleton on which Differential Geometry builds the dynamics: smoothly varying tensors become tensor fields, and the failure of $\partial_k$ to be tensorial (the Christoffel Symbols counterexample) leads to the Covariant Derivative and Curvature Tensor. The metric tensor $g_{ij}$ supplies the inner product enabling Raising and Lowering Indices, linking $V$ and $V^*$ — this is the index-notation face of the Musical Isomorphism. Symmetrization and antisymmetrization of indices generate the Exterior Algebra of differential forms, where antisymmetric $(0,q)$ -tensors become $q$ -forms. The abstract multilinear-map definition connects to the universal property in Multilinear Algebra and the Tensor Product of vector spaces.

🔬 Where this appears

⏳ History

- 1827 — Carl Friedrich Gauss studies intrinsic surface geometry; the first metric quadratic form

ds^2=E\,du^2+2F\,du\,dv+G\,dv^2

foreshadows the metric tensor.

- 1854 — Bernhard Riemann's Habilitation lecture introduces

n

-dimensional manifolds and the curvature concept, demanding a multilinear formalism.

- 1869 — Elwin Bruno Christoffel introduces the symbols bearing his name while studying when two quadratic differential forms are equivalent.

- 1884–1894 — Gregorio Ricci-Curbastro develops the absolute differential calculus, formalizing covariant and contravariant transformation.

- 1900 — Ricci and Tullio Levi-Civita publish their definitive memoir systematizing tensor calculus and index notation.

- 1912–1915 — Marcel Grossmann teaches Einstein the Ricci calculus; Einstein adopts it for general relativity.

- 1916 — Einstein introduces the summation convention in his foundational GR paper, eliminating explicit summation signs.

- 1917 — Levi-Civita and Hermann Weyl develop parallel transport and the connection, clarifying the non-tensorial nature of

\Gamma

.

- 1923 — Élie Cartan reformulates tensor calculus via differential forms and moving frames, complementing index methods.

open-problem

Index notation's power obscures genuine conceptual subtleties. (1) Coordinate vs. abstract indices: Penrose's abstract index notation uses indices as type markers without committing to a basis, reconciling the computational clarity of indices with coordinate-freedom — but the precise category-theoretic semantics of mixing abstract and coordinate indices remains a pedagogical minefield. (2) Density and weight: Tensor densities (e.g., $\sqrt{-g}$ , the Levi-Civita symbol $\varepsilon_{ijk}$ ) transform with Jacobian determinant powers and are not tensors; tracking weights consistently is error-prone and lacks universal notational standards. (3) Higher categories: Generalizing tensor contraction to graphical/string-diagram calculus and to symmetric monoidal categories raises open questions about canonical forms and the complexity of optimal tensor-network contraction — the latter is NP-hard, a live problem in computational physics and machine learning. (4) Infinite dimensions: In infinite-dimensional or operator-algebraic settings, $V^{**}\ne V$ and the clean raising/lowering duality breaks, so index notation requires careful reinterpretation.

Formal Statement

Why It Holds / Derivation

Building Intuition

Worked Examples

Common Misconceptions

Connections

Real-World Applications

Historical Development

Subtleties & Limits

See Also