Heat Capacity and the Fluctuation-Response Relation
Poke a system with a change in temperature and it absorbs energy; how much it absorbs per degree is the heat capacity . Leave that same system utterly alone in a heat bath and its energy still trembles — trading quanta with the bath, wandering above and below its mean. These look like two unrelated facts, one about response to a deliberate push, one about spontaneous jitter at rest. The central surprise of this article is that they are the same number: the heat capacity is exactly the variance of the equilibrium energy fluctuations, divided by . This identity, , is the simplest fluctuation–response (or fluctuation–dissipation) relation in physics — the prototype of a family that also links magnetic susceptibility to spin fluctuations and compressibility to density fluctuations. Its companion article, Energy Fluctuations in the Canonical Ensemble, derives the identity from ; here we read it the other way. Instead of asking "how big are the fluctuations?" we ask "what does the fluctuation tell us?" — and the answer is a response coefficient you can measure with a calorimeter, or extract from a simulation without ever touching the temperature. Two consequences fall out at once. Because a variance can never be negative, is guaranteed — thermodynamic stability is baked into the statistics, not assumed. And because energies of independent parts add, the relative energy fluctuation shrinks as , which is precisely why the fluctuating canonical energy behaves like the fixed microcanonical one for macroscopic matter. The article's owned result makes the "response tracks fluctuation" slogan quantitative on the two-level system, and every number here is python-verified.
- The heat capacity is a response: energy absorbed per degree of warming.
- In the canonical ensemble it equals a fluctuation: — the simplest fluctuation–dissipation relation.
- Because a variance is non-negative, this forces — thermodynamic stability guaranteed by statistics, not postulated.
- Relative energy fluctuations scale as , so canonical and microcanonical ensembles agree for macroscopic systems (ensemble equivalence).
- A diverging at a continuous phase transition is a diverging fluctuation — the gateway to critical phenomena.
- Key idea: the heat capacity you measure by warming a system is identically the size of the energy jitter the system undergoes at rest — response equals fluctuation, .
The constant-volume heat capacity, a response to changing temperature, is identically the fluctuation of the equilibrium energy: . Since a variance is non-negative, automatically (stability), and since the relative fluctuation vanishes as (ensemble equivalence). This is the prototype fluctuation–dissipation relation.
The physical picture
Picture a small copper block clamped in thermal contact with a large water bath. Its energy is not a fixed number — it drifts up and down as it swaps thermal quanta with the bath. Now ask two questions about that block. Response: if I nudge the bath temperature up by one kelvin, how much energy does the block soak up? That is . Fluctuation: if I just watch the block sit at fixed temperature, how widely does its energy wander around the mean? That is . The claim of this article is that these are one measurement in disguise. The reason is that both are controlled by the same feature of the energy spectrum. A block whose accessible states are densely spread around the current thermal energy can readily shuffle energy around: it fluctuates a lot, and it also absorbs a lot when warmed. A block with a big gap up to its next states is stiff both ways — it barely fluctuates, and it barely responds. Softness and jitter travel together. Formally, the Boltzmann weight is a moment-generating engine in the variable : one derivative of gives the mean energy, a second gives its variance, and since temperature enters only through , the temperature-derivative of the mean (the heat capacity) is forced to be the variance up to the fixed factor .
The most striking payoff is the two-level (Schottky) system: ions each with a ground state and one excited state a gap above. As you warm it from absolute zero, the heat capacity rises, reaches a peak, then falls again — a distinctive bump. Why a peak and not a monotone rise? The energy variance per ion actually climbs monotonically with and saturates at (both levels equally full). It is the factor in that turns that monotone fluctuation into a peaked response — the fluctuation is largest at high , but the response is weighted toward lower . The peak sits at (that is ), and experimentalists read the level gap straight off the peak temperature. This is how a two-level structure — nuclear spins, crystal-field doublets — is detected in a real material.
Finally, the smallness is why thermodynamics is possible at all. A kilogram of copper has atoms, so its relative energy fluctuation is about one part in — completely invisible on any macroscopic scale. Yet those microscopic, invisible fluctuations are exactly what fix the macroscopic you read off a calorimeter. The tiny jitter you can never see determines the response you always measure.
The core equations
The heat capacity at constant volume is the thermodynamic definition we start from — the response of the mean energy to a change in the bath temperature at fixed :
where: — constant-volume heat capacity (a response coefficient); — mean internal energy; — absolute temperature; held fixed. This is what a calorimeter measures: divide the heat supplied by the temperature rise. The mean energy and its variance are the first two -derivatives of (derived in full in Energy Fluctuations in the Canonical Ensemble). We recall them because they are the bridge from the spectrum to the response:
where: — canonical partition function; — variance of the energy in the canonical distribution; — Boltzmann constant. That generates the mean and the variance is the cumulant-generating structure that makes the whole identity inevitable. The central result of the article — the fluctuation–response relation — states that the response is the fluctuation , scaled by :
where: the numerator is a spontaneous equilibrium fluctuation, the left side is a driven thermal response, and is the exact conversion factor. Read left-to-right it is the fluctuation–dissipation theorem for energy; read right-to-left it is a recipe for computing from a variance you can sample in a simulation without differentiating anything. Because the right-hand side is a variance over , and both are non-negative, stability is immediate — a statistical guarantee, not a thermodynamic postulate:
where: follows because (a variance) and . A material with negative at fixed would need a negative variance — impossible. (Self-gravitating systems appear to violate this, but they are not in the canonical ensemble; see the warning below.) The same content appears as the concavity of the free energy in temperature, the route most useful for thermodynamic manipulations:
where: — Helmholtz free energy; — entropy. is equivalent to being concave — the temperature-stability condition of thermodynamics.
This is the load-bearing identity of the article: we prove that the thermodynamic response is exactly the statistical fluctuation divided by , starting only from the definition of and the partition-function expression for . The strategy is to differentiate the mean energy with respect to , convert the -derivative into a -derivative via the chain rule, recognize the second log-derivative of as the variance, and watch two minus signs conspire to make the result manifestly positive.
Step 1. Write the response as a -derivative. By definition . Since , the chain rule gives with , so . Why: temperature enters the canonical distribution only through , so every temperature-response is really a -response, carried across by the Jacobian .
Step 2. Differentiate the mean energy. With , we have . From the generating-function structure, , so . Why: the second derivative of is the variance — the quotient rule turns minus into .
Step 3. Combine the two minus signs. Substituting into Step 1, . Why: the Jacobian carries one minus sign and carries another; they cancel, leaving a manifestly positive ratio of a variance to a positive number.
Step 4. Read off stability. Because (it is a mean square) and , we conclude with no further assumption. Equivalently, means is concave — the thermodynamic stability condition emerges as a corollary of the positivity of a variance. Why: statistical mechanics does not need to postulate ; it inherits it from the unassailable fact that a variance cannot be negative. *Verified: the three routes , , and are shown to be symbolically identical on the two-level system in verify_aq-sm-heat-capacity-fluctuation-response.py.*
Here is the article's owned structural result, made quantitative on the two-level system. The goal is to explain the distinctive peak in the Schottky heat capacity: we compute the per-ion energy variance and the heat capacity as functions of temperature, show that the variance is monotone (it only grows and saturates), and prove that the peak in is entirely manufactured by the weighting in . This is "response tracks fluctuation" made exact — the two curves are the same object, reweighted.
Step 1. Set up the spectrum. Each ion has levels and , so and . The per-ion energy variance is . Why: differentiating once more with respect to , or directly forming with , gives the standard two-level variance.
Step 2. Show the variance is monotone in . Writing , the per-ion variance is . As a function of this decreases monotonically for ; as a function of temperature it therefore increases monotonically, rising from at and saturating at as . There is no interior peak in the fluctuation. Why: at high both levels are equally populated (), giving the maximal spread ; the fluctuation just grows toward that ceiling.
Step 3. Form the heat capacity and find its peak. Now . The extra suppresses the high- region and creates an interior maximum. Setting gives a transcendental equation whose root is , i.e. the peak sits at , with peak value . Why: multiplying a monotone-decreasing by a rising produces a single interior peak — the Schottky anomaly — located where the two tendencies balance.
Step 4. State the connection honestly. The fluctuation and the response are not peaked at the same temperature — the fluctuation has no finite- peak at all. What is exact is the pointwise identity at every temperature: the response is the fluctuation, seen through the lens of . The famous Schottky peak is the fingerprint of that reweighting, and its location delivers the level gap. Why: "response tracks fluctuation" is precise as an identity between functions, not as a coincidence of peak positions; the factor is a physical, not cosmetic, part of the relation. *Verified: , the variance saturation at , the peak at (peak value ), and the pointwise identity at several temperatures are all confirmed in the verify script.*
Limiting cases
The fluctuation–response relation across regimes:
| Case | Result | Meaning |
|---|---|---|
| Thermodynamic limit | and , so relative fluctuations vanish; canonical microcanonical. | |
| Classical ideal gas | Relative fluctuation , explicitly ; at . | |
| Two-level (Schottky) | Peaks at (); the level gap is read off the peak. | |
| Low (quantum solid) | Energy frozen into the ground state; fluctuations suppressed, — third law. | |
| Critical point | Diverging long-ranged energy fluctuations drive ; the picture breaks. |
Both halves need care. The relation does force — in the canonical ensemble. But it does not cap : at a continuous phase transition the correlation length diverges, energy fluctuations become long-ranged instead of the sum of independent small pieces, the central-limit scaling fails, and . A finite variance is not guaranteed. The other trap is the ensemble. This identity is specifically canonical — it needs a system that genuinely exchanges energy with a reservoir so that fluctuates. In the microcanonical ensemble energy is fixed, identically, yet : there is read from , not from a variance. Finally, systems with long-range interactions (self-gravitating stars, some nuclear matter) can show negative microcanonical heat capacity — no contradiction, because they are not described by a canonical distribution with a normalizable , so the positivity argument simply does not apply. Match the ensemble to the physics before quoting the relation.
Worked examples
1 · Reading a level gap off a Schottky peak (a real crystal-field measurement)
A dilute paramagnetic salt has a doublet of ions with a crystal-field gap such that . Where (in temperature) does the molar heat capacity peak, and how large is the peak? One mole of ions.
Step 1. Locate the peak in . The two-level heat capacity (per mole, ) peaks where , whose numerical root is .
Step 2. Convert to a temperature. Since , the peak is at .
Step 3. Compute the peak height. At , the factor , so .
Step 4. The physics. The heat capacity bump at is a direct fingerprint of the level gap — the very fact that a two-level structure exists is what produces a peaked (rather than monotone) , and its location fixes . Below the peak the gap freezes out excitations (); above it both levels saturate (); the bump in between is where the response, weighted by , is maximal.
2 · How invisible are the energy fluctuations of a mole of gas? (exam level)
Take one mole of monatomic ideal gas at . Compute the RMS energy fluctuation and express it as a fraction of the internal energy .
Step 1. Internal energy. .
Step 2. Variance from the fluctuation–response relation. With , . Numerically , so .
Step 3. The fraction. , which equals exactly.
Step 4. The lesson. The energy of a mole of gas is defined to about one part in — a spread of a few nanojoules on top of kilojoules of energy — so the fluctuating canonical energy is, for all macroscopic purposes, as sharp as the fixed microcanonical energy. This smallness, read straight off the heat capacity through the fluctuation relation, is the quantitative content of ensemble equivalence: it is why we may use the mathematically convenient canonical ensemble to compute the properties of systems that are, physically, at fixed energy.
The fluctuation–dissipation theorem is the general statement that the way a system responds to a small external perturbation is completely determined by the spontaneous fluctuations it undergoes in thermal equilibrium — no driving required. The heat-capacity relation is its simplest and oldest instance: Einstein wrote the energy-fluctuation formula in 1904, and the same structure appeared in Johnson and Nyquist's 1928 analysis of thermal ("Johnson–Nyquist") noise in resistors, where the voltage fluctuations across a resistor at temperature fix its dissipative resistance. The general theorem was proved by Herbert Callen and Theodore Welton in 1951, and cast in its modern linear-response form by Ryogo Kubo in 1957, linking any response function to an equilibrium time-correlation of the conjugate fluctuation. The principle is one of the deepest unifying ideas in statistical physics: susceptibility is spin fluctuation, compressibility is density fluctuation, mobility is velocity fluctuation (the Einstein relation), and heat capacity is energy fluctuation. It is why we can extract macroscopic transport and response coefficients from simulations that merely watch a system fluctuate at equilibrium, and why the same that measures thermal jitter also measures the strength of dissipation.
Where this lives today
The fluctuation–response relation is the daily workhorse of computational statistical mechanics. In Monte Carlo and molecular-dynamics simulations, one almost never obtains the heat capacity by numerically differentiating — that amplifies statistical noise ruinously. Instead is read directly from the measured energy variance in a single run at fixed : . The same trick gives the magnetic susceptibility from magnetization variance and the compressibility from particle-number variance. Locating a phase transition then becomes a matter of watching for a variance peak: the specific-heat divergence of the 2D Ising model, the -anomaly of liquid helium, and the melting of model solids are all found this way, and finite-size scaling of the variance peak yields the critical exponent and the transition temperature . Beyond equilibrium thermodynamics, the same principle powers modern measurement. Passive microrheology infers the viscoelastic response of a cell or polymer network purely from the thermal jiggling of an embedded bead — the fluctuation spectrum, via the fluctuation–dissipation theorem, is the response spectrum. In electronics, Johnson–Nyquist noise sets the temperature-dependent noise floor of every resistor, and is used in reverse as a primary thermometer (Johnson-noise thermometry) traceable to itself: fluctuations and response are two faces of the single number .
Check yourself
Going further
References. Pathria & Beale, Statistical Mechanics, 3rd ed., §3.6 · Kardar, Statistical Physics of Particles, Ch. 4 · Reif, Fundamentals of Statistical and Thermal Physics, §6.5 · Sethna, Statistical Mechanics: Entropy, Order Parameters, and Complexity, Ch. 6 · Landau & Lifshitz, Statistical Physics Part 1, §112 · Callen & Welton, Phys. Rev. 83, 34 (1951) · Kubo, J. Phys. Soc. Japan 12, 570 (1957).
Provenance. The relation follows from and (Pathria §3.6; Kardar Ch. 4; Reif §6.5). A verifier should reproduce: the three equivalent routes to (definition, variance, ); the two-level Schottky with peak at (peak value ), and the monotone variance saturating at ; the ideal-gas , variance , and relative fluctuation . Numerical instances — the crystal-field peak at and ; the mole-of-gas RMS fluctuation and fraction — are recomputed in verify_aq-sm-heat-capacity-fluctuation-response.py. Callen–Welton 1951, Kubo 1957, Johnson–Nyquist 1928 dates web-verified. , , (CODATA/SI).
Builds on: Canonical Ensemble · Canonical Partition Function · Boltzmann Factor · Thermodynamic Quantities from the Partition Function · Energy Fluctuations in the Canonical Ensemble. Leads to: Grand Canonical Ensemble · Grand Potential · Helmholtz Free Energy from the Partition Function · Particle-Number Fluctuations.
If C_V is just a fluctuation, why can I measure it with a calorimeter without ever seeing any fluctuations?
Because the two are the same number, and the calorimeter is measuring the aggregate effect of the microscopic fluctuations. When you supply heat and watch the temperature rise , you are probing exactly how easily the system's energy distribution shifts — and how easily it shifts is set by how wide it already is. A wide (large-variance) energy distribution moves a lot per unit temperature change (large ); a narrow one barely moves (small ). You never see the individual fluctuations because their relative size is , far below any calorimeter's resolution. But their collective statistical width is precisely the quantity , and tells you that measuring the response and measuring the fluctuation are two experiments returning one answer.
The energy variance of the two-level system only grows with temperature, yet C_V peaks. How can the response peak if the fluctuation doesn't?
This is the subtle and important point. The fluctuation and the response are linked by — an identity at every temperature, not a statement that they peak together. The per-ion variance (with ) rises monotonically with and saturates at once both levels are equally populated. What makes peaked is the explicit factor: it suppresses the high-temperature region where the variance is largest, and the product (variance-shape) has a single interior maximum at . So the response is the fluctuation reweighted toward lower temperature. The Schottky peak is the fingerprint of that reweighting — and it is physically real, because the is a genuine part of the fluctuation–response relation, not an artifact.
Does C_V ≥ 0 really follow with no assumptions, and does it always hold?
In the canonical ensemble it follows with essentially no assumptions: is a variance divided by a positive number, and a variance is a mean of a square, hence non-negative. So any system describable by a canonical distribution with a well-defined partition function has — thermodynamic stability is a theorem, not a postulate. Where it "fails" is where the premise fails. Systems with long-range interactions — self-gravitating star clusters, some nuclear and cluster systems — can exhibit negative microcanonical heat capacity, but they are not in a canonical state (their does not converge / the ensembles are inequivalent), so the argument simply does not apply to them. Within its proper domain — short-range interactions, a normalizable — is airtight.
How is this the same relation as magnetic susceptibility being spin fluctuations?
It is the same structure with a different conjugate pair. In every case you differentiate the partition function twice with respect to a control parameter, and the second derivative of produces a variance. For energy, the control is (temperature) and the variance is energy fluctuations, giving . For magnetization, the control is the magnetic field : — susceptibility equals magnetization fluctuations. For particle number, the control is the chemical potential : the isothermal compressibility is set by . All are instances of the fluctuation–dissipation theorem: a linear response coefficient equals an equilibrium fluctuation of the conjugate observable, divided by (times for the energy case). The recurring theme is that the same Boltzmann weight that fluctuates is the one you differentiate to get a response.
Why is C_V a good detector of phase transitions?
Because , so a peak or divergence in the heat capacity is a direct readout of anomalously large energy fluctuations. Away from a transition the energy is a sum of many nearly-independent local pieces, its variance grows only as , and is smooth and finite. At a continuous transition the correlation length diverges: distant regions become correlated, energy fluctuations turn long-ranged and super-extensive, the scaling breaks down, and — hence — diverges as . Watching is watching the fluctuation amplitude, which is why the specific heat is among the first observables computed when hunting a transition — experimentally as a -shaped anomaly, in simulation as a variance peak whose finite-size scaling gives .
Is the microcanonical heat capacity the same as the canonical one, given they compute it so differently?
In the thermodynamic limit, yes — this is ensemble equivalence, and the fluctuation relation is exactly why. Canonically, energy fluctuates and ; microcanonically, energy is fixed and comes instead from . Genuinely different objects, yet for a large short-range system they give the same , because the canonical energy distribution is a sharp Gaussian of relative width centered on the microcanonical energy. The two disagree only where fluctuations are not small — near critical points or for long-range interactions — exactly where the ensembles become inequivalent.