Linear Algebra and Its Applications · Problem 6.4.15

Computations with Matrices — Gilbert Strang

Mathematics · minimax-principle

Problem

Which particular subspace S2S_2 in Problem 13 gives the minimum value λ2\lambda_2? In other words, over which S2S_2 is the maximum of R(x)R(x) equal to λ2\lambda_2?
Intuitive explanation

The key insight is that λ2\lambda_2 is the second eigenvalue of your matrix, and the subspace S2S_2 that achieves it is the eigenspace (or any subspace containing the corresponding eigenvector). The Rayleigh quotient R(x)R(x) reaches its maximum value λ2\lambda_2 precisely when xx lies in the eigenspace of λ2\lambda_2—this is the variational characterization of eigenvalues. So you're looking for which eigenspace minimizes the maximum of R(x)R(x) over all unit vectors in that space.

Intuitive explanation

The key insight is that λ2\lambda_2 is the second eigenvalue of your matrix, and the subspace S2S_2 that achieves it is the eigenspace (or any subspace containing the corresponding eigenvector). The Rayleigh quotient R(x)R(x) reaches its maximum value λ2\lambda_2 precisely when xx lies in the eigenspace of λ2\lambda_2—this is the variational characterization of eigenvalues. So you're looking for which eigenspace minimizes the maximum of R(x)R(x) over all unit vectors in that space.

Browse the problem library