Linear Algebra and Its Applications · Problem 7.4.16
Linear Programming and Game Theory — Gilbert Strang
Mathematics · arnoldi-lanczos-method
Problem
When , the Arnoldi-Lanczos method finds orthonormal 's so that (with ). Multiply by to find a formula for . The equation says that where is a \underline{\hspace{1cm}} matrix.Intuitive explanation
When is symmetric, the Lanczos iteration produces a tridiagonal structure because symmetry kills off the upper Hessenberg terms. Multiplying the recurrence by isolates by exploiting orthonormality: the cross terms vanish, leaving . The matrix in captures this tridiagonal pattern—it's the compressed representation of in the orthonormal basis, with the 's as off-diagonals and 's on the main diagonal.
Intuitive explanation
When is symmetric, the Lanczos iteration produces a tridiagonal structure because symmetry kills off the upper Hessenberg terms. Multiplying the recurrence by isolates by exploiting orthonormality: the cross terms vanish, leaving . The matrix in captures this tridiagonal pattern—it's the compressed representation of in the orthonormal basis, with the 's as off-diagonals and 's on the main diagonal.