Linear Algebra and Its Applications · Problem 3.1.30

Orthogonality — Gilbert Strang

Mathematics · orthogonal-vectors-subspaces

Problem

If AxAx is in the nullspace of ATA^T then Ax=0Ax = 0. Reason: AxAx is also in the \_\_\_\_ of AA and the spaces are \_\_\_\_. Conclusion: ATAA^TA has the same nullspace as AA.
Intuitive explanation

The key insight is recognizing that AxAx lives in the column space of AA, and the column space and left nullspace (nullspace of ATA^T) are orthogonal complements. If a vector belongs to both orthogonal subspaces simultaneously, it must be the zero vector. This orthogonality relationship is what forces Ax=0Ax = 0 and ultimately explains why ATAA^TA and AA share the same nullspace.

Intuitive explanation

The key insight is recognizing that AxAx lives in the column space of AA, and the column space and left nullspace (nullspace of ATA^T) are orthogonal complements. If a vector belongs to both orthogonal subspaces simultaneously, it must be the zero vector. This orthogonality relationship is what forces Ax=0Ax = 0 and ultimately explains why ATAA^TA and AA share the same nullspace.

Browse the problem library