What does a symmetric matrix transformation do, geometrically?

A real symmetric matrix is always orthogonally diagonalizable, meaning that there's a basis for $\mathbb R^n$ consisting of mutually perpendicular eigenvectors of the matrix. Thus you can understand multiplying a column vector by a symmetric matrix geometrically as:

  • Express the input vector in a different rectangular coordinate system that depends on the matrix.
  • Multiply each coordinate by some constant that depends on which axis in the new coordinate system it corresponds to -- that is, stretch, shrink or flip each axis independently of each other.
  • Express the result back in the original coordinate system.