Importance of eigenvalues
I know how to find eigenvalues and eigenvectors. But I don't know what to do with that.
What is their use? Can anyone explain it to me?
One practical application that comes to my mind is principal component analysis (PCA). It is extensively used in pattern recognition, for eg, face recognition. The covariance matrix of the observed data is used for this purpose. Let $C$ be our $N \times N$ covariance matrix, then \begin{align} C=\sum_{i}^{N}\lambda_iv_iv_i^H \end{align} is the eigen decomposition. Here $\lambda_i$ are the eigenvalues and $v_i$ are the eigenvectors. For a covariances matrix, $\lambda_i$ are always non-negative. Let us say $\lambda_1,\lambda_2,...\lambda_N$ are in the decreasing order. Thus, in that sense, $\lambda_1v_1v_1^H$ is the principal component in the above summation ahd hence plays a important role in determining the observed data. This interpretation will be more clear, once you delve into the application. My area is signal processing, and I see them Left, Right and Center throughout on my way. Happy Learning!!
The reason why eigenvalues are so important in mathematics are too many. Here is a very short and extremely incomplete list of the main applications I encountered in my path and that are coming now in mind to me:
Theoretical applications:
- The eigenvalues of the Jacobian of a vector field at a given point determines the local geometry of the flow and the stability of that point;
- An iterative method $\mathbf{y}_{k+1} = \mathbf{A} \mathbf{y}_k$ is convergent if the spectral radius $\rho(\mathbf{A})$ (the maximum absolute value of the eigenvalues of $\mathbf{A}$) is < 1.
Practical applications:
- The order in which your search results appear in Google is determined by computing an eigenvector (See PageRank).
- You can automatically recognize faces by computing eigenvectors of images (See Eigenfaces).
And there are also other type of eigenvalue problems, more difficult to solve, e.g. Generalized and Nonlinear Eigenvalue Problems, with even more interesting applications.
Hope I gave you some interesting inputs :)
Construction of suspension bridges... Each such bridge has a "natural frequency" and when the physical system that models the bridge is linearized, this frequency corresponds to the eigenvalue of smallest magnitude. Engineers want that this frequency be reasonably far away from any frequencies that occur naturally, such as local wind conditions. When this fails to be the case, i.e. when the natural frequency of the bridge corresponds to wave frequencies induced by the environment, the frequencies become (nearly) additive, as opposed to the desired state of the frequences (nearly) canceling out. The result is, for example, what occurred in the 1940 collapse of the Tacoma Narrows Bridge.
As far as I'm concerned, the biggest deal about eigen-anything is that there are many canonical cases where the eigen-vectors/functions/states form a complete basis for the space that you're working in. For instance, in the case of Quantum Mechanics, the "eigenvectors" of operators which corresponds to observable quantities, like energy, position, etc., form a complete basis for the space of all possible states of the system that you're analysing. That is, any state you want can be written as a linear combination of these "eigenvectors". Naturally, this makes solving problems so much easier, as now all we need to do is to find the coefficients in this linear combination (for which there is a neat formula).
Many mathematics techniques such as Fourier Analysis work on the same principle. There is also a technique for solving certain types of linear ODEs which exploits the fact that the "eigenvectors" of certain things for a complete basis (Sturm-Liouville Theory), basically what you do is to find the "eigenvectors" of the differential equation (strictly, we want the eigenfunctions of the differential operator, e.g. $e^{kx}$ is an eigenfunction of $\frac{\mathrm{d}}{\mathrm{d}x}$ with eigenvalue $k$) and then we can write the solution in terms of these "eigenvectors" simply by calculating the coefficients in the linear combination (there is a formula for this too!).