In mathematics, an eigenvalue perturbation problem is that of finding the eigenvectors and eigenvalues of a system
that is perturbed from one with known eigenvectors and eigenvalues
. This is useful for studying how sensitive the original system's eigenvectors and eigenvalues
are to changes in the system. This type of analysis was popularized by Lord Rayleigh, in his investigation of harmonic vibrations of a string perturbed by small inhomogeneities.[1]
The derivations in this article are essentially self-contained and can be found in many texts on numerical linear algebra or numerical functional analysis. This article is focused on the case of the perturbation of a simple eigenvalue (see in multiplicity of eigenvalues).
Why generalized eigenvalues?
In the entry applications of eigenvalues and eigenvectors we find numerous scientific fields in which eigenvalues are used to obtain solutions. Generalized eigenvalue problems are less widespread but are a key in the study of vibrations. They are useful when we use the Galerkin method or Rayleigh-Ritz method to find approximate solutions of partial differential equations modeling vibrations of structures such as strings and plates; the paper of Courant (1943) [2] is fundamental. The Finite element method is a widespread particular case.
In classical mechanics, we may find generalized eigenvalues when we look for vibrations of multiple degrees of freedom systems close to equilibrium; the kinetic energy provides the mass matrix
, the potential strain energy provides the rigidity matrix
. To get details, for example see the first section of this article of Weinstein (1941, in French) [3]
With both methods, we obtain a system of differential equations or Matrix differential equation
with the mass matrix
, the damping matrix
and the rigidity matrix
. If we neglect the damping effect, we use
, we can look for a solution of the following form
; we obtain that
and
are solution of the generalized eigenvalue problem
Setting of perturbation for a generalized eigenvalue problem
Suppose we have solutions to the generalized eigenvalue problem,
![{\displaystyle \mathbf {K} _{0}\mathbf {x} _{0i}=\lambda _{0i}\mathbf {M} _{0}\mathbf {x} _{0i}.\qquad (0)}](https://wikimedia.org/api/rest_v1/media/math/render/svg/fb178a0e676b94a6e978c8b79917813ca1e48e59)
where
and
are matrices. That is, we know the eigenvalues λ0i and eigenvectors x0i for i = 1, ..., N. It is also required that the eigenvalues are distinct.
Now suppose we want to change the matrices by a small amount. That is, we want to find the eigenvalues and eigenvectors of
![{\displaystyle \mathbf {K} \mathbf {x} _{i}=\lambda _{i}\mathbf {M} \mathbf {x} _{i}\qquad (1)}](https://wikimedia.org/api/rest_v1/media/math/render/svg/2b8bd6cec5c8c6eef3b8dd1a798f81ca14ced26b)
where
![{\displaystyle {\begin{aligned}\mathbf {K} &=\mathbf {K} _{0}+\delta \mathbf {K} \\\mathbf {M} &=\mathbf {M} _{0}+\delta \mathbf {M} \end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/edb8006505101fdbb35abb97fc019acba4276a2d)
with the perturbations
and
much smaller than
and
respectively. Then we expect the new eigenvalues and eigenvectors to be similar to the original, plus small perturbations:
![{\displaystyle {\begin{aligned}\lambda _{i}&=\lambda _{0i}+\delta \lambda _{i}\\\mathbf {x} _{i}&=\mathbf {x} _{0i}+\delta \mathbf {x} _{i}\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/2340a653c23f48015c5c21d5e9d1c595bc6c8c29)
Steps
We assume that the matrices are symmetric and positive definite, and assume we have scaled the eigenvectors such that
![{\displaystyle \mathbf {x} _{0j}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}=\delta _{ij},\quad }](https://wikimedia.org/api/rest_v1/media/math/render/svg/ff36a042e87399b77ef390af47c10736f5bd8f14)
![{\displaystyle \mathbf {x} _{i}^{T}\mathbf {M} \mathbf {x} _{j}=\delta _{ij}\qquad (2)}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3d359f3c6aeb56b206676ec7eb3443aee84c36c3)
where δij is the Kronecker delta. Now we want to solve the equation
![{\displaystyle \mathbf {K} \mathbf {x} _{i}-\lambda _{i}\mathbf {M} \mathbf {x} _{i}=0.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/d9188514ffa636eeddb764bfdb858522d938d0f6)
In this article we restrict the study to first order perturbation.
First order expansion of the equation
Substituting in (1), we get
![{\displaystyle (\mathbf {K} _{0}+\delta \mathbf {K} )(\mathbf {x} _{0i}+\delta \mathbf {x} _{i})=\left(\lambda _{0i}+\delta \lambda _{i}\right)\left(\mathbf {M} _{0}+\delta \mathbf {M} \right)\left(\mathbf {x} _{0i}+\delta \mathbf {x} _{i}\right),}](https://wikimedia.org/api/rest_v1/media/math/render/svg/1ef6b034bfb2ce0c834c83f9bdff3e269bc8b180)
which expands to
![{\displaystyle {\begin{aligned}\mathbf {K} _{0}\mathbf {x} _{0i}&+\delta \mathbf {K} \mathbf {x} _{0i}+\mathbf {K} _{0}\delta \mathbf {x} _{i}+\delta \mathbf {K} \delta \mathbf {x} _{i}=\\[6pt]&\lambda _{0i}\mathbf {M} _{0}\mathbf {x} _{0i}+\lambda _{0i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}+\\&\quad \lambda _{0i}\delta \mathbf {M} \delta \mathbf {x} _{i}+\delta \lambda _{i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\delta \lambda _{i}\delta \mathbf {M} \delta \mathbf {x} _{i}.\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/caa6adcd57e20edd87e8212fd962774424a7f862)
Canceling from (0) (
) leaves
![{\displaystyle {\begin{aligned}\delta \mathbf {K} \mathbf {x} _{0i}+&\mathbf {K} _{0}\delta \mathbf {x} _{i}+\delta \mathbf {K} \delta \mathbf {x} _{i}=\lambda _{0i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}+\\&\lambda _{0i}\delta \mathbf {M} \delta \mathbf {x} _{i}+\delta \lambda _{i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\delta \lambda _{i}\delta \mathbf {M} \delta \mathbf {x} _{i}.\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/04a565685738fc243885c72b58644b9343d831a8)
Removing the higher-order terms, this simplifies to
![{\displaystyle \mathbf {K} _{0}\delta \mathbf {x} _{i}+\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\delta \mathbf {M} \mathrm {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}.\qquad (3)}](https://wikimedia.org/api/rest_v1/media/math/render/svg/9772ebb8db73a2e1459b2d9a9af4fcff6784dfc9)
- In other words,
no longer denotes the exact variation of the eigenvalue but its first order approximation.
As the matrix is symmetric, the unperturbed eigenvectors are
orthogonal and so we use them as a basis for the perturbed eigenvectors. That is, we want to construct
with
,
where the εij are small constants that are to be determined.
In the same way, substituting in (2), and removing higher order terms, we get
The derivation can go on with two forks.
First fork: get first eigenvalue perturbation
Eigenvalue perturbation
- We start with (3)
![{\displaystyle \quad \mathbf {K} _{0}\delta \mathbf {x} _{i}+\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\delta \mathbf {M} \mathrm {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i};}](https://wikimedia.org/api/rest_v1/media/math/render/svg/51bffae55c081005ce368edf1277f1fe4a0cb32c)
we left multiply with
and use (2) as well as its first order variation (5); we get
![{\displaystyle \mathbf {x} _{0i}^{T}\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0i}^{T}\delta \mathbf {M} \mathrm {x} _{0i}+\delta \lambda _{i}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/6dce1b98191e3ec376aff157d0df361265f827e3)
or
![{\displaystyle \delta \lambda _{i}=\mathbf {x} _{0i}^{T}\delta \mathbf {K} \mathbf {x} _{0i}-\lambda _{0i}\mathbf {x} _{0i}^{T}\delta \mathbf {M} \mathrm {x} _{0i}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3d7088b27d649bbd287c14e978d1f32ee070898e)
We notice that it is the first order perturbation of the generalized Rayleigh quotient with fixed
:
Moreover, for
, the formula
should be compared with Bauer-Fike theorem which provides a bound for eigenvalue perturbation.
Eigenvector perturbation
We left multiply (3) with
for
and get
![{\displaystyle \mathbf {x} _{0j}^{T}\mathbf {K} _{0}\delta \mathbf {x} _{i}+\mathbf {x} _{0j}^{T}\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\mathbf {x} _{0j}^{T}\delta \mathbf {M} \mathrm {x} _{0i}+\delta \lambda _{i}\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/ad519df87fe95b775310f27f78105b07cc23f8b3)
We use
for
.
![{\displaystyle \lambda _{0j}\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\mathbf {x} _{0j}^{T}\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\lambda _{0i}\mathbf {x} _{0j}^{T}\delta \mathbf {M} \mathrm {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/acbee2d014b0f524a7fdf15520b6f27e1abe083f)
or
![{\displaystyle (\lambda _{0j}-\lambda _{0i})\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}+\mathbf {x} _{0j}^{T}\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0j}^{T}\delta \mathbf {M} \mathrm {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3df5b4f48df8103d358b6d44818fbb0c681de214)
As the eigenvalues are assumed to be simple, for
![{\displaystyle \epsilon _{ij}=\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}={\frac {-\mathbf {x} _{0j}^{T}\delta \mathbf {K} \mathbf {x} _{0i}+\lambda _{0i}\mathbf {x} _{0j}^{T}\delta \mathbf {M} \mathrm {x} _{0i}}{(\lambda _{0j}-\lambda _{0i})}},i=1,\dots N;j=1,\dots N;j\neq i.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/d0c0f06cdc1df2dd89056863a05e1acf6b2c47e5)
Moreover (5) (the first order variation of (2) ) yields
We have obtained all the components of
.
Second fork: Straightforward manipulations
Substituting (4) into (3) and rearranging gives
![{\displaystyle {\begin{aligned}\mathbf {K} _{0}\sum _{j=1}^{N}\varepsilon _{ij}\mathbf {x} _{0j}+\delta \mathbf {K} \mathbf {x} _{0i}&=\lambda _{0i}\mathbf {M} _{0}\sum _{j=1}^{N}\varepsilon _{ij}\mathbf {x} _{0j}+\lambda _{0i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}&&(5)\\\sum _{j=1}^{N}\varepsilon _{ij}\mathbf {K} _{0}\mathbf {x} _{0j}+\delta \mathbf {K} \mathbf {x} _{0i}&=\lambda _{0i}\mathbf {M} _{0}\sum _{j=1}^{N}\varepsilon _{ij}\mathbf {x} _{0j}+\lambda _{0i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}&&\\({\text{applying }}\mathbf {K} _{0}{\text{ to the sum}})\\\sum _{j=1}^{N}\varepsilon _{ij}\lambda _{0j}\mathbf {M} _{0}\mathbf {x} _{0j}+\delta \mathbf {K} \mathbf {x} _{0i}&=\lambda _{0i}\mathbf {M} _{0}\sum _{j=1}^{N}\varepsilon _{ij}\mathbf {x} _{0j}+\lambda _{0i}\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {M} _{0}\mathbf {x} _{0i}&&({\text{using Eq. }}(1))\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/e03afe06ce8a4a8d585d5e689964115a80e15751)
Because the eigenvectors are M0-orthogonal when M0 is positive definite, we can remove the summations by left-multiplying by
:
![{\displaystyle \mathbf {x} _{0i}^{\top }\varepsilon _{ii}\lambda _{0i}\mathbf {M} _{0}\mathbf {x} _{0i}+\mathbf {x} _{0i}^{\top }\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\varepsilon _{ii}\mathbf {x} _{0i}+\lambda _{0i}\mathbf {x} _{0i}^{\top }\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/1f96433b2ce2eec6a2bd04907aae60313b7e46a4)
By use of equation (1) again:
![{\displaystyle \mathbf {x} _{0i}^{\top }\mathbf {K} _{0}\varepsilon _{ii}\mathbf {x} _{0i}+\mathbf {x} _{0i}^{\top }\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\varepsilon _{ii}\mathbf {x} _{0i}+\lambda _{0i}\mathbf {x} _{0i}^{\top }\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}.\qquad (6)}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3bd834b0728daf9b4295edbd5284b3c4552dbe78)
The two terms containing εii are equal because left-multiplying (1) by
gives
![{\displaystyle \mathbf {x} _{0i}^{\top }\mathbf {K} _{0}\mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3e12c4844738c730b7c6a2ea071417fb635c98b0)
Canceling those terms in (6) leaves
![{\displaystyle \mathbf {x} _{0i}^{\top }\delta \mathbf {K} \mathbf {x} _{0i}=\lambda _{0i}\mathbf {x} _{0i}^{\top }\delta \mathbf {M} \mathbf {x} _{0i}+\delta \lambda _{i}\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/dda8fb5e060acecde93b3a8f5095788464653b2f)
Rearranging gives
![{\displaystyle \delta \lambda _{i}={\frac {\mathbf {x} _{0i}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}}{\mathbf {x} _{0i}^{\top }\mathbf {M} _{0}\mathbf {x} _{0i}}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/4dd67b003a41011f1479563d3141f73937e19704)
But by (2), this denominator is equal to 1. Thus
![{\displaystyle \delta \lambda _{i}=\mathbf {x} _{0i}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/f26b7af9c5bef180362c2ef2b568564c81ba3125)
Then, as
for
(assumption simple eigenvalues) by left-multiplying equation (5) by
:
![{\displaystyle \varepsilon _{ik}={\frac {\mathbf {x} _{0k}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}}{\lambda _{0i}-\lambda _{0k}}},\qquad i\neq k.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/509d739128b3ea11c98b98bbfbdcf0729e00337b)
Or by changing the name of the indices:
![{\displaystyle \varepsilon _{ij}={\frac {\mathbf {x} _{0j}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}}{\lambda _{0i}-\lambda _{0j}}},\qquad i\neq j.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/c44392bed72552c8fb02fb9211b6f03143ed7032)
To find εii, use the fact that:
![{\displaystyle \mathbf {x} _{i}^{\top }\mathbf {M} \mathbf {x} _{i}=1}](https://wikimedia.org/api/rest_v1/media/math/render/svg/71b5a3d5187d88c532b6b953729743b346178db0)
implies:
![{\displaystyle \varepsilon _{ii}=-{\tfrac {1}{2}}\mathbf {x} _{0i}^{\top }\delta \mathbf {M} \mathbf {x} _{0i}.}](https://wikimedia.org/api/rest_v1/media/math/render/svg/6b60cf1f2a16f6d1eda672ebf2a9ec84e8938009)
Summary of the first order perturbation result
In the case where all the matrices are Hermitian positive definite and all the eigenvalues are distinct,
![{\displaystyle {\begin{aligned}\lambda _{i}&=\lambda _{0i}+\mathbf {x} _{0i}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}\\\mathbf {x} _{i}&=\mathbf {x} _{0i}\left(1-{\tfrac {1}{2}}\mathbf {x} _{0i}^{\top }\delta \mathbf {M} \mathbf {x} _{0i}\right)+\sum _{j=1 \atop j\neq i}^{N}{\frac {\mathbf {x} _{0j}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}}{\lambda _{0i}-\lambda _{0j}}}\mathbf {x} _{0j}\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/05cccfc0e4a0d24e57495029c25686e45eff29df)
for infinitesimal
and
(the higher order terms in (3) being neglected).
So far, we have not proved that these higher order terms may be neglected. This point may be derived using the implicit function theorem; in next section, we summarize the use of this theorem in order to obtain a first order expansion.
Theoretical derivation
Perturbation of an implicit function.
In the next paragraph, we shall use the Implicit function theorem (Statement of the theorem ); we notice that for a continuously differentiable function
, with an invertible Jacobian matrix
, from a point
solution of
, we get solutions of
with
close to
in the form
where
is a continuously differentiable function ; moreover the Jacobian marix of
is provided by the linear system
.
As soon as the hypothesis of the theorem is satisfied, the Jacobian matrix of
may be computed with a first order expansion of
, we get
; as
, it is equivalent to equation
.
Eigenvalue perturbation: a theoretical basis.
We use the previous paragraph (Perturbation of an implicit function) with somewhat different notations suited to eigenvalue perturbation; we introduce
, with
with
. In order to use the Implicit function theorem, we study the invertibility of the Jacobian
with
. Indeed, the solution of
![{\displaystyle J_{{\tilde {f}};\lambda _{0i},x_{0i}}(K,M;\lambda _{0i},x_{0i})(\delta \lambda _{i},\delta x_{i})=}](https://wikimedia.org/api/rest_v1/media/math/render/svg/c1e706d22955dd945b205a190832924d0dcce660)
may be derived with computations similar to the derivation of the expansion.
![{\displaystyle \delta \lambda _{i}=-x_{0i}^{T}y,\;{\text{ and }}(\lambda _{0i}-\lambda _{0j})x_{0j}^{T}M\delta x_{i}=x_{j}^{T}y,j=1,\dots ,n,j\neq i\;;}](https://wikimedia.org/api/rest_v1/media/math/render/svg/59f884de4cf25819dac9ffc8fd490bab03433c91)
When
is a simple eigenvalue, as the eigenvectors
form an orthonormal basis, for any right-hand side, we have obtained one solution therefore, the Jacobian is invertible.
The implicit function theorem provides a continuously differentiable function
hence the expansion with little o notation:
. with
![{\displaystyle \delta x_{i}=\mathbf {x} _{0j}^{T}\mathbf {M} _{0}\delta \mathbf {x} _{i}\mathbf {x} _{0j}{\text{ with}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/3fcef1033d7f453c84e217e1f62713210d92e128)
This is the first order expansion of the perturbed eigenvalues and eigenvectors. which is proved.
Results of sensitivity analysis with respect to the entries of the matrices
The results
This means it is possible to efficiently do a sensitivity analysis on λi as a function of changes in the entries of the matrices. (Recall that the matrices are symmetric and so changing Kkℓ will also change Kℓk, hence the (2 − δkℓ) term.)
![{\displaystyle {\begin{aligned}{\frac {\partial \lambda _{i}}{\partial \mathbf {K} _{(k\ell )}}}&={\frac {\partial }{\partial \mathbf {K} _{(k\ell )}}}\left(\lambda _{0i}+\mathbf {x} _{0i}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}\right)=x_{0i(k)}x_{0i(\ell )}\left(2-\delta _{k\ell }\right)\\{\frac {\partial \lambda _{i}}{\partial \mathbf {M} _{(k\ell )}}}&={\frac {\partial }{\partial \mathbf {M} _{(k\ell )}}}\left(\lambda _{0i}+\mathbf {x} _{0i}^{\top }\left(\delta \mathbf {K} -\lambda _{0i}\delta \mathbf {M} \right)\mathbf {x} _{0i}\right)=-\lambda _{i}x_{0i(k)}x_{0i(\ell )}\left(2-\delta _{k\ell }\right).\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/2af42097a75fcc11715d1b835dd174595142e57f)
Similarly
![{\displaystyle {\begin{aligned}{\frac {\partial \mathbf {x} _{i}}{\partial \mathbf {K} _{(k\ell )}}}&=\sum _{j=1 \atop j\neq i}^{N}{\frac {x_{0j(k)}x_{0i(\ell )}\left(2-\delta _{k\ell }\right)}{\lambda _{0i}-\lambda _{0j}}}\mathbf {x} _{0j}\\{\frac {\partial \mathbf {x} _{i}}{\partial \mathbf {M} _{(k\ell )}}}&=-\mathbf {x} _{0i}{\frac {x_{0i(k)}x_{0i(\ell )}}{2}}(2-\delta _{k\ell })-\sum _{j=1 \atop j\neq i}^{N}{\frac {\lambda _{0i}x_{0j(k)}x_{0i(\ell )}}{\lambda _{0i}-\lambda _{0j}}}\mathbf {x} _{0j}\left(2-\delta _{k\ell }\right).\end{aligned}}}](https://wikimedia.org/api/rest_v1/media/math/render/svg/6f89ac17a5f920684d6603e0b2cb26235d0c478d)
Eigenvalue sensitivity, a small example
A simple case is
; however you can compute eigenvalues and eigenvectors with the help of online tools such as [1] (see introduction in Wikipedia WIMS) or using Sage SageMath. You get the smallest eigenvalue
and an explicit computation
; more over, an associated eigenvector is
; it is not an unitary vector; so
; we get
and
; hence
; for this example , we have checked that
or
.
Existence of eigenvectors
Note that in the above example we assumed that both the unperturbed and the perturbed systems involved symmetric matrices, which guaranteed the existence of
linearly independent eigenvectors. An eigenvalue problem involving non-symmetric matrices is not guaranteed to have
linearly independent eigenvectors, though a sufficient condition is that
and
be simultaneously diagonalizable.
The case of repeated eigenvalues
A technical report of Rellich [4] for perturbation of eigenvalue problems provides several examples. The elementary examples are in chapter 2. The report may be downloaded from archive.org. We draw an example in which the eigenvectors have a nasty behavior.
Example 1
Consider the following matrix
and
For
, the matrix
has eigenvectors
belonging to eigenvalues
. Since
for
if
are any normalized eigenvectors belonging to
respectively then
where
are real for
It is obviously impossible to define
, say, in such a way that
tends to a limit as
because
has no limit as
Note in this example that
is not only continuous but also has continuous derivatives of all orders. Rellich draws the following important consequence. << Since in general the individual eigenvectors do not depend continuously on the perturbation parameter even though the operator
does, it is necessary to work, not with an eigenvector, but rather with the space spanned by all the eigenvectors belonging to the same eigenvalue. >>
Example 2
This example is less nasty that the previous one. Suppose
is the 2x2 identity matrix, any vector is an eigenvector; then
is one possible eigenvector. But if one makes a small perturbation, such as
Then the eigenvectors are
and
; they are constant with respect to
so that
is constant and does not go to zero.
See also
References
- ^ Rayleigh, J. W. S. (1894). The theory of Sound. Vol. 1 (2nd ed.). London: Macmillan. pp. 114–118. ISBN 1-152-06023-6.
- ^ Courant, R. (1943). "Variational Methods for the Solution of Problems of Equilibrium and Vibrations" (PDF). Bulletin of the American Mathematical Society. 49: 1–23. doi:10.1090/S0002-9904-1943-07818-4.
- ^ Weinstein, A. (1941). "Les vibrations et le calcul des variations". Portugaliae Mathematica (in French). 2 (2): 36–55.
- ^ Rellich, F. (1954). Perturbation theory of eigenvalue problems. CRC Press.
Further reading
Books
- Ren-Cang Li (2014). "Matrix Perturbation Theory". In Hogben, Leslie (ed.). Handbook of linear algebra (Second ed.). ISBN 978-1466507289.
- Rellich, F., & Berkowitz, J. (1969). Perturbation theory of eigenvalue problems. CRC Press.
{{cite book}}
: CS1 maint: multiple names: authors list (link). - Bhatia, R. (1987). Perturbation bounds for matrix eigenvalues. SIAM.
Report
- Rellich, Franz (1954). Perturbation theory of eigenvalue problems. New-York: Courant Institute of Mathematical Sciences, New-York University.
Journal papers
- Simon, B. (1982). Large orders and summability of eigenvalue perturbation theory: a mathematical overview. International Journal of Quantum Chemistry, 21(1), 3-25.
- Crandall, M. G., & Rabinowitz, P. H. (1973). Bifurcation, perturbation of simple eigenvalues, and linearized stability. Archive for Rational Mechanics and Analysis, 52(2), 161-180.
- Stewart, G. W. (1973). Error and perturbation bounds for subspaces associated with certain eigenvalue problems. SIAM review, 15(4), 727-764.
- Löwdin, P. O. (1962). Studies in perturbation theory. IV. Solution of eigenvalue problem by projection operator formalism. Journal of Mathematical Physics, 3(5), 969-982.