[Math] Lyapunov equation for stability analysis – what’s the point

dynamical systemseigenvalues-eigenvectorsmatrix equationsordinary differential equationsstability-in-odes

Straight from Wikipedia:

In the following theorem $A, P, Q \in \mathbb{R}^{n \times n}$, and $P$ and $Q$ are symmetric. The notation $P>0$ means that the matrix $P$ is positive definite.

Given any $Q>0$, there exists a unique $P>0$ satisfying $A^T P + P A + Q = 0$ if and only if the linear system $\dot{x}=A x$ is globally asymptotically stable. The quadratic function $V(z)=z^T P z$ is a Lyapunov function that can be used to verify stability.

Recently I became quite familiar with tools to solve Lyapunov equation $A^T P + P A + Q = 0$ and obtain $P$. However in the context of stability analysis I see one huge problem. It's that you still have to check that $P$ is positive definite or equivalently that its eigenvalues are positive. But for the linear system the fact that all eigenvalues of $A$ have negative real parts ensures that the system is globally asymptotically stable in the first place.

So what's the point of going through all the hassle just to end up with looking for the eigenvalues ($P$ and $A$ are of the same size!) anyway? Does the symmetric matrix make such a big difference?

Best Answer

  1. The problem of finding eigenvalues for non-hermitian (and non-symmetric) matrices is very unstable; it is quite hard to solve numerically (close to impossible) and can't be solved in radicals for matrices of size at least $5$.

  2. Finding eigenvalues for hermitian (symmetric) matrices is a much easier problem - and can be reliably solved numerically.

  3. For asymptotic stability, we don't need the exact values of eigenvalues, we only need that their real part are strictly negative. The existence of $P=P^*>0$ satisfying the Lyapunov equation is a sufficient criterion.

  4. We have explicit formulas for solutions of the Lyapunov equations.

  5. The Lyapunov equation is linear in $P$ (if we are talking about real matrices), hence, we obtain a large system of linear equations, so we can solve it numerically.

  6. We are not looking for eigenvalues of $P$: we can use any other criterion of positive definness: for example, via main minors.

  7. The most important one: we have estimations on the norm $\|x(t)\|$ is terms of the matrices $P$ and $Q$. A mere study of eigenvalues of $A$ (given that we can find them...) does not give such information (we could use the eigenvectors to obtain that info, but hte problem would become even harder).

Edit

The last result is quite standard for Lyapunov stability. Let $x(t)$ be a solution of the differential equation. Then we can write $$(x^*(t)Px(t))' = (x^*(t))'Px(t)+x^*(t)Px'(t) = x^*(t)(A^*P+PA)x(t) = -x^*(t)QX(t)\le q \|x(t)\|^2\le -\frac{q}{\|P\|}x^*(t)Px(t),$$ where $q>0$ is the minimal eigenvalue of $Q$.

The Gronwall's lemma gives us the inequality $$x^*(t)Px(t)\le \exp\left(-\frac{qt}{\|P\|}\right)x^*(0)Px(0)\le \|P\|\exp\left(-\frac{qt}{\|P\|}\right)\|x(0)\|^2.$$

One the other hand, if $p>0$ is the minimal eigenvalue of $P$, then $$p\|x(t)\|^2\le x^*(t)Px(t)\le \|P\|\exp\left(-\frac{qt}{\|P\|}\right)\|x(0)\|^2,$$ hence $$ \|x(t)\|^2\le \frac{\|P\|}{p}\exp\left(-\frac{qt}{\|P\|}\right)\|x(0)\|^2.$$ The term $\frac{\|P\|}{p}$ is nothing but the conditionment number of the matrix $P$: $cond(P) = \|P\|\|P^{-1}\| = \|P\|/p$.

Related Question