Non-commutative matrix Taylor series + How to compute the Jordan Chevalley

linear algebramatrix decompositionmatrix exponentialmatrix-calculustaylor expansion

I have some matrix $J$, which has a decomposition into the diagonal matrix $D$, and the nilpotent matrix $N$. It is almost exactly like a Jordan block, except with ones on the subdiagonal even when the $\lambda$ on the diagonal change – plus, it's transposed. I.e, $J,D,N$ look like this:

$$J=\begin{bmatrix}\lambda_1&0&0&0&\cdots&0\\1&\lambda_2&0&0&\cdots&0\\0&1&\lambda_3&0&\cdots&0\\\vdots&\vdots&\vdots&\vdots&\ddots&0\\0&0&0&\cdots&\lambda_{n-1}&0\\0&0&0&\cdots&1&\lambda_n\end{bmatrix}D=\begin{bmatrix}\lambda_1&0&0&0&\cdots&0\\0&\lambda_2&0&0&\cdots&0\\0&0&\lambda_3&0&\cdots&0\\\vdots&\vdots&\vdots&\ddots&\vdots&0\\0&0&0&\cdots&\lambda_{n-1}&0\\0&0&0&\cdots&0&\lambda_n\end{bmatrix}N=J-D$$

The Taylor series (incidentally the function is $\exp(tJ$) I am centering around $tD$:

$$f(tJ)=\sum_{k=0}^\infty\frac{f^{(k)}(tD)}{k!}\cdot (tJ-tD)^k=\sum_{k=0}^\infty\frac{f^{(k)}(tD)}{k!}\cdot (tN)^k$$

But the order of the multiplication $f^{(k)}(tD)\times (tN)^k$ is extremely important, since $N,D$ don't commute. Which way is correct, rigorously, and why? It seems to me that the extension of the Taylor series to matrix functions requires some extra thought!

Edit – perhaps it is a requirement on Taylor series that the two summands commute? Is this the case, meaning I must split $tJ$ some other, commutative, way? I know the Jordan-Chevalley decomposition states that such a commutative split exists, but I've seen nothing about how one actually finds $J=S+N:SN=NS%$.

Best Answer

$ \def\l{\lambda}\def\p{\partial} \def\A{{\cal A}}\def\B{{\cal B}}\def\C{{\cal C}} \def\L{\left}\def\R{\right}\def\LR#1{\L(#1\R)} \def\vec#1{\operatorname{vec}\LR{#1}} \def\trace#1{\operatorname{Tr}\LR{#1}} \def\grad#1#2{\frac{\p #1}{\p #2}} \def\gradLR#1#2{\LR{\frac{\p #1}{\p #2}}} \def\hess#1#2#3{\LR{\frac{\p #1}{\p #2}\bigg|_{#3}}} $Taylor series with matrix variables do not work the way you think they do.

For example, consider the second-order series of $f(X)$ centered at $X_0$ $$\eqalign{ f(X) &= \frac1{0!}f(X_0) \\ &+\; \frac1{1!}\LR{X-X_0}:\hess{f}{X}{X=X_0} \\ &+\; \frac1{2!}\LR{X-X_0}\star\LR{X-X_0}:\,:\hess{^2f}{X^2}{X=X_0} \\ }$$ In this expansion, $(:,\, :\,:)$ denote the double and quadruple contraction products, $(\star)$ denotes the dyadic (aka tensor) product, and the terms in parentheses are second and fourth order tensors.

In general, the $n^{th}$ order Taylor series of a function of $m^{th}$ order tensors will involve tensors and contraction products of order $mn$.

The Taylor series as derived in undergraduate calculus is only possible because scalars are $0^{th}$ order tensors, i.e. $\;m=0$.