Matrix Transpose and Inverse – Reason for Reversing Order

linear algebramatrices

Whenever there is a transpose or inverse of a group of matrices, I just reverse their order. For eg: $(ABC)^{-1} = C^{-1}B^{-1}A^{-1}$ and $(ABC)^{T} = C^{T}B^{T}A^{T}$

But usually, I am taking this reverse "rule" for granted without really knowing why I have to reverse their order whenever there is an inverse or transpose.

What is the reason for reversing their order?

Best Answer

For the inverse, you can just apply the definition and compute:

$(ab)(b^{-1}a^{-1})=a(bb^{-1})a^{-1}=aa^{-1}=id$

and similarly $(b^{-1}a^{-1})(ab)=id$. Hence $b^{-1}a^{-1}$ is an (and by uniqueness of inverses, the) inverse of $ab$.

A popular way to 'explain' this, is by saying "the inverse of 'putting on socks and then shoes', is 'taking off shoes and then socks'".

For the transpose, you can also apply the definition: if $A$ has matrix elements $(a_{ij})_{ij}$, then $A^T$ has matrix elements $(a_{ji})_{ij}$. Then compute the matrix elements of $(AB)^T$ and of $B^TA^T$ and see that they are equal.

A more conceptual way however is the following: taking the dual is a contravariant functor. That is, a linear map $A:V\to W$ has dual map $A^*:W^*\to V^*$ between the dual spaces (in the other direction!), and this is compatible with composition: $(A\circ B)^*=B^*\circ A^*$. The definition is $A^*=-\circ A$, so just precompose the linear functional with $A$; the composition property is then immediate. Now if $A$ has matrix $a_{ij}$ with repsect to some bases of $V,W$, then the matrix of $A^*$ w.r.t. the corresponding dual bases of $V^*,W^*$ is $a_{ji}$ (this is an easy check by writing out the definitions).

Related Question