block matriceslinear algebramatrices
Why does elementary row operation on combination of Identity matrix and invertible matrix yields inverse matrix?
$$A = \begin{pmatrix}
1 & 3\\
4 & 2
\end{pmatrix}$$
if we combine $A$ with $I_{2\times 2}$ in which $I$ is an identity matrix, and do elementary row operation on it to get identity matrix on the other side, the opposite side(block) yields out the inverse of the matrix.
The question is, why is it true?
Like in the definition of Wikipedia you are correct, $k$ cannot be equal $0$. In fact elementary matrices represent the steps that you do with the gaussian algorithm, and you are not allowed to multiply a row/column by $0$ to get the Row Echelon Form because when you multiply a row/column by $0$ "you loose the information" of the row/column and that is obviously not good.
It can happen that you get a row/column with all zeros, but that's because the rank of the matrix isn't equal to its dimension.
Since the operation is $B=EA$ we have \begin{equation} \begin{pmatrix} -2 & 0\\0 & 1 \end{pmatrix}\begin{pmatrix} 2 & -1\\5 & 3 \end{pmatrix} = \begin{pmatrix} -4 & 2\\5 & 3 \end{pmatrix}. \end{equation} Your elementary matrix is correct but you meant to multiply it to $A$ on the left not on the right.
Best Answer
Great question.
The reason why this is true is because, if a given matrix $A$ is invertible, then there exists a sequence of matrices $E_1, E_2, \dots, E_m$ such that
$$E_m E_{m-1} \cdots E_2 E_1 A = A^{-1}$$
We call these matrices elementary matrices. These matrices are in charge of the row operations that we can do on matrices, such as swapping rows, multiplying one row by a constant, or even multiplying one row by a constant and adding it to another row (exactly what we do in Guassian elimination). For example, consider the matrix
$$E_1 = \left( \begin{array}{rc} 1 & 0 \\ -4 & 1 \end{array} \right)$$
If we left-hand multiply your matrix $A$ by $E_1$, we get
$$\left( \begin{array}{rc} 1 & 0 \\ -4 & 1 \end{array} \right) \left( \begin{array}{cc} 1 & 3 \\ 4 & 2 \end{array} \right) = \left( \begin{array}{cr} 1 & 3 \\ 0 & -10 \end{array} \right)$$
which is the matrix we get after the first step Guassian elimination on your matrix $A$! But look closely: if you're trying to find the inverse of $A$ by attaching the identity to the right and row-reducing $A$ down to the identity, then $E_1$ pops up on the right (in place of the identity you attached) after your first step.
Now, consider
$$E_2 = \left( \begin{array}{rr} 1 & 0 \\ 0 & -1/10 \end{array} \right)$$
and observe that
$$E_2 E_1 A = \left( \begin{array}{rr} 1 & 0 \\ 0 & -1/10 \end{array} \right) \left( \begin{array}{cr} 1 & 3 \\ 0 & -10 \end{array} \right) = \left( \begin{array}{cc} 1 & 3 \\ 0 & 1 \end{array} \right)$$
which is the matrix you'd get after multiplying the second row through by $-1/10$, something that might be useful in our Guassian elimination because we want $A$ to eventually be the identity. If you do that in your steps of trying to invert $A$, notice that, after multiplying the second row through, the matrix attached to the right hand side becomes
$$E_2 E_1 = \left( \begin{array}{cc} 1 & 0 \\ 2/5 & -1/10 \end{array} \right)$$
Finally, consider
$$ E_3 = \left( \begin{array}{cr} 1 & -3 \\ 0 & 1 \end{array} \right)$$
and observe that
$$E_3 E_2 E_1 A = \left( \begin{array}{cr} 1 & -3 \\ 0 & 1 \end{array} \right) \left( \begin{array}{cc} 1 & 3 \\ 0 & 1 \end{array} \right) = \left( \begin{array}{cr} 1 & 0 \\ 0 & 1 \end{array} \right)$$
which is the matrix you get after your final step of Guassian elimination of $A$ (multiplying the second row by $-3$ and adding it to the first row of $A$). But look!
$$E_3 E_2 E_1 = \left( \begin{array}{cr} 1 & -3 \\ 0 & 1 \end{array} \right)\left( \begin{array}{cc} 1 & 0 \\ 2/5 & -1/10 \end{array} \right) = \left( \begin{array}{cr} -1/5 & 3/10 \\ 2/5 & -1/10 \end{array} \right)$$
which is the inverse of $A$, and it also happened to pop on the right-hand side in place of the identity that you initially attached.
Basically, when you do row operations with an identity matrix attached to the right, you're recording all of these steps as elementary matrices. When you apply multiple row operations, these steps accumulate on the right hand side. This accumulation process is the same as multiplying the elementary matrices that govern these Guassian elimination steps. In the end, once $A$ has been reduced down to the identity and all of the steps have been recorded, you get the identity, and this is the same thing as multiplying all of the elementary matrices that you needed together.