In learning linear algebra, an overarching question that I have is why there is a very specific set of rules that dictates when a system of equations is solved. The specifications according to stattrek.com:
The first non-zero element in each row, called the leading entry, is
1. Each leading entry is in a column to the right of the leading entry in the previous row. Rows with all zero elements, if any, are below
rows having a non-zero element.
just seem oddly contrived to me. This may be more of a question about how it was discovered, but then again I'm not sure. My best guess is that this just happens to be the pattern matrices follow when you've introduced the most zeros into the matrix (you've "eliminated" as many terms from the corresponding system as mathematically possible). I try to understand math as deeply as possible and this question has been bugging me for a while.
Best Answer
The row echelon form is useful under many respects. One of them is that the operations leading to it don't change linear relations between the columns of the matrices.
More precisely, if $A$ and $B$ are row equivalent matrices (one can be obtained by the other via elementary row operations) and their columns are $a_1,\dots,a_n$ and $b_1,\dots,b_n$ respectively, then a relation $\alpha_1a_{i_1}+\dots+\alpha_ka_{i_k}=0$ holds if and only if $\alpha_1b_{i_1}+\dots+\alpha_kb_{i_k}=0$ holds.
In other words, a set of columns of $A$ is linearly dependent if and only if the corresponding set of column of $B$ is linearly dependent.
Consider now a row echelon form $B$ of the matrix $A$. The pivot columns in $B$ are obviously linearly independent and each nonpivot column is a linear combination of the pivot columns (using only the pivot columns at the left of it). Therefore the same is true for the corresponding columns of $A$.
Hence one can find a basis of the column space of $A$ by considering the columns corresponding to the pivot columns in a row echelon form.
If $B$ is the reduced row echelon form, then the entries in a nonpivot column provide the coefficients for expressing that column as a linear combination of the pivot columns, and the same coefficients express the corresponding column of $A$ as a linear combination of the basis columns chosen as above.
By the way, this proves that the reduced row echelon form is unique.
Of course, the reduced row echelon form is particularly useful for solving linear systems (which is the reason why it was invented).