[Math] Geometric Interpretation of Gaussian elimination

linear algebra

I understand the solution of a linear system of equation is equivalent to finding the intersection points of n-hyperplanes.

There are 3 elementary row operations – scaling an equation, exchanging equations and subtracting a scalar multiple of an equation from another equation.

The first two I understand geometrically. I am trying to understand the subtraction of two equations geometrically. I can see that the row operation produces a new hyperplane which has one of the coordinate axes as its normal. What I am specifically trying to understand is how the hyperplane is rotated by exactly the right angle?. Anything to do with direction cosines/

Thanks
Rajagopal

Best Answer

The coefficients of the equation specify the normal vector of the corresponding hyperplane. Thus, if you add equations, you're adding their normal vectors. Specifically, if you have equations $e_1$ and $e_2$ and you form $e=e_1+\lambda e_2$, you get a new normal vector $n=n_1+\lambda n_2$. The direction of this new normal vector goes to that of $n_2$ for $\lambda\to\pm\infty$, but, unless $n_2$ is parallel to $n_1$, it is never that of $n_2$, which ensures that the new equation is linearly independent of the one for $n_2$ if the old one was.

By "the row operation produces a new hyperplane which has one of the coordinate axes as its normal", I presume you're referring specifically to the row operations used in Gaussian elimination which make one of the coefficients $0$. This doesn't mean that the normal of the new hyperplane is one of the coordinate axes (else it would have to have all the previous coordinate axes as its normal, too). Rather, it means that the normal of the hyperplane is orthogonal to that coordinate axis.

Related Question