[Math] Geometric interpretation of Laplace’s formula for determinants

differential-geometrygeometrylinear algebra

Coming from the geometric point of view, the determinant of an $n \times n$-Matrix computes the volume of an parallelepiped spanned by the columns of the matrix.

In context of this question, let the determinant be defined by Laplace's formula and let us assume that we use the Laplace expansion along the first column of the matrix.

In case of a $2\times 2$-matrix of the form $M=\begin{pmatrix} a & c\\ b & d\end{pmatrix}$, the expansion is quite intuitive: One takes $a$ – which can be seen as the projection of the vektor $\begin{pmatrix} a \\ b \end{pmatrix}$ onto the $e_1$-axis – and multiplies it with $d$, which can be seen as the projection of the vector $\begin{pmatrix} c \\ d \end{pmatrix}$ onto the $e_2$-axis. So it's the base $\times$ height-formula which would be correct if $b=0$. If $b \neq 0$, the error which is made is exactly $c \cdot d$, again by a base $\times$ height-formula, which one can check with the help of a figure by Salomon Golomb, which I found here:

Why determinant of a 2 by 2 matrix is the area of a parallelogram?

I hoped to transfer this principle to $3 \times 3$-matrices.
I considered the parallelogram spanned by the 2nd and the 3rd column of a $3 \times 3$-matrix. Keeping Laplace's formula in mind, the first entry of the first column is multiplied with the area of the projection of the parallelogram onto the $e_2$-$e_3$-plane, the second entry is multiplied with the area of the projection onto the $e_1$-$e_3$-plane and the third entry is multiplied with the area of the projection onto the $e_1$-$e_2$-plane. (That is, $\det(a,b,c)= c\cdot (a\times b)$).

I tried to give an geometric sense to this calculations mimicking what was done in Golomb's figure but I failed. Sure, there is a way to rearrange the three sets to conclude that actually the volume of the parallelepiped was computed but again I would not understand why.

Is the anyone who knows a way to interprete Laplace's formula geometrically? I think there might be a way which uses the projections of the parallelogram which I mentioned above…

I would be very thankful for all other (geometric) interpretations, too!

Ole

Best Answer

Let's have a little lesson on determinants and why they correspond to volumes in the first place.


Exterior and Clifford algebra: algebras of planes, volumes, and other interesting subspaces

You might have realized that conventional linear algebra--the algebra of directions, as it were--is somewhat inadequate for talking about planes, volumes, and the like. These are interesting geometric objects, but they do not correspond to vectors in vector algebra. Conventional approaches devise some clever ways around this problem: they use normal vectors for planes in 3d, for instance, but this doesn't generalize.

An algebraic solution to this issue is to use something that builds up from vector algebra. Clifford algebra is a good choice: compared to vector algebra, the extra stuff you need is pretty minimal.

Clifford algebra follows from the introduction of a "geometric product" of vectors: if $a$ is a vector, then $aa \equiv |a|^2$. If $a, b$ are orthogonal, then $ab = -ba$. If $u, v, w$ are vectors, then $(uv)w = u(vw)$. So, we have behavior like the dot product, behavior like the cross product, and associativity.

The geometric product allows us to build up multivectors. A product of $k$ orthogonal vectors is called a $k$-blade. Vectors are 1-blades, but two orthogonal vectors $u,v$ would form a 2-blade $uv$.

Now, you might realize that it's clumsy to have to deal with only orthogonal or parallel vectors. Given two vectors $c, d$ that are neither parallel nor orthogonal, you can break down the geometric product like so:

$$cd = c_{\parallel} d + c_{\perp} d \equiv c \cdot d + c \wedge d$$

The dot and wedge used here are traditional. And they make sense for general blades. Let $B$ be some general $k$-blade. Then the expression

$$cB = c_\parallel B + c_\perp B = c \cdot B + c \wedge B$$

has a similar meaning: there are two well-defined parts of the product from looking at the projection of $c$ onto $B$ and the "rejection" of $c$ that is perpendicular to $B$. Note, however, that if $B$ is a $k$-dimensional subspace, a $k$-blade, then $c \cdot B$ is not a scalar. Rather, $c \cdot B$ is a $k-1$-dimensional subspace, and $c \wedge B$ is $k+1$ dimensional. Think about how this worked for the vector-vector case if that doesn't make sense.

Now, if you wanted to build up a parallelpiped from three vectors, you could wedge them together like so:

$$u \wedge v \wedge w = u_{\perp(v \wedge w)} v_{\perp(w)} w$$


The relationship with linear algebra: the geometric interpretation of determinant

The role of determinants here is somewhat misunderstood. Traditional linear algebra doesn't really explain it as well as clifford algebra can.

Given a linear operator $\underline T$, which we often represent with a matrix with respect to some basis*, there is a natural extension of that linear operator to blades. In paritcular, consider the definition

$$\underline T(u \wedge v \wedge w \wedge \ldots) \equiv \underline T(u) \wedge \underline T(v) \wedge \underline T(w) \wedge \ldots$$

Now, realize that in any $n$-dimensional space, the vector space of $n$-blades is like that of scalars: let $i$ denote one such $n$-blade. Then all other $n$-blades are scalar multiples of $i$. Think of a volume: all other volumes are scalar multiples of that volume in terms of numerical size. Negative volumes are just oriented differently (left-hand vs. right-hand rule).

Indeed, this gives a nice, geometric definition of the determinant that can be understood with the machinery of the clifford algebra:

$$\underline T(i) \equiv (\det \underline T) i$$

So the determinant becomes understood as an eigenvalue, the eigenvalue of any $n$-blade.

But this relationship has often been understood the wrong way around: because the determinant gives us a way to measure a given $n$-blade with respect to a reference $n$-blade (in this case, $i$), people often build up linear operators from the $n$ linearly independent vectors that they want to build up a (hyper-)parallelepiped from, and then they take a determinant to find the size of that parallelepiped. This is very backwards; the clifford algebra gives a direct way to do that with algebraic operations. Namely, if $I$ is the $n$-blade you want to consider and $i$ is the reference $n$-blade you want to use to measure its size against, just take

$$I i^{-1} \equiv I i/|i^2|$$

This is a nice, well-defined quantity.


Geometric interpretation of wedge products

So in fact, the relationship to determinants here is somewhat incidental. We really want to understand, geometrically, how to calculate the magnitude of an $n$-blade.

Again, the geoemtric product gives an obvious interpretation. Given a wedge product of $n$-vectors, we can rewrite that product as a geometric product using rejections. Again, remember this example:

$$u \wedge v \wedge w = u_{\perp(v \wedge w)} v_{\perp(w)} w$$

You could write that in terms of a unit 3-blade $i$ and some trig functions:

$$u \wedge v \wedge w = |u||v||w| i\sin \theta_{v,w} \sin \theta_{u,v\wedge w}$$

And these angles have immediate geometric significance: $\theta_{v,w}$ is the angle $v$ makes with $w$. $\theta_{u,v\wedge w}$ is the angle $u$ makes with the plane formed by $v \wedge w$. This can be done successively.


Geometric interpretation of Laplace expansion

But your question was specifically about the Laplace expansion. Well, let me consider an explicit calculation of one of these wedge products:

$$u \wedge v \wedge w = u^1 e_1 \wedge (v \wedge w) + u^2 e_2 \wedge (v \wedge w) + u^3 e_3 \wedge (v \wedge w)$$

This is basically what Laplace expansion does: in each $v \wedge w$ term, we neglect any terms that involve the vector we're weding on to it. So in the $e_1 \wedge (v \wedge w)$ term, we neglect anything in the parentheses that would have $e_1$ in it. In 3d, those are only terms that look like $e_2 e_3$, and so you get the familiar terms of $(v^2 w^3 - v^3 w^2) e_2 e_3$.

It should be understood, then, when Laplace expansion is invoked, we're explicitly doing the calculation of taking the vector we expanded along and, in essence, finding the rejection of that vector onto the $n-1$-dimensional subspace formed by the other vectors in the matrix (rejection = part perpendicular to that subspace). We're finding the "height" of the parallelepiped with respect to a certain base. And the whole process of finding a determinant here is just repeatedly finding heights, and then the corresponding areas or volumes that those heights help form.