Dual space as linear functional

linear algebra

I understand the dual space to be a vector space of linear functionals that takes in vectors and spits out scalars. I'm struggling to understand what this actually means and more specifically what it means for the dual basis. I think at a high level if we have a basis vector and we find its dual basis then we can feed the dual basis a vector via the inner product and it will spit out a scalar that will tell us how much of our original basis is in the representation of vector with respect to the original basis but I'm not sure how to interpret actual results when going through these operations. If I perform an inner product with a dual basis and some vector x and the result is 6, what does that actually mean? Additionally, I understand that rows in a matrix in general can be thought of as linear functionals that tell us how much of something is in the output. How exactly is this related to the dual basis? It almost seems like the dual basis is functionally equivalent to the transpose of a matrix but this doesn't seem to be the case if I look at actual examples of calculating dual basis.

Best Answer

Let's say we have a basis $v_1, \dots, v_n$ of the vector space $V$ (could be $V= \mathbb R^n$ for example). Then the dual basis is often written as $v_1^\vee, \dots, v_n^\vee$ where the definition of the functional $v_i^\vee$ is: $$v_i^\vee(v_j) = \delta_{ij}$$ where $\delta_{ij}$ is the Kronecker-delta ($\delta_{ij}=1$ iff $i=j$, $\delta_{ij}=0$ otherwise). First of all this completely defines $v_i^\vee$ as $v_1, \dots, v_n$ is a basis of $V$, so $v_i^\vee$ is defined by giving values of $v_i^\vee$ for a basis. By linearity that defines $v_i^\vee$.

Now for the interpretation part: if you have $v_i^\vee(w) = 6$ for some vector $w$ that means that in the representation $$w=\sum_{j=1}^n c_jv_j$$ the coefficient $c_i$ has to be $6$. Because $$v_i^\vee(w) = \sum_{j=1}^n c_j v_i^\vee(v_j)=c_i$$ by linearity of $v_i^\vee$. That is the formal way of explaining the "how much of $v_i$ was in the input".

Now for the transposing part: You can interpret the calculation of $v_i^\vee(w)$ as dot product or multiplication of a row vector with a columns vector as follows: The linear map $v_i^\vee$ maps the $i$-th basis vector to $1$ and the other basis vectors to $0$. So if $w= \sum_{j=1}^n c_jv_j$ we have $$v_i^\vee(w) = (0,\dots, 0, 1, 0, \dots, 0) \cdot \begin{pmatrix} c_1\\ \vdots \\c_n \end{pmatrix}$$ This gives a useful tool to evaluate other linear functionals in the dual space $V^\vee$. Then the row vector is just the coefficients of the functional $\phi$ in the expression $$\phi = \sum_{k=1}^n a_k v_k^\vee$$ In other words, $v_i^\vee$ corresponds to $e_i^T$ and the column vector that you multiply is the vector of coefficients in the representation of the vector $w$ in the basis $v_1, \dots, v_n$

Related Question