Are tensors vectors

linear algebratensors

Take the definition of a tensor as a multilinear map $T: (V)^n \times (V^*)^m \rightarrow \mathbb R$. One may then define the addition of two tensors as the sum of their outputs on their input spaces (assuming of course the tensors have the same rank), and scalar multiplication as the output scaled by the factor used (if $T$ maps its input to $b$, then $aT$ maps its input to $ab$).

As one can easily check, tensors would then satisfy all of the vector space axioms, so then a tensor could be considered a specific type of vector. This bothered me, though, because vectors are often defined as objects with magnitude and direction in less formal contexts, and tensors can often be informally considered to have many different directions.

This leads me to the writing of this question. What distinguishes a tensor from a classical, "ordinary" vector? How can one derive the definition of a vector as something with magnitude and direction from the definition of a vector space, and where does this definition break down for tensors (if anywhere)?

Best Answer

What distinguishes a tensor from a vector relies on understanding what you're talking about. Strictly speaking, tensors of a fixed rank form a vector space (over $\mathbf R$, say), and thus "tensors are vectors" for pure mathematicians who don't work in anything related to physics or differential geometry.

But nobody means anything like that when they bring up the issues of tensors vs. vectors. This is why "tensors are not vectors" for physicists, and it explains why you are getting the answers "yes" and "no" in the comments.

Look at how tensors are built. You start with a vector space $V$ and take a tensor product of tensor powers of $V$ and the dual space $V^*$, say $V^{\otimes n} \otimes (V^*)^{\otimes m}$. Elements of $V^{\otimes n} \otimes (V^*)^{\otimes m}$ are called tensors, elements of $V$ are called vectors, and elements of $V^*$ are called covectors. In this setting, where the word vector means "element of $V$", the objects in $V^{\otimes n} \otimes (V^*)^{\otimes m}$ are not vectors (unless $n = 1$ and $m = 0$). Vector is just a synonym for "element of $V$". That's all there is to it.

You ask in a comment why tensors can't be given an inner product. That's incorrect: they can, provided $V$ is given an inner product first. If $V$ and $W$ are both real vector spaces and they are each given an inner product $\langle \cdot,\cdot\rangle_V$ and $\langle \cdot,\cdot\rangle_W$, then there is a unique inner product on $V \otimes W$ for which $$ \langle v \otimes w,v'\otimes w'\rangle = \langle v,v'\rangle_V\langle w,w'\rangle_W $$ on elementary tensors $v \otimes w$ and $v' \otimes w'$ in $V \otimes W$. Check that. That is, figure out why there exists exactly one inner product on $V \otimes W$ having the above behavior on pairs of elementary tensors in $V \otimes W$.

By iterating this construction, when $V$ has an inner product $\langle \cdot,\cdot\rangle_V$, each tensor power $V^{\otimes n}$ has a unique inner product that looks like $$ \langle v_1 \otimes \cdots \otimes v_n,v_1'\otimes \cdots \otimes v_n'\rangle = \langle v_1,v_1'\rangle_V\cdots \langle v_n,v_n'\rangle_V $$ on pairs of elementary tensors $v_1 \otimes \cdots \otimes v_n$ and $v_1'\otimes \cdots \otimes v_n'$.

When $V$ is finite-dimensional, an inner product $\langle \cdot,\cdot\rangle_V$ on $V$ gives us an isomorphism $V \to V^*$ by $v \mapsto \langle\cdot,v\rangle_V$. Using this, we can transport the inner product on $V$ over to an inner product on $V^*$: for $\varphi$ and $\varphi'$ in $V^*$, simply declare $$ \langle \varphi,\varphi'\rangle_{V^*} := \langle v,v'\rangle_V $$ where $\varphi = \langle \cdot,v\rangle_V$ and $\varphi' = \langle \cdot,v'\rangle_V$. Now you can use this inner product on $V^*$ to define an inner product on $(V^*)^{\otimes m}$ by the method described above for creating an inner product on tensor powers of $V$ from an inner product on $V$ (just replace $V$ by $V^*$ everywhere). And then you can use the inner products on $V^{\otimes n}$ and $(V^*)^{\otimes m}$ to define an inner product on $V^{\otimes n} \otimes (V^*)^{\otimes m}$ by the method described up above for putting an inner product on $V \otimes W$ when $V$ and $W$ each have an inner product. Thus, when a finite-dimensional real vector space $V$ has an inner product, every space of tensors $V^{\otimes n} \otimes (V^*)^{\otimes m}$ for fixed $m$ and $n$ gets an inner product from the inner product on $V$. Concretely, for elementary tensors $$ t = v_1 \otimes \cdots \otimes v_n \otimes \varphi_1 \otimes \cdots \otimes \varphi_m $$ and $$ t' = v_1' \otimes \cdots \otimes v_n' \otimes \varphi_1' \otimes \cdots \otimes \varphi_m' $$ in $V^{\otimes n} \otimes (V^*)^{\otimes m}$, $$ \langle t,t'\rangle = \prod_{i=1}^n \langle v_i,v_i'\rangle_V \prod_{j=1}^m \langle w_j,w_j'\rangle_V, $$ where $\varphi_j = \langle \cdot,w_j\rangle_V$ and $\varphi_j' = \langle \cdot,w_j'\rangle_V$.

Related Question