I have a doubt about the real meaning of the derivative of a vector field. This question seems silly at first but the doubt came when I was studying the definition of tangent space.
If I understood well a vector is a directional derivative operator, i.e.: a vector is an operator that can produce derivatives of scalar fields. If that's the case then a vector acts on a scalar field and tells me how the field changes on that point.
However, if a vector is a derivative operator, a vector field defines a different derivative operator at each point. So differentiate a vector would be differentiate a derivate operator, and that seems strange to me at first. I thought for example that the total derivative of a vector field would produce rates of change of the field, but my studies led me to a different approach, where the total derivative produces rates of change only for scalar fields and for vector fields it produces the pushforward.
So, what's the real meaning of differentiating a vector field knowing all of this?
Best Answer
As I understand it, these are your questions:
I think the best way to answer these questions is to provide a broader context:
In calculus, we ask how to find derivatives of functions $F\colon \mathbb{R}^m \to \mathbb{R}^n$. The typical answer is the total derivative $DF\colon \mathbb{R}^m \to L(\mathbb{R}^m, \mathbb{R}^n)$, which assigns to each point $p \in \mathbb{R}^m$ a linear map $D_pF \in L(\mathbb{R}^m, \mathbb{R}^n)$. With respect to to the standard bases, this linear map can be represented as a matrix: $$D_pF = \begin{pmatrix} \left.\frac{\partial F^1}{\partial x^1}\right|_p & \cdots & \left.\frac{\partial F^1}{\partial x^m}\right|_p \\ \vdots & & \vdots \\ \left.\frac{\partial F^n}{\partial x^1}\right|_p & \cdots & \left.\frac{\partial F^n}{\partial x^m}\right|_p \end{pmatrix}$$
Personally, I think this encodes the idea of "rate of change" very well. (Just look at all those partial derivatives!)
Let's now specialize to the case $m = n$. Psychologically, how does one intuit these functions $F\colon \mathbb{R}^n \to \mathbb{R}^n$? There are two usual answers:
This distinction is important. When we generalize from $\mathbb{R}^n$ to abstract manifolds, these two ideas will take on different forms. Consequently, this means that we will end up with different concepts of "derivative."
In case (1), the maps $F\colon \mathbb{R}^m \to \mathbb{R}^n$ generalize to smooth maps between manifolds $F \colon M \to N$. In this setting, the concept of "total derivative" generalizes nicely to "pushforward." That is, it makes sense to talk about the pushforward of a smooth map $F \colon M \to N$.
But you asked about vector fields, which brings us to case (2). In this case, we first have to be careful about what we mean by "vector" and "vector field."
In this setting, it no longer makes sense to talk about the "total derivative" of a vector field. You've said it yourself: what would it even mean to talk about "derivatives" of vectors, anyway? This doesn't make sense, so we'll need to go a different route.
In differential geometry, there are two ways of talking about the derivative of a vector field with respect to another vector field:
Intuitively, these notions capture the idea of "infinitesimal rate of change of a vector field $v$ in the direction of a vector field $w$."
Question: What do these constructions look like in $\mathbb{R}^n$?
Taking advantage of the fact that we're in $\mathbb{R}^n$, we can look at our vector fields in the calculus way: as functions $v\colon \mathbb{R}^n \to \mathbb{R}^n$. As such, we can write the components as $v = (v^1,\ldots, v^n)$.
Also, in $\mathbb{R}^n$ we have the pleasant formula
$$\mathcal{L}_wv = \nabla_wv - \nabla_vw,$$
which aids in computation.