[Math] the gradient with respect to a vector $\mathbf x$

calculusmultivariable-calculus

What is the meaning of "gradient with respect to $\mathbf x$"?

http://en.wikipedia.org/wiki/Gradient

I am talking about the symbol $$\nabla_\mathbf x$$

Does that simply mean derivative with respect to $\mathbf x$?

Best Answer

You need to be careful with any notation since often authors define and use symbols in different manner. Although in this particular case, my mathematical experience tells me that most common are:

1. "Gradient's variable":
following Ruben Tobar's answer, it may be notation providing information with respect to which variables the whole gradient should be taken. To be more precise: if $x_i\in \mathbb{R}$ for $i= 1,...,n$ and $\mathbf{x}\in\mathbb{R}^n$ is a vector defined as $\mathbf{x}=\{x_1,...,x_n\}$, given differentiable $f(\mathbf{x}):\mathbb{R}^n\rightarrow\mathbb{R}$ we have: $$\nabla_{\mathbf{x}}f=(\partial_{x_1}f,...,\partial_{x_n}f)$$ Therefore $\nabla_{\mathbf{x}}f$ is a vector whose entities $\partial_{x_i}f$ are just standard derivatives of multi-variable function $f$ with respect to the real variable $x_i$ (so called partial derivatives). Note that I did not write here explicitly dependence of $f$ on $\mathbf{x}$ since it would be redundant and erroneous, but nevertheless both left hand side and all the entities on the right hand side are functions dependent on $\mathbf{x}$.
To elaborate about the notation a little: it is quite commonly used in partial differential equations, where you have multiple different variables and not to confuse your reader, when you use (or define) a differential operator you stress the variables used in definition of this operator. For example consider the following: take $\mathbf{x}\in{\mathbb{R}^n}$ defined as above and similarly $\mathbf{z}\in{\mathbb{R}^d}$ for some natural $r,d>1$ and $t\in\mathbb{R}$. Problem is to find a function $f(t,\mathbf{x},\mathbf{z}):\mathbb{R}\times \mathbb{R}^n\times\mathbb{R}^d\rightarrow\mathbb{R}$ solving differential equation. Without stressing the variables the following differential equation is ambiguous and difficult to write in any different way: $$f_t + \nabla_\mathbf{x}f +{\rm div}_\mathbf{z}f = 0$$ where ${\rm div}_\mathbf{z}$ is different differential operator (called divergence) defined as $\sum_i\partial_{z_i}$, $i=1,...d.$

2. Directional derivative:
As you see in https://en.wikipedia.org/wiki/Directional_derivative (where you can find more information) it is a very common notation for directional derivative. Not in full generality: Given any $f(\mathbf{x}):\mathbb{R}^n\rightarrow\mathbb{R}$ and a vector $\mathbf{v}\in \mathbb{R}^n$: $$\nabla_{\mathbf{v}} f(\mathbf{x}):=\nabla f(\mathbf{x})\cdot\mathbf{v},$$ where on the right hand side we have standard scalar product.

3. Gradient at x?:
In my opinion (some may disagree): it is neither common, nor useful notation. Although, using our notation it would mean: $$\nabla_\mathbf{x}f:=[\nabla f](\mathbf{x}):=(\partial_{x_1} f(\mathbf{x}),...,\partial_{x_n} f(\mathbf{x}))$$ Where $\mathbf{x}\in\mathbb{R}^n$ is fixed and partial derivatives of $f$ are evaluated at $\mathbf{x}$. Note that unlike in point 1. where we didn't stress dependence on the variable, here we write explicitly that functions are evaluated at $\mathbf{x}.$