[Math] Difference between magnitude of gradient vs directional derivative of gradient

multivariable-calculus

I've read that the directional derivative is the rate of change of a function $f$ in a given direction $\mathbf{v}$, given as $\nabla f\cdot \mathbf{v}$. I've also read (perhaps incorrectly) that the magnitude of the gradient also tells us the rate of change. If so, what does the directional derivative of the gradient, i.e. $\nabla f\cdot \nabla f$ tell us?

Best Answer

The magnitude of the gradient is the maximum rate of change at the point. The directional derivative is the rate of change in a certain direction. Think about hiking, the gradient points directly up the steepest part of the slope while the directional derivative gives the slope in the direction that you choose to walk.

In response to the comments:

There's more than one direction starting at a point (you're in a multivariate situation). Therefore, it doesn't make sense to talk about "the rate of change." Each direction of travel gives a different rate of change. The magnitude of the gradient is the largest of these rates of change while the directional derivative is the rate of change in a particular direction.

Instead of $\nabla f\cdot \nabla f$, you might be interested in the following. Let $u$ be a unit vector which points in the direction of $\nabla f$. Then the directional derivative in the direction of $u$ is $\|\nabla f\|$, which is the maximum possible rate of change.