Professional Documents
Culture Documents
work pdf-converted (1)
work pdf-converted (1)
We know that the partial derivatives with respect to xxx and yyy tell us
the rate of change of fff as we nudge the input either in
the xxx or yyy direction.
[Show me an example of this.]
The question now is what happens when we nudge the input of fff in a
direction which is not parallel to the xxx or yyy axes.
For example, the image below shows the graph of fff along with a small
step along a vector \vec{\textbf{v}}vstart bold text, v, end bold text,
with, vector, on top in the input space, meaning the xyxyx, y-plane in this
case. Is there an operation which tells us how the height of the graph
above the tip of \vec{\textbf{v}}vstart bold text, v, end bold text, with,
vector, on top compares to the height of the graph above its tail?
Change input in the direction of \vec{\textbf{v}}vstart bold text, v, end
bold text, with, vector, on top
One very helpful way to think about this is to picture a point in the input
space moving with velocity \vec{\textbf{v}}vstart bold text, v, end bold
text, with, vector, on top. The directional derivative
of fff along \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector,
on top is the resulting rate of change in the output of the function. So, for
example, multiplying the vector \vec{\textbf{v}}vstart bold text, v, end
bold text, with, vector, on top by two would double the value of the
directional derivative since all changes would be happening twice as fast.
Notation
There are quite a few different notations for this one concept:
Example 1: \vec{\textbf{v}} =
\hat{\textbf{j}}v=j^start bold text, v, end
bold text, with, vector, on top, equals, start
bold text, j, end bold text, with, hat, on top
Before jumping into the general rule for
computing \nabla_{\vec{\textbf{v}}} f∇vfdel, start subscript, start bold
text, v, end bold text, with, vector, on top, end subscript, f, let's look at
how we can rewrite the more familiar notion of a partial derivative as a
directional derivative.
\small{1}1\small{2}2\small{\llap{-}1}-1\small{\llap{-}2}-2\small{1}1\small{2}2\small{\llap{-}1}-
1\small{\llap{-}2}-2yyxx\hat{\textbf{j}}j^
This is all just fiddling with different notation. What's more important is
to have a clear mental image of what all this notation represents.
That is, a tiny nudge in the \vec{\textbf{v}}vstart bold text, v, end bold
text, with, vector, on top direction consists of \blueE{v_1}v1start color
#0c7f99, v, start subscript, 1, end subscript, end color #0c7f99 times a
tiny nudge in the xxx-direction, \redE{v_2}v2start color #bc2612, v, start
subscript, 2, end subscript, end color #bc2612 times a tiny nudge in
the yyy-direction, and \greenE{v_3}v3start color #0d923f, v, start
subscript, 3, end subscript, end color #0d923f times a tiny nudge in
the zzz-direction.
\begin{aligned} \nabla_{\maroonD{\vec{\textbf{v}}}} f =
\nabla f \cdot \maroonD{\vec{\textbf{v}}} \end{aligned}∇v
f=∇f⋅v
Take a moment to delight in the fact that one single operation, the
gradient, packs enough information to compute the rate of change of a
function in every possible direction! That's so many directions! Left, right,
up, down, north-north-east, 34.8^\circ∘degrees clockwise from the xxx-
axis... Madness!
Example 2:
Problem: Take a look at the following function.
Finding slope
How do you find the slope of a graph intersected with a plane that is not
parallel to the xxx or yyy axes?
Slice graph in a direction not parallel to x or y directions
You can use the directional derivative, but there is one important thing
to remember:
However, this might not always be what you want. The slope of a graph
in the direction of \vec{\textbf{v}}vstart bold text, v, end bold text, with,
vector, on top, for example, depends only on the direction
of \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on top,
not the magnitude ||\vec{\textbf{v}}||∣∣v∣∣vertical bar, vertical bar, start
bold text, v, end bold text, with, vector, on top, vertical bar, vertical bar.
Let's see why.
How can we imagine this slope? Slice the graph of fff with a vertical plane
that cuts the xyxyx, y-plane in the direction of \vec{\textbf{v}}vstart bold
text, v, end bold text, with, vector, on top. The slope in question is that of
a line tangent to the resulting curve. As with any slope, we look for the
rise over run.
In this case, the run will be the distance of a small nudge in the direction
of \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on top.
We can express such a nudge as an addition of h\vec{\textbf{v}}hvh,
start bold text, v, end bold text, with, vector, on top to an input
point \textbf{x}_0x0start bold text, x, end bold text, start subscript, 0, end
subscript, where hhh is thought of as some small number. The magnitude
of this nudge is h ||\vec{\textbf{v}}||h∣∣v∣∣h, vertical bar, vertical bar,
start bold text, v, end bold text, with, vector, on top, vertical bar, vertical
bar.
The resulting change in the output of fff can be approximated by
multiplying this little value hhh by the directional derivative:
In fact, the rise of the tangent line—as opposed to the graph of the
function— is precisely h \nabla_{\vec{\textbf{v}}} f(x_0, y_0)h∇vf(x0,y0)h,
del, start subscript, start bold text, v, end bold text, with, vector, on top,
end subscript, f, left parenthesis, x, start subscript, 0, end subscript,
comma, y, start subscript, 0, end subscript, right parenthesis due to this
run of size h ||\vec{\textbf{v}}||h∣∣v∣∣h, vertical bar, vertical bar, start
bold text, v, end bold text, with, vector, on top, vertical bar, vertical bar.
For full details on why this is true, see the formal definition of the
directional derivative in the next article.
\begin{aligned} \dfrac{h\nabla_{\vec{\textbf{v}}}f(x_0,
y_0)}{h||v||} =
\boxed{\dfrac{\nabla_{\vec{\textbf{v}}}f(x_0, y_0)}{||v||}}
\end{aligned}h∣∣v∣∣h∇vf(x0,y0)=∣∣v∣∣∇vf(x0,y0)
Notice, if \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector,
on top is a unit vector, meaning ||\vec{\textbf{v}}|| = 1∣∣v∣∣=1vertical
bar, vertical bar, start bold text, v, end bold text, with, vector, on top,
vertical bar, vertical bar, equals, 1, then the directional
derivative does give the slope of a graph along that direction. Otherwise,
it is important to remember to divide out by the magnitude
of \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on top.
Example 3: Slope
Problem: On the stage for this problem we have three players.
\vec{\textbf{v}} = 2 \hat{\textbf{i}} + 3
\hat{\textbf{j}}v=2i^+3j^start bold text, v, end bold text, with,
vector, on top, equals, 2, start bold text, i, end bold text, with, hat, on top,
plus, 3, start bold text, j, end bold text, with, hat, on top
What is the slope of the graph of fff at the point (x_0, y_0)(x0,y0)left
parenthesis, x, start subscript, 0, end subscript, comma, y, start subscript,
0, end subscript, right parenthesis along the
vector \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on
top?
Answer: Since we are finding slope, we must first normalize the vector
in question. The magnitude ||\vec\textbf{v}||∣∣v∣∣vertical bar, vertical
bar, start bold text, v, end bold text, with, vector, on top, vertical bar,
vertical bar is \sqrt{2^2 + 3^2} = \sqrt{13}22+32=13square root of, 2,
squared, plus, 3, squared, end square root, equals, square root of, 13, end
square root, so we divide each term by \sqrt{13}13square root of, 13,
end square root to get the resulting unit vector \hat{\textbf{u}}u^start
bold text, u, end bold text, with, hat, on top in the direction
of \vec\textbf{v}vstart bold text, v, end bold text, with, vector, on top:
[Show answer.]
Summary
• If you have some multivariable function, f(x, y)f(x,y)f, left parenthesis, x,
comma, y, right parenthesis and some vector in the function's input
space, \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on
top, the directional derivative of fff along \vec{\textbf{v}}vstart bold
text, v, end bold text, with, vector, on top tells you the rate at
which fff will change while the input moves with velocity
vector \vec{\textbf{v}}vstart bold text, v, end bold text, with, vector, on
top.
Our