Local Extrema in Multiple Variables
Just like in one variable, we’re interested in local maxima and minima of a function , where
is an open region in
. Again, we say that
has a local minimum at a point
if there is some neighborhood
of
so that
for all
. A maximum is similarly defined, except that we require
in the neighborhood. As I alluded to recently, we can bring Fermat’s theorem to bear to determine a necessary condition.
Specifically, if we have coordinates on given by a basis
, we can regard
as a function of the
variables
. We can fix
of these variables
for
and let
vary in a neighborhood of
. If
has a local extremum at
, then in particular it has a local extremum along this coordinate line at
. And so we can use Fermat’s theorem to draw conclusions about the derivative of this restricted function at
, which of course is the partial derivative
.
So what can we say? For each variable , the partial derivative
either does not exist or is equal to zero at
. And because the differential subsumes the partial derivatives, if any of them fail to exist the differential must fail to exist as well. On the other hand, if they all exist they’re all zero, and so
as well. Incidentally, we can again make the connection to the usual coverage in a multivariable calculus course by remembering that the gradient
is the vector that corresponds to the linear functional of the differential
. So at a local extremum we must have
.
As was the case with Fermat’s theorem, this provides a necessary, but not a sufficient condition to have a local extremum. Anything that can go wrong in one dimension can be copied here. For instance, we could define . Then we find
, which is zero at
. But any neighborhood of this point will contain points
and
for small enough
, and we see that
, so the origin cannot be a local extremum.
But weirder things can happen. We might ask that have a local minimum at
along any line, like we tried with directional derivatives. But even this can go wrong. If we define
we can calculate
which again is zero at . Along any slanted line through the origin
we find
and so the second derivative is always positive at the origin, except along the -axis. For the vertical line, we find
so along all of these lines we have a local minimum at the origin by the second derivative test. And along the -axis, we have
, which has the origin as a local minimum.
Unfortunately, it’s still not a local minimum in the plane, since any neighborhood of the origin must contain points of the form for small enough
. For these points we find
and so cannot have a local minimum at the origin.
What we’ll do is content ourselves with this analogue and extension of Fermat’s theorem as a necessary condition, and then develop tools that can distinguish the common behaviors near such critical points, analogous to the second derivative test.
Hi John,
Not a comment about this particular post, but I just want to say “Good work”! For a while I’ve wanted to write some “blaths” (to take your terminology; btw, I hope I pluralized correctly, do you perhaps want to “define” the proper declension?) accessible to the lay audience, but I don’t think I came anywhere close to accessible in my handful of attempts.
You on the other hand, chose some nice topics and wrote great expositions.
Cheers,
W
[…] Critical Points So let’s say we’ve got a critical point of a multivariable function . That is, a point where the differential vanishes. We want something […]
Pingback by Classifying Critical Points « The Unapologetic Mathematician | November 24, 2009 |
[…] with Constraints I We can consider the problem of maximizing or minimizing a function, as we have been, but insisting that our solution satisfy some […]
Pingback by Extrema with Constraints I « The Unapologetic Mathematician | November 25, 2009 |
[…] changes if we “wiggle” the path by a little variation , and this should remind us about how to find local minima: they happen when no matter how we change the input, the “first derivative” of the […]
Pingback by The Higgs Mechanism part 1: Lagrangians « The Unapologetic Mathematician | July 16, 2012 |