The Unapologetic Mathematician

Mathematics for the interested outsider

Higher-Order Differentials

Just like we assembled partial derivatives into the differential of a function, so we can assemble higher partial derivatives into higher-order differentials. The differential measures how the function itself changes as we move around, and the higher differentials will measure how lower differentials change.

First let’s look at the second-order differential of a real-valued function f of n variables x^i. We’ll use the dx^i as a basis for the space of differentials, which allows us to write out the components of the differential:

\displaystyle df(x)=\frac{\partial f}{\partial x^i}dx^i

So, just as we did for vector-valued functions, we’ll just take the differentials of each of these components separately, and then cobble them together.

\displaystyle d\left[df\right](x)=\left(d\frac{\partial f}{\partial x^i}\right)dx^i=\left(\frac{\partial^2 f}{\partial x^j\partial x^i}dx^j\right)dx^i

Now this second displacement may have nothing to do with the first, but it should be the same for all components. That is, we could write out the second differential as a function of not only the point x but of two displacements t_1 and t_2 from the point:

\displaystyle d^2f(x;t_1,t_2)=\frac{\partial^2 f}{\partial x^j\partial x^i}t_1^it_2^j

Commonly we’ll collapse this into a function of a point and a single displacement. We just put the same vector t in for both t_1 and t_2

\displaystyle d^2f(x;t)=\frac{\partial^2 f}{\partial x^j\partial x^i}t^it^j

Unfortunately, these higher differentials are more complicated than our first-order derivatives. In particular, they don’t obey anything like Cauchy’s invariant rule, meaning they don’t transform well when we compose functions. As an example, let’s go back and look at the polar coordinate transform again:

\displaystyle\begin{aligned}x&=r\cos(\theta)\\y&=r\sin(\theta)\end{aligned}

We’ve seen how we can use Cauchy’s invariant rule to rewrite differentials:

\displaystyle\begin{aligned}dx&=\cos(\theta)dr-r\sin(\theta)d\theta\\dy&=\sin(\theta)dr+r\cos(\theta)d\theta\end{aligned}

We can also invert the transformation and rewrite differential operators:

\displaystyle\begin{aligned}\frac{\partial f}{\partial x}&=\cos(\theta)\frac{\partial f}{\partial r}-\frac{\sin(\theta)}{r}\frac{\partial f}{\partial\theta}\\\frac{\partial f}{\partial y}&=\sin(\theta)\frac{\partial f}{\partial r}+\frac{\cos(\theta)}{r}\frac{\partial f}{\partial\theta}\end{aligned}

So let’s take our second-order differential

\displaystyle d^2f=\left(\frac{\partial}{\partial x}\frac{\partial}{\partial x}f\right)(dx)^2+\left(\frac{\partial}{\partial x}\frac{\partial}{\partial y}f\right)(dx)(dy)+\left(\frac{\partial}{\partial y}\frac{\partial}{\partial x}f\right)(dy)(dx)+\left(\frac{\partial}{\partial y}\frac{\partial}{\partial y}f\right)(dy)^2

and try to rewrite it. The nasty bit is working out all these second-order partial derivatives in terms of r and \theta.

\displaystyle\begin{aligned}\frac{\partial}{\partial x}\frac{\partial}{\partial x}f=&\left[\cos(\theta)\frac{\partial}{\partial r}-\frac{\sin(\theta)}{r}\frac{\partial}{\partial\theta}\right]\left(\cos(\theta)\frac{\partial f}{\partial r}-\frac{\sin(\theta)}{r}\frac{\partial f}{\partial\theta}\right)\\=&\cos(\theta)\frac{\partial}{\partial r}\left(\cos(\theta)\frac{\partial f}{\partial r}-\frac{\sin(\theta)}{r}\frac{\partial f}{\partial\theta}\right)-\frac{\sin(\theta)}{r}\frac{\partial}{\partial\theta}\left(\cos(\theta)\frac{\partial f}{\partial r}-\frac{\sin(\theta)}{r}\frac{\partial f}{\partial\theta}\right)\\=&\left(\cos(\theta)^2\frac{\partial^2f}{\partial r^2}+\frac{\cos(\theta)\sin(\theta)}{r^2}\frac{\partial f}{\partial\theta}-\frac{\cos(\theta)\sin(\theta)}{r}\frac{\partial^2f}{\partial r\partial\theta}\right)\\&+\left(\frac{\sin(\theta)^2}{r}\frac{\partial f}{\partial r}-\frac{\sin(\theta)\cos(\theta)}{r}\frac{\partial^2f}{\partial\theta\partial r}+\frac{\sin(\theta)\cos(\theta)}{r^2}\frac{\partial f}{\partial\theta}+\frac{\sin(\theta)^2}{r^2}\frac{\partial^2f}{\partial\theta^2}\right)\\=&\cos(\theta)^2\frac{\partial^2f}{\partial r^2}-2\frac{\cos(\theta)\sin(\theta)}{r}\frac{\partial^2f}{\partial r\partial\theta}+\frac{\sin(\theta)^2}{r^2}\frac{\partial^2f}{\partial\theta^2}\\&+\frac{\sin(\theta)^2}{r}\frac{\partial f}{\partial r}+2\frac{\cos(\theta)\sin(\theta)}{r^2}\frac{\partial f}{\partial\theta}\end{aligned}

\displaystyle\begin{aligned}\frac{\partial}{\partial x}\frac{\partial}{\partial y}f=\frac{\partial}{\partial y}\frac{\partial}{\partial x}f=&\cos(\theta)\sin(\theta)\frac{\partial^2f}{\partial r^2}+\frac{\cos(\theta)^2-\sin(\theta)^2}{r}\frac{\partial^2f}{\partial r\partial\theta}-\frac{\sin(\theta)\cos(\theta)}{r^2}\frac{\partial^2f}{\partial\theta^2}\\&-\frac{\sin(\theta)\cos(\theta)}{r}\frac{\partial f}{\partial r}+\frac{\sin(\theta)^2-\cos(\theta)^2}{r^2}\frac{\partial f}{\partial\theta}\end{aligned}

\displaystyle\begin{aligned}\frac{\partial}{\partial y}\frac{\partial}{\partial y}f=&\sin(\theta)^2\frac{\partial^2f}{\partial r^2}+2\frac{\sin(\theta)\cos(\theta)}{r}\frac{\partial^2f}{\partial r\partial\theta}+\frac{\cos(\theta)^2}{r^2}\frac{\partial^2f}{\partial\theta^2}\\&+\frac{\cos(\theta)^2}{r}\frac{\partial f}{\partial r}-2\frac{\cos(\theta)\sin(\theta)}{r^2}\frac{\partial f}{\partial\theta}\end{aligned}

After that it’s no trouble at all to transform the differential terms

\displaystyle\begin{aligned}(dx)^2&=\cos(\theta)^2(dr)^2-2r\sin(\theta)\cos(\theta)(dr)(d\theta)+r^2\sin(\theta)^2(d\theta)^2\\(dx)(dy)=(dy)(dx)&=\cos(\theta)\sin(\theta)(dr)^2+r(\cos(\theta)^2-\sin(\theta)^2)(dr)(d\theta)-r^2\sin(\theta)\cos(\theta)(d\theta)^2\\(dy)^2&=\sin(\theta)^2(dr)^2+2r\sin(\theta)\cos(\theta)(dr)(d\theta)+r^2\cos(\theta)^2(d\theta)^2\end{aligned}

Let’s just work out the component that goes with (d\theta)^2 when we put these all together

\displaystyle\begin{aligned}\left(r^2\cos(\theta)^2\sin(\theta)^2-2r^2\cos(\theta)^2\sin(\theta)^2+r^2\cos(\theta)^2\sin(\theta)^2\right)&\frac{\partial^2f}{\partial r^2}\\+\left(-2r\cos(\theta)\sin(\theta)^3+2r(\cos(\theta)\sin(\theta)^3-\cos(\theta)^3\sin(\theta))+2r\cos(\theta)^3\sin(\theta)\right)&\frac{\partial^2f}{\partial r\partial\theta}\\+\left(\sin(\theta)^4+2\cos(\theta)^2\sin(\theta)^2+\cos(\theta)^4\right)&\frac{\partial^2f}{\partial\theta^2}\\+\left(r\sin(\theta)^4+2r\sin(\theta)^2\cos(\theta)^2+r\cos(\theta)^4\right)&\frac{\partial f}{\partial r}\\+\left(2\cos(\theta)\sin(\theta)^3+2(\cos(\theta)^3\sin(\theta)-\cos(\theta)\sin(\theta)^3)-2\cos(\theta)^3\sin(\theta)\right)&\frac{\partial f}{\partial\theta}\\=&\frac{\partial^2f}{\partial\theta^2}+r\frac{\partial f}{\partial r}\end{aligned}

Which has an extraneous term! If an invariance rule held, we should just get \frac{\partial^2f}{\partial\theta^2}.

The difference comes from the way that the differential operators themselves change as we move our point around. Increasing \theta by a little bit means something different at the point (x,y)=(1,0) than it does at the point (x,y)=(0,1). This doesn’t really matter when we’re talking about first-order differentials because we’re never putting two differential operators together, and so we never get any measurement of how an operator changes from point to point. We will eventually learn how to compensate for this effect, but that will wait until we have a significantly more general approach.

October 16, 2009 - Posted by | Analysis, Calculus

4 Comments »

  1. […] Differentials and Composite Functions Last time we saw an example of what can go wrong when we try to translate higher differentials the way we did […]

    Pingback by Higher Differentials and Composite Functions « The Unapologetic Mathematician | October 19, 2009 | Reply

  2. […] the mixed second partials are equal, since they’re both continuous, and we can define the second differential. These functions form a subalgebra of (and thus a further subalgebra of ) which we write as . […]

    Pingback by Smoothness « The Unapologetic Mathematician | October 21, 2009 | Reply

  3. […] analogue of the second derivative for multivariable functions is the second differential . This function assigns to every point a bilinear function of two displacement vectors and , and […]

    Pingback by Classifying Critical Points « The Unapologetic Mathematician | November 24, 2009 | Reply

  4. […] to itself to be differentiable, and for that differential to be continuous, and for there to be a second differential, and so on. We even introduced classes of functions to describe this whole tower, where consists […]

    Pingback by Classes of Manifolds « The Unapologetic Mathematician | February 25, 2011 | Reply


Leave a reply to Higher Differentials and Composite Functions « The Unapologetic Mathematician Cancel reply

« Previous | Next »