Iterated Integrals V
Our iterated integrals worked out nicely over -dimensional intervals because these regions are simple products of one-dimensional intervals. When working over more general sets, though, it’s not so nice. Still, we can often do almost as well.
Unlike our earlier approach, though, we won’t peel off an integral from the outside first, but from an inside. That is, instead of writing
we’ll write
Underlying all of these equations is the assumption that each of the integrals we write down exists, or at least the inner ones don’t fail to exist often enough to cause the outer ones to also fail to exist.
Okay, so let’s say that we’ve got some bounded region contained in an
-dimensional interval
. Just like before, we project
into the plane with
to get the
-dimensional region
. This will be contained in the projection
of
. Again, we write
for the remaining
variables.
Here’s where our restriction comes in: assume that is contained between the graphs of two integrable functions on
. That is, we want
where and
are two integrable functions defined on
.
Now we can try to evaluate the integral
We first replace by
because
is identically zero wherever
is outside of
, and thus so will the whole inner integral. Then we replace the limits of integration for the inner integral by
and
because for any fixed
the function
is zero for
below the former and above the latter.
If we’re lucky, itself can be written in a similar form, as the region between the graphs of two integrable functions in another coordinate direction, and so on. Each inner integral’s integrand depends on the remaining variables of later integrals, as before. But now the bounds of integration can also depend on later variables, which adds new complication. However, once a given variable has been integrated away, nothing further out ever depends on it again, and so this whole procedure is still well-defined.
Integrals are Additive Over Regions
Before I state today’s proposition, I need to define what I mean by saying that two sets in are “nonoverlapping”. Intuitively, we might think that this means they have no intersection, but that’s not quite it. We’ll allow some intersection, but only at boundary points. Since the regions we’re interested in for integrals are Jordan measurable, and their boundaries have zero Jordan content, so we know changing things along these boundaries in an integral will make no difference.
Let be a collection of bounded regions in
, so that any two of these regions are nonoverlapping. We define their union
and let be a bounded function defined on this union. Then
is integrable on
if and only if it’s integrable on each
, and we find
Indeed, if is some
-dimensional interval containing
, then it will also contain each of the smaller regions
, and we can define
and
We can use Lebesgue’s condition to establish our assertion about integrability. On the one hand, the discontinuities of in
must be contained within those of
, so if the latter set has measure zero then so must the former. On the other hand, the discontinuities of
consist of those within each of the
, and maybe some along the boundaries. Since the boundaries have measure zero, and we assume that the discontinuities in each
are of measure zero, their (countable) union will also have measure zero. And then so must the set of discontinuities of
in
have measure zero as well.
The inclusion-exclusion principle tells us that we can rewrite the characteristic function of :
We can put this into our integral and use the fact that integrals are additive with respect to finite sums in the integrand
But we assumed that all the are nonoverlapping, so any intersection of two or more of them must lie only along their boundaries. And since these boundaries all have Jordan content zero the integrals over them must come out to zero. We’re left with only the sum over each subregion, as we wanted.
The Mean Value Theorem for Multiple Integrals
As in the single variable case, multiple integrals satisfy a mean value property.
First of all, we should note that, like one-dimensional Riemann-Stieltjes integrals with increasing integrators, integration preserves order. That is, if and
are both integrable over a Jordan-measurable set
, and if
at each point
, then we have
This is a simple consequence of the definition of a multiple integral as the limit of Riemann sums, since every Riemann sum for will be smaller than the corresponding sum for
.
Now if and
are integrable on
and
for every
, then we set
and
— the infimum and supremum of the values attained by
on
. I assert that there is some
in the interval
so that
In particular, we can set and find
giving bounds on the integral in terms of the Jordan content of . Incidentally,
here is serving a similar role to the integrator
in the integral mean value theorem for Riemann-Stieltjes integrals.
Okay, so since we have
for every
. Since integration preserves order, this yields
If the integral of is zero, then our result automatically holds for any value of
. Otherwise we can divide through by this integral and set
which will be between and
.
One particularly useful case is when has Jordan content zero. In this case, we find that any integral over
is itself automatically zero.
Inclusion-Exclusion Again
Now that we know a little more about characteristic functions, let’s see how they can be used to understand the inclusion-exclusion principle. Our first pass was through a very categorified lens, which was a neat tie-in to Euler characteristics. But we want something a little more down-to-Earth.
So, let’s take a finite collection of subsets of a set
. To each one we have a corresponding idempotent function
, which is
for points in
and
elsewhere. We can take the complement of a subset in the language of idempotents as usual:
. This function is
for points not in
, and
in
.
Now let’s take and multiply all these complementary functions together to get
By DeMorgan’s Laws, the intersection of all these complements is the complement of the union of all the . Thus
Now let’s expand out the product, just like we expand out the product of any sequence of binomials. In each factor, we choose which of the or the
to contribute. First we get the term where we always choose
, then the terms where we choose exactly one of the
, then the terms where we choose exactly two of them, and so on until we choose all
of them. The sign of a term is negative when we choose an odd number of the
, and positive when we choose an even number. That is
Putting this together with the earlier expression, we find
For this gives us back our formula for the characteristic function of the intersection of two sets. For larger
it gives us the inclusion-exclusion principle in terms of characteristic functions.
Characteristic Functions as Idempotents
I just talked about characteristic functions as masks on other functions. Given a function and a subset
, we can mask the function
to the subset
by multiplying it by the characteristic function
. I want to talk a little more about these functions and how they relate to set theory.
First of all, it’s easy to recognize a characteristic function when we see one: they’re exactly the idempotent functions. That is, , and if
then
must be
for some set
. Indeed, given a real number
, we can only have
if
or
. That is,
or
for every
. So we can define
to be the set of
for which
, and then
for every
. Thus the idempotents in the algebra of real-valued functions on
correspond exactly to the subsets of
.
We can define two operations on such idempotent functions to make them into a lattice. The easier to define is the meet. Given idempotents and
we define the meet to be their product:
This function will take the value at a point
if and only if both
and
do, so this is the characteristic function of the intersection
We might hope that the join would be the sum of two idempotents, but in general this will not be another idempotent. Indeed, we can check:
We have a problem exactly when the corresponding sets have a nonempty intersection, which leads us to think that maybe this has something to do with the inclusion-exclusion principle. We’re “overcounting” the intersection by just adding, so let’s subtract it off to define
We can multiply this out to check its idempotence, or we could consider its values. If is not in
, then
, and we find
— it takes the value
if
and
otherwise. A similar calculation holds if
, which leaves only the case when
. But now
and
both take the value
, and a quick calculation shows that
does as well. This establishes that
We can push further and make this into an orthocomplemented lattice. We define the orthocomplement of an idempotent by
This function is wherever
is
, and vice-versa. That is, it’s the characteristic function of the complement
So we can take the lattice of subsets of and realize it in the nice, concrete algebra of real-valued functions on
. The objects of the lattice are exactly the idempotents of this algebra, and we can build the meet and join from the algebraic operations of addition and multiplication. In fact, we could turn around and do this for any commutative algebra to create a lattice, which would mimic the “lattice of subsets” of some “set”, which emerges from the algebra. This sort of trick is a key insight to quite a lot of modern geometry.
Integrals Over More General Sets
To this point we’ve only discussed multiple integrals over -dimensional intervals. But often we’re interested in more general regions, like circles or ellipsoids or even more rectangular solids that are just tilted with respect to the coordinate axes. How can we handle integrating over these more general sets?
One attempt might be to fill up the region from inside. We can chop up regions into smaller pieces, each of which is an -dimensional interval. But overall this requires an incredibly involved limiting process, and we’ll never get anything calculated that way.
Instead, we come at it from outside. Given a bounded region , we can put it into an
-dimensional interval
. Then if
is a function, we can try to define some sort of integral of
over
in terms of its integral over
.
The obvious problem with is that it includes all the points in
that aren’t in
, and we don’t want to include the integral of
over that region. Worse, what if
has a big cluster of discontinuities within
but outside of
? Clearly that shouldn’t make
fail to be integrable over
. What we need is to mask off
, like a stencil or masking tape does when painting.
The mask we’ll use is the characteristic function of , which I’ve mentioned before. I’ll actually go more deeply into them in a bit, but for now we’ll recall that the characteristic function of a set
is written
, and it’s defined as
Now look what happens when we multiply our function by this mask:
Now our function has been redefined outside by setting it equal to zero there. Then we proceed to define
The integral over should be the “integral” over
plus the “integral” over the region
outside
. I put these in quotes because we haven’t really defined what these integrals mean (that’s what we’re trying to do!), but we can make reasonable assertions about properties that they should have, whatever they are.
Now is zero on the outer region, so the second integral is zero. And
is just equal to
inside
, so when “integrating” over
itself we may as well just drop the
factor. This justifies the definition of integrating over
.
It should be clear that this definition doesn’t depend on the interval at all. Indeed, if we have two different intervals
and
which both contain
, then any region the one contains which the other does not must fall outside of
, and
will be zero there anyway, and so will the difference between their integrals.
Now, this definition isn’t without its problems. The clearest of which is that we’ve almost certainly introduced new discontinuities. All around the boundary of , if
wasn’t already zero it suddenly and discontinuously becomes zero when we add our mask. This could cause trouble when trying to integrate the masked function over
. We must ask that
be Jordan measurable, because this will happen if and only if the boundary
has zero Jordan content, and thus zero outer Lebesgue measure. Since the collection of new discontinuities must be contained in this boundary, it will also have measure zero.
This leads us to an integrability criterion over a Jordan measurable set :
will be integrable over
if and only if the discontinuities of
in
form a set of measure zero. Indeed, Lebesgue’s condition tells us that the discontinuities of
must have measure zero. These discontinuities either come from those of
inside
, or from the characteristic function
at the boundary
. By assuming that
is Jordan measurable, we force the second kind to have measure zero, and so the total collection of discontinuities will have measure zero and satisfy Lebesgue’s condition if and only if the discontinuities of
inside
do.
Iterated Integrals IV
So we’ve established that as long as a double integral exists, we can use an iterated integral to evaluate it. What happens when the dimension of our space is even bigger?
In this case, we’re considering integrating an integrable function over some
-dimensional interval
. We want something like iterated integrals to allow us to evaluate this multiple integral. We’ll do this by peeling off a single integral from the outside and leaving an integral over an
-dimensional integral inside.
Specifically, we can project the interval onto the coordinate hyperplane defined by
just by leaving the coordinates
of each point
the same if
and setting
. We’ll call the resulting interval
where the wide hat means that we just leave out that one factor in the product. We’ll also write to mean the remaining coordinates on
.
Essentially, we want to integrate first over , and then let
run from
to
. We have a collection of assertions that parallel those from the two-dimensional case
- If
exists, then we have
with a copy of these three for each index between
and
. The proofs of these are pretty much identical to the proofs in the two-dimensional case, and so I’ll just skip them.
Anyhow, once we’ve picked one of the variables and split it off as the outermost integral, we’re left with an
-dimensional integral on the inside. We can pick any one of these variables and split it off, leaving an
-dimensional integral on the inside, and so on. For each of the
orderings of the original
variables, we get a way of writing the
-dimensional integral over
as a sequence of
integrals, each over a one-dimensional interval. Now, we may find some of these iterated integrals easier to evaluate than others, but in principle, if each of the
-dimensional integrals in the sequence exists it doesn’t matter which of the orderings we use.
So, for example, if we’re considering a bounded function defined on a three-dimensional interval
, we can write (up to) six different iterated integrals, assuming that all the integrals in sight exist.
Iterated Integrals III
I recently heard a characterization (if someone remembers the source, please let me know) of the situation in analysis as being that there are no theorems — only conjectures that don’t yet have counterexamples. Today’s counterexample is adapted from one in Apostol’s book, but it’s far simpler than his seems to be.
We might guess that we can always evaluate double integrals by iterated integrals as we’ve been discussing. After all, that’s exactly what we do in multivariable calculus courses as soon as we introduce iterated integrals, never looking back to all those messy double and triple Riemann sums again. Unfortunately, the existence of the iterated integrals — even if both of them exist and their values agree — is not enough to guarantee that the double integral exists. Today, we will see a counterexample.
Let be the set of points
in the unit square
so that
and
, where
and
are two fractions with the same denominator, each of which are in lowest terms. That is, it contains the point
, but not the point
, since when we write these latter two fractions in lowest terms they are no longer over a common denominator. We will consider the characteristic function
, which is
on points in
and
elsewhere in the unit square.
First, I assert that both iterated integrals exist and have the same value. That is
Indeed, the set is symmetric between the two coordinates, so we only need to evaluate one of these iterated integrals and the other one will automatically have the same value.
If is an irrational number in
, then there is no
at all so that
. Thus we can easily calculate the inner integral
On the other hand, if is a rational number, we can write it in lowest terms as
. Then there are only a finite number of points
having the same denominator at all. Thus we can break the interval
into a finite number of pieces, on each of which the characteristic function has the constant value zero. Thus we can calculate the inner integral
And so we see that for any the inner integral evaluates to
. Then it’s easy to calculate the outer integral
and, as we said before, the other iterated integral also has the value .
On the other hand, the double integral does not exist. Yes, is countable, and so it has measure zero. However, it’s also dense, which means
is discontinuous everywhere in the unit square.
Saying that is dense in the square means that every neighborhood of every point of the square contains some point of
. Indeed, consider a point
in the square and some radius
. Since the real numbers are Archimedean, we can pick some
, and as many people on Nick‘s Twitter experiment (remember to follow @DrMathochist!) reminded us, there are infinitely many prime numbers. Thus we can pick a prime
. Then we can round
up to the next larger fraction of the form
, which will be in lowest terms unless
, in which case we round
down to
. Similarly, we can round
up (or down) to a fraction
in lowest terms. This gives us a new point
, and we can calculate the distance
So there is a point in within any radius
of
.
But now when we try to set up the upper and lower integrals to check Riemann’s condition we find that every subinterval of any partition must contain some points in
and some points not in
. The points within
tell us that the upper sum gets a sample value of
for each subinterval, giving a total upper sum of
. Meanwhile the points outside of
tell us that the lower sum gets a sample value of
for each subinterval, giving a total lower sum of
. Clearly Riemann’s condition fails to hold, and thus the double integral
fails to exist, despite the iterated integrals existing and agreeing.
Iterated Integrals II
Let’s get to proving the assertions we made last time, starting with
where is a bounded function defined on the rectangle
.
We can start by defining
And we easily see that , where
is the supremum of
on the rectangle
, so this is a bounded function as well. Thus the upper integral
and the lower integral
are both well-defined.
Now if is a partition of
, and
is a partition of
, then
is a partition of
into
subrectangles
. We will define
Clearly, we have
and so we find
That is
and, similarly
We also define and
to be the infimum and supremum of
over the rectangle
, which gives us the inequalities
and from here we find
Summing on both and
, and sing the above inequalities, we get
and since this holds for all partitions , the assertion that we’re trying to prove follows.
The second assertion from last time can be proven similarly, just replacing by the lower integral over
. And then the third and fourth assertions are just the same, but interchanging the roles of
and
. Finally, the last assertion is a consequence of the first four. Indeed, if the integral over
exists, then the upper and lower integrals are equal, which collapses all of the inequalities into equalities.
Iterated Integrals I
We may remember from a multivariable calculus class that we can evaluate multiple integrals by using iterated integrals. For example, if is a continuous, nonnegative function on a two-dimensional rectangle
then the integral
measures the volume contained between the graph of the function and the
–
plane within the rectangle. If we fix some constant
between
and
we can calculate the single integral
which describes the area that the plane cuts out of this volume. It exists because because the integrand is continuous as a function of
. In such classes, we make the reasonable assumption that as we vary
this area varies continuously. This gives us a continuous function on
, which will then be integrable:
This is an “iterated integral”, since we perform more than one integral in sequence. We usually leave out the big parens and trust in the notation to tell us when the inner integral is closed. Our handwaving argument then justifies the belief that this iterated integral is the same as the double integral above. And this is true:
but we haven’t really proven it.
Besides, we’re interested in more general situations. What if, say, is discontinuous along the whole line
for some fixed
? This line can be contained in an arbitrarily thin rectangle, so it has outer Lebesgue measure zero in the rectangle
. If these are the only discontinuities, then
is integrable on
, but we can’t follow the above prescription anymore, even if it were actually rigorous. We need some method of handling this sort of thing.
To this end, we have five assertions relating the upper and lower single and double integrals involving a function which is defined and bounded on the rectangle
above. Unfortunately, our notation for upper and lower integrals gets a little cumbersome here, and the
support on WordPress isn’t the most elegant. Still, we soldier on and write
and similarly for upper integrals, and for lower and upper double integrals. Now, our assertions:
- If
exists, then we have
Okay, as ugly as all those are, they’re what we’ll prove next time.