Iterated Integrals V

Our iterated integrals worked out nicely over -dimensional intervals because these regions are simple products of one-dimensional intervals. When working over more general sets, though, it’s not so nice. Still, we can often do almost as well.

Unlike our earlier approach, though, we won’t peel off an integral from the outside first, but from an inside. That is, instead of writing

we’ll write

Underlying all of these equations is the assumption that each of the integrals we write down exists, or at least the inner ones don’t fail to exist often enough to cause the outer ones to also fail to exist.

Okay, so let’s say that we’ve got some bounded region contained in an -dimensional interval . Just like before, we project into the plane with to get the -dimensional region . This will be contained in the projection of . Again, we write for the remaining variables.

Here’s where our restriction comes in: assume that is contained between the graphs of two integrable functions on . That is, we want

where and are two integrable functions defined on .

Now we can try to evaluate the integral

We first replace by because is identically zero wherever is outside of , and thus so will the whole inner integral. Then we replace the limits of integration for the inner integral by and because for any fixed the function is zero for below the former and above the latter.

If we’re lucky, itself can be written in a similar form, as the region between the graphs of two integrable functions in another coordinate direction, and so on. Each inner integral’s integrand depends on the remaining variables of later integrals, as before. But now the bounds of integration can also depend on later variables, which adds new complication. However, once a given variable has been integrated away, nothing further out ever depends on it again, and so this whole procedure is still well-defined.

Integrals are Additive Over Regions

Before I state today’s proposition, I need to define what I mean by saying that two sets in are “nonoverlapping”. Intuitively, we might think that this means they have no intersection, but that’s not quite it. We’ll allow some intersection, but only at boundary points. Since the regions we’re interested in for integrals are Jordan measurable, and their boundaries have zero Jordan content, so we know changing things along these boundaries in an integral will make no difference.

Let be a collection of bounded regions in , so that any two of these regions are nonoverlapping. We define their union

and let be a bounded function defined on this union. Then is integrable on if and only if it’s integrable on each , and we find

Indeed, if is some -dimensional interval containing , then it will also contain each of the smaller regions , and we can define

and

We can use Lebesgue’s condition to establish our assertion about integrability. On the one hand, the discontinuities of in must be contained within those of , so if the latter set has measure zero then so must the former. On the other hand, the discontinuities of consist of those within each of the , and maybe some along the boundaries. Since the boundaries have measure zero, and we assume that the discontinuities in each are of measure zero, their (countable) union will also have measure zero. And then so must the set of discontinuities of in have measure zero as well.

The inclusion-exclusion principle tells us that we can rewrite the characteristic function of :

We can put this into our integral and use the fact that integrals are additive with respect to finite sums in the integrand

But we assumed that all the are nonoverlapping, so any intersection of two or more of them must lie only along their boundaries. And since these boundaries all have Jordan content zero the integrals over them must come out to zero. We’re left with only the sum over each subregion, as we wanted.

The Mean Value Theorem for Multiple Integrals

As in the single variable case, multiple integrals satisfy a mean value property.

First of all, we should note that, like one-dimensional Riemann-Stieltjes integrals with increasing integrators, integration preserves order. That is, if and are both integrable over a Jordan-measurable set , and if at each point , then we have

This is a simple consequence of the definition of a multiple integral as the limit of Riemann sums, since every Riemann sum for will be smaller than the corresponding sum for .

Now if and are integrable on and for every , then we set and — the infimum and supremum of the values attained by on . I assert that there is some in the interval so that

In particular, we can set and find

giving bounds on the integral in terms of the Jordan content of . Incidentally, here is serving a similar role to the integrator in the integral mean value theorem for Riemann-Stieltjes integrals.

Okay, so since we have for every . Since integration preserves order, this yields

If the integral of is zero, then our result automatically holds for any value of . Otherwise we can divide through by this integral and set

which will be between and .

One particularly useful case is when has Jordan content zero. In this case, we find that any integral over is itself automatically zero.

Inclusion-Exclusion Again

Now that we know a little more about characteristic functions, let’s see how they can be used to understand the inclusion-exclusion principle. Our first pass was through a very categorified lens, which was a neat tie-in to Euler characteristics. But we want something a little more down-to-Earth.

So, let’s take a finite collection of subsets of a set . To each one we have a corresponding idempotent function , which is for points in and elsewhere. We can take the complement of a subset in the language of idempotents as usual: . This function is for points not in , and in .

Now let’s take and multiply all these complementary functions together to get

By DeMorgan’s Laws, the intersection of all these complements is the complement of the union of all the . Thus

Now let’s expand out the product, just like we expand out the product of any sequence of binomials. In each factor, we choose which of the or the to contribute. First we get the term where we always choose , then the terms where we choose exactly one of the , then the terms where we choose exactly two of them, and so on until we choose all of them. The sign of a term is negative when we choose an odd number of the , and positive when we choose an even number. That is

Putting this together with the earlier expression, we find

For this gives us back our formula for the characteristic function of the intersection of two sets. For larger it gives us the inclusion-exclusion principle in terms of characteristic functions.

Characteristic Functions as Idempotents

I just talked about characteristic functions as masks on other functions. Given a function and a subset , we can mask the function to the subset by multiplying it by the characteristic function . I want to talk a little more about these functions and how they relate to set theory.

First of all, it’s easy to recognize a characteristic function when we see one: they’re exactly the idempotent functions. That is, , and if then must be for some set . Indeed, given a real number , we can only have if or . That is, or for every . So we can define to be the set of for which , and then for every . Thus the idempotents in the algebra of real-valued functions on correspond exactly to the subsets of .

We can define two operations on such idempotent functions to make them into a lattice. The easier to define is the meet. Given idempotents and we define the meet to be their product:

This function will take the value at a point if and only if both and do, so this is the characteristic function of the intersection

We might hope that the join would be the sum of two idempotents, but in general this will not be another idempotent. Indeed, we can check:

We have a problem exactly when the corresponding sets have a nonempty intersection, which leads us to think that maybe this has something to do with the inclusion-exclusion principle. We’re “overcounting” the intersection by just adding, so let’s subtract it off to define

We can multiply this out to check its idempotence, or we could consider its values. If is not in , then , and we find — it takes the value if and otherwise. A similar calculation holds if , which leaves only the case when . But now and both take the value , and a quick calculation shows that does as well. This establishes that

We can push further and make this into an orthocomplemented lattice. We define the orthocomplement of an idempotent by

This function is wherever is , and vice-versa. That is, it’s the characteristic function of the complement

So we can take the lattice of subsets of and realize it in the nice, concrete algebra of real-valued functions on . The objects of the lattice are exactly the idempotents of this algebra, and we can build the meet and join from the algebraic operations of addition and multiplication. In fact, we could turn around and do this for any commutative algebra to create a lattice, which would mimic the “lattice of subsets” of some “set”, which emerges from the algebra. This sort of trick is a key insight to quite a lot of modern geometry.

Integrals Over More General Sets

To this point we’ve only discussed multiple integrals over -dimensional intervals. But often we’re interested in more general regions, like circles or ellipsoids or even more rectangular solids that are just tilted with respect to the coordinate axes. How can we handle integrating over these more general sets?

One attempt might be to fill up the region from inside. We can chop up regions into smaller pieces, each of which is an -dimensional interval. But overall this requires an incredibly involved limiting process, and we’ll never get anything calculated that way.

Instead, we come at it from outside. Given a bounded region , we can put it into an -dimensional interval . Then if is a function, we can try to define some sort of integral of over in terms of its integral over .

The obvious problem with is that it includes all the points in that aren’t in , and we don’t want to include the integral of over that region. Worse, what if has a big cluster of discontinuities within but outside of ? Clearly that shouldn’t make fail to be integrable over . What we need is to mask off , like a stencil or masking tape does when painting.

The mask we’ll use is the characteristic function of , which I’ve mentioned before. I’ll actually go more deeply into them in a bit, but for now we’ll recall that the characteristic function of a set is written , and it’s defined as

Now look what happens when we multiply our function by this mask:

Now our function has been redefined outside by setting it equal to zero there. Then we proceed to define

The integral over should be the “integral” over plus the “integral” over the region outside . I put these in quotes because we haven’t really defined what these integrals mean (that’s what we’re trying to do!), but we can make reasonable assertions about properties that they should have, whatever they are.

Now is zero on the outer region, so the second integral is zero. And is just equal to inside , so when “integrating” over itself we may as well just drop the factor. This justifies the definition of integrating over .

It should be clear that this definition doesn’t depend on the interval at all. Indeed, if we have two different intervals and which both contain , then any region the one contains which the other does not must fall outside of , and will be zero there anyway, and so will the difference between their integrals.

Now, this definition isn’t without its problems. The clearest of which is that we’ve almost certainly introduced new discontinuities. All around the boundary of , if wasn’t already zero it suddenly and discontinuously becomes zero when we add our mask. This could cause trouble when trying to integrate the masked function over . We must ask that be Jordan measurable, because this will happen if and only if the boundary has zero Jordan content, and thus zero outer Lebesgue measure. Since the collection of new discontinuities must be contained in this boundary, it will also have measure zero.

This leads us to an integrability criterion over a Jordan measurable set : will be integrable over if and only if the discontinuities of in form a set of measure zero. Indeed, Lebesgue’s condition tells us that the discontinuities of must have measure zero. These discontinuities either come from those of inside , or from the characteristic function at the boundary . By assuming that is Jordan measurable, we force the second kind to have measure zero, and so the total collection of discontinuities will have measure zero and satisfy Lebesgue’s condition if and only if the discontinuities of inside do.

Iterated Integrals IV

So we’ve established that as long as a double integral exists, we can use an iterated integral to evaluate it. What happens when the dimension of our space is even bigger?

In this case, we’re considering integrating an integrable function over some -dimensional interval . We want something like iterated integrals to allow us to evaluate this multiple integral. We’ll do this by peeling off a single integral from the outside and leaving an integral over an -dimensional integral inside.

Specifically, we can project the interval onto the coordinate hyperplane defined by just by leaving the coordinates of each point the same if and setting . We’ll call the resulting interval

where the wide hat means that we just leave out that one factor in the product. We’ll also write to mean the remaining coordinates on .

Essentially, we want to integrate first over , and then let run from to . We have a collection of assertions that parallel those from the two-dimensional case

• 
• 
• If exists, then we have
  

with a copy of these three for each index between and . The proofs of these are pretty much identical to the proofs in the two-dimensional case, and so I’ll just skip them.

Anyhow, once we’ve picked one of the variables and split it off as the outermost integral, we’re left with an -dimensional integral on the inside. We can pick any one of these variables and split it off, leaving an -dimensional integral on the inside, and so on. For each of the orderings of the original variables, we get a way of writing the -dimensional integral over as a sequence of integrals, each over a one-dimensional interval. Now, we may find some of these iterated integrals easier to evaluate than others, but in principle, if each of the -dimensional integrals in the sequence exists it doesn’t matter which of the orderings we use.

So, for example, if we’re considering a bounded function defined on a three-dimensional interval , we can write (up to) six different iterated integrals, assuming that all the integrals in sight exist.

Iterated Integrals III

I recently heard a characterization (if someone remembers the source, please let me know) of the situation in analysis as being that there are no theorems — only conjectures that don’t yet have counterexamples. Today’s counterexample is adapted from one in Apostol’s book, but it’s far simpler than his seems to be.

We might guess that we can always evaluate double integrals by iterated integrals as we’ve been discussing. After all, that’s exactly what we do in multivariable calculus courses as soon as we introduce iterated integrals, never looking back to all those messy double and triple Riemann sums again. Unfortunately, the existence of the iterated integrals — even if both of them exist and their values agree — is not enough to guarantee that the double integral exists. Today, we will see a counterexample.

Let be the set of points in the unit square so that and , where and are two fractions with the same denominator, each of which are in lowest terms. That is, it contains the point , but not the point , since when we write these latter two fractions in lowest terms they are no longer over a common denominator. We will consider the characteristic function , which is on points in and elsewhere in the unit square.

First, I assert that both iterated integrals exist and have the same value. That is

Indeed, the set is symmetric between the two coordinates, so we only need to evaluate one of these iterated integrals and the other one will automatically have the same value.

If is an irrational number in , then there is no at all so that . Thus we can easily calculate the inner integral

On the other hand, if is a rational number, we can write it in lowest terms as . Then there are only a finite number of points having the same denominator at all. Thus we can break the interval into a finite number of pieces, on each of which the characteristic function has the constant value zero. Thus we can calculate the inner integral

And so we see that for any the inner integral evaluates to . Then it’s easy to calculate the outer integral

and, as we said before, the other iterated integral also has the value .

On the other hand, the double integral does not exist. Yes, is countable, and so it has measure zero. However, it’s also dense, which means is discontinuous everywhere in the unit square.

Saying that is dense in the square means that every neighborhood of every point of the square contains some point of . Indeed, consider a point in the square and some radius . Since the real numbers are Archimedean, we can pick some , and as many people on Nick‘s Twitter experiment (remember to follow @DrMathochist!) reminded us, there are infinitely many prime numbers. Thus we can pick a prime . Then we can round up to the next larger fraction of the form , which will be in lowest terms unless , in which case we round down to . Similarly, we can round up (or down) to a fraction in lowest terms. This gives us a new point , and we can calculate the distance

So there is a point in within any radius of .

But now when we try to set up the upper and lower integrals to check Riemann’s condition we find that every subinterval of any partition must contain some points in and some points not in . The points within tell us that the upper sum gets a sample value of for each subinterval, giving a total upper sum of . Meanwhile the points outside of tell us that the lower sum gets a sample value of for each subinterval, giving a total lower sum of . Clearly Riemann’s condition fails to hold, and thus the double integral

fails to exist, despite the iterated integrals existing and agreeing.

Iterated Integrals II

Let’s get to proving the assertions we made last time, starting with

where is a bounded function defined on the rectangle .

We can start by defining

And we easily see that , where is the supremum of on the rectangle , so this is a bounded function as well. Thus the upper integral

and the lower integral

are both well-defined.

Now if is a partition of , and is a partition of , then is a partition of into subrectangles . We will define

Clearly, we have

and so we find

That is

and, similarly

We also define and to be the infimum and supremum of over the rectangle , which gives us the inequalities

and from here we find

Summing on both and , and sing the above inequalities, we get

and since this holds for all partitions , the assertion that we’re trying to prove follows.

The second assertion from last time can be proven similarly, just replacing by the lower integral over . And then the third and fourth assertions are just the same, but interchanging the roles of and . Finally, the last assertion is a consequence of the first four. Indeed, if the integral over exists, then the upper and lower integrals are equal, which collapses all of the inequalities into equalities.

Iterated Integrals I

We may remember from a multivariable calculus class that we can evaluate multiple integrals by using iterated integrals. For example, if is a continuous, nonnegative function on a two-dimensional rectangle then the integral

measures the volume contained between the graph of the function and the - plane within the rectangle. If we fix some constant between and we can calculate the single integral

which describes the area that the plane cuts out of this volume. It exists because because the integrand is continuous as a function of . In such classes, we make the reasonable assumption that as we vary this area varies continuously. This gives us a continuous function on , which will then be integrable:

This is an “iterated integral”, since we perform more than one integral in sequence. We usually leave out the big parens and trust in the notation to tell us when the inner integral is closed. Our handwaving argument then justifies the belief that this iterated integral is the same as the double integral above. And this is true:

but we haven’t really proven it.

Besides, we’re interested in more general situations. What if, say, is discontinuous along the whole line for some fixed ? This line can be contained in an arbitrarily thin rectangle, so it has outer Lebesgue measure zero in the rectangle . If these are the only discontinuities, then is integrable on , but we can’t follow the above prescription anymore, even if it were actually rigorous. We need some method of handling this sort of thing.

To this end, we have five assertions relating the upper and lower single and double integrals involving a function which is defined and bounded on the rectangle above. Unfortunately, our notation for upper and lower integrals gets a little cumbersome here, and the support on WordPress isn’t the most elegant. Still, we soldier on and write

and similarly for upper integrals, and for lower and upper double integrals. Now, our assertions:

• 
• 
• 
• 
• If exists, then we have
  

Okay, as ugly as all those are, they’re what we’ll prove next time.