Adjoint Transformations
Since an inner product on a finite-dimensional vector space is a bilinear form, it provides two isomorphisms from
to its dual
. And since an inner product is a symmetric bilinear form, these two isomorphisms are identical. But since duality is a (contravariant) functor, we have a dual transformation
for every linear transformation
. So what happens when we put these two together?
Say we start with linear transformation . We’ll build up a transformation from
to
which we’ll call the “adjoint” to
. First we have the isomorphism
. Then we follow this with the dual transformation
. Finally, we use the isomorphism
. We’ll write
for this composite, and rely on context to tell us whether we mean the dual or the adjoint (but because of the isomorphisms they’re secretly the same thing).
So why is this the adjoint? Let’s say we have vectors and
. Then it turns out that
which should recall the relation between two adjoint functors. An important difference here is that there is no distinction between left- and right-adjoint transformations. The adjoint of an adjoint is the original transformation back again: . This follows if we use the symmetry of the inner products on the relation above
Then since and the inner product on
is nondegenerate, we must have
sending every
to the zero vector in
. Thus
.
So let’s show this adjoint condition in the first place. On the left side, we have the result of applying the linear functional to the vector
. But this linear functional is simply the image of the vector
under the isomorphism
. So on the left, we’ve calculated the result of first applying
to
, and then applying this linear functional.
But the way we defined the dual transformation was such that we can instead apply the dual to the linear functional
, and then apply the resulting functional to
, and we’ll get the same result. And the isomorphism
tells us that there is some vector in
so that the linear functional we’re now applying to
is
. That is, our value will be
for some vector
. Which one? The one we defined as
.
I’ll admit that it sometimes takes a little getting used to the way adjoints and duals are the same, and also the subtleties of how they’re distinct. But it sinks in soon enough.
Testing
If all goes according to plan, a link to this post should show up on my Twitter feed shortly. Thanks to twitterfeed.
