Metric Spaces
Introduction and Common Metrics
A set and a function of two variables is a metric space if for for all , the following 3 properties are true:
- Non-Negativity: , and if and only if
- Symmetry: ,
- Triangle Inequality: , .
In this case, we call a metric on . Note that a single set could have multiple valid metrics, though there are some metrics that are more commonly used than others.
Note that if is a metric space with metric , then any is also a metric space with metric .
We describe 3 of the most important metric spaces in the below theorems.
Theorem: Common Metric on
For any two real numbers , we have the metric on
The proof for the metric is trivial, as it all follows from properties of absolute values.
Theorem: Common Metric on
For any two points , we have the metric on , otherwise known as the norm,
Like the prior metric, the properties for the norm can be proven fairly easily.
Example: Norms (1)
In , some of the following are examples of norms.
We have the typical norm we are used to, .
But we also have other options for norms! For example,
The proof for the former is trivial. For (3) of the latter, note that
And comparing the norms, we find that
So in finite dimensions, we find that convergence along any one of the norms implies convergence along the others, by squeeze!
This fails to hold in infinite dimenions!
Theorem: Common Metric on
Let be the set of all continuous functions .
For any two functions , we have the metric
This finds the maximum single difference between the functions in the interval !
Remark
In the metric space , with norm
We find that closed and bounded sets need not be sequentially compact.
For example, consider the set , and take sequence in . Then,
Converges pointwise. However, there does not exist a convergent !
Example: Norms (2)
Let be a set of continuous functions on to .
We can define the following norms and verify them. Note that we only verify their triangle inequalities, as the rest is obvious to show.
We define the norm .
We can also define the norm .
We can also define .
Theorem: The Discrete Metric
Let be any set. For any two points , we have metric known as discrete metric
Generalized Metric Space Definitions
With metric spaces, we can generalize many of the definitions we had previously, by using our metric as a “distance” function! In fact, many of our definitions (ex. open sets) were given in terms of the norm .
Let be a metric space.
A sequence is said to converge to a point , if , such that
We call the limit of the sequence . Note that by this definition, we can see that a sequence converges if and only if the real sequence .
We also have the following set definitions:
- For a point , , the set
is the open ball around in .
- is open if , such that .
- is closed if , if , then .
- For , a point is an interior point if where .
Theorem: The Complementing Characterization
Let be a metric space, and . Then, is open if and only if is closed in .
Theorem: Open and Closure of in Itself
Let be a metric space. Then, is open in , and is also closed in !
Theorem: Intersection and Union of Closed / Open Sets
Let be a metric space.
Then,
- The union of a (potentially infinite) collection of open subsets of is open.
- The intersection of a finite collection of open subsets of is open.
Also,
- The union of a finite collection of closed subsets of is closed.
- The intersection of a (potentially infinite) collection of closed subsets of is closed.
Completeness and the Contraction Mapping Principle
Let be a metric space. Then, a sequence is Cauchy if , such that
Theorem: Convergence and Cauchy Sequences
Every convergent sequence is a Cauchy sequence.
Example: Cauchy Sequences in
Consider a sequence . Then, from definition of the metric, is a Cauchy sequence if and only if , such that
Note that this must hold, as the metric takes the maximum difference between the functions.
In other words, is cauchy if and only if it is uniformly cauchy (converges uniformly).
We say metric space is complete, if Cauchy sequence in , such that . In other words, all Cauchy sequences converge to a point in .
Remark
The metric spaces are complete.
Example: Incomplete Space
We can find that and
is not complete.
We form a series of functions that converge to a function that is not continuous (and thus not in our space).
Lets consider where
Then,
If for , for .
So, with respect to the metric, so is Cauchy. However, there does not exist a that is continuous from with real values such that
Theorem: Complete Subspaces
Let be a complete metric space, and a subspace of . Then, is a complete metric space if and only if is a closed subset of .
A corollary from this is that, every closed subset of is a complete metric space (from the previous remark).
Let be a metric space, and be a function. Then, is Lipschitz if such that
For all . In other words, the change in distance between any two points after the mapping is bounded by some value.
Note that the same must work for all pairs.
A Lipschitz function is a contraction if . That is, there exists a such that
Lipschitz Functions on
If differentiable, then is Lipschitz with constant if and only if .
Proof
Proof
If is differentiable and Lipschitz, then by definition of Lipschitz functions, ,
And
So, applying our Lipschitz definition,
Proof
Conversely, if , , then we want to show that ,
As is differentiable, by the mean value theorem, there exists a between such that
We multiply on either side to find our result.
If is a metric space, and is a function, then is called a fixed point if
In other words, the point after being mapped does not change.
With some assumptions on , we can guarantee the existence of a fixed point for a function .
Theorem: The Contraction Mapping Principle
Let be a complete metric space, and suppose is a contraction. Then, has exactly one fixed point.
Proof
Proof (Uniqueness)
Say , and . By contraction, we find a such that
This is only possible if .
Proof (Existence)
Start with any . Let . We show that the sequence of points is Cauchy, thus there exists a where , and .
First, look at the distance between adjacent terms in the sequence.
Thus, we find that
Thus, our sequence is Cauchy!
Bringing it Together
Let . We show that .
We essentially show that is continuous, so that if , then .
By squeeze. So, .
We know that , and , so by the uniqueness of limits.
Note that by this, Lipschitz functions are essentially a stronger form of continuity!
Example: The Contraction Mapping Principle
Let . Let be given as
Part 1
Show that maps onto .
Take any . We wish to show that .
And furthermore, because ,
So, , meaning !
Part 2
Is a contraction?
Take any . To show that is a contraction, we wish to show that for some ,
We find ! So, is a contraction.
Part 3
Write down a fixed point of .
For a fixed point of ,
This gives us system
Which has a solution of . is a fixed point of our system!
This theorem is quite important in differential equations!
The Existence Theorem for Nonlinear Differential Equations
Let be an open interval of real numbers, . Then, for and a function , consider the differential system.
We ask, does there exist a differentiable function that satisfies the above differential equation?
Previously, we established that given continuous, there does exist an , and this is unique with formula
Now, we consider much more general differential systems.
Suppose is an open subset of , and let . Also suppose that we have a continuous function .
Let be an interval in , and define the function such that the set of inputs/outputs is contained within .
We ask, can we find this interval containing , and a differentiable function satisfying
Note how now, the derivative of our is given in terms of as well!
We use this setup from here on.
Lemma: The Equivalence Lemma
Let be an open subset of with the point , and suppose we have continuous.
If is a neighborhood of the point , and has the property that for all , then the following two are equivalent:
The function is differentiable and is a solution of the differential equation
The function is continuous and is a solution of the integral equation
Proof
Proof
Assume (1). Then, differentiable implies continuous, and because (a composition of continuous functions), is also continuous. So, by the fundamental theorem of calculus, we find
Which is formula 2.
Proof
Assume (2). Since , and is continuous (as remarked earlier), we know the integral of a continuous function is differentiable. So, is differentiable, and
Also, can be obtained as .
Let’s define a function as the equation in point 2 of the equivalence lemma.
Using this function , with an additional constraint on , we can guarantee the existence of a unique solution for our system! This is known as the Existence and Uniqueness Theorem.
Theorem: Existence and Uniqueness
Let be an open subset of the plane that contains the point . Suppose that the function is continuous.
Now, assume an additional constraint, that such that ,
Then, there is an open interval with such that the differential equation
Has exactly one solution.
Proof: Existence and Uniqueness
Because is open, we can choose numbers such that the box of width , height centered around is contained within .
For some positive number , let be the closed interval , and define
Or in other words, the set of all continuous functions along our interval . Note that the domain and image of these functions are contained within our box by assumption.
For a function , we define the function in as
We now prove two conditions:
- maps the space to itself
- is a contraction
Then, by the Contraction Mapping Principle, we have a unique fixed point.
Because we is continuous on a compact set, we know that such that for all in our box .
Then, if , and (so ), we have
So, if , the range of our function is bounded between , meaning . We choose small enough to make this happen.
is a Contraction
We now show that is a contraction provided is sufficiently small. We want
Where is the uniform metric.
So, we found that
As is fixed, and we can determine , we make as small as we want! So, provided that , we have a contraction.
Thus, by the Contraction Mapping Principle, there is exactly one fixed point for . In other words, there exists a unique such that .
This is a really important proof!
Note that there are many constraints that this theorem assumes in order for our result to hold; below, we address some common misconceptions.
Remark: Failure of Uniqueness
There are examples of continuous for which uniqueness fails. Consider
Then, we can find the following solutions that are non-unique.
In fact, we can find any solution of the form
And find that in fact, our initial problem fails the Lipschitz condition, as for , is unbounded as .
Remark: Existence is a Local Property
Consider system
Note that one solution to this is , which only works for .
Remark 3
Let , and assume that
For some , and for all .
If , , and , , then for all .
Proof
Look at . We find that
Thus, , .
Because is monotonically decreasing, and it is 0 at , and for all , we know that
Which forces .
Proof (2)
Let differentiable, satisfying
And . Also assume the Lipschitz condition
From our main theorem, such that .We wish to show that this holds for all .
Look at the set . We find that
- Because are continuous, then is closed!
- is open. Let . Thus, , and there exists a such that , by from the local uniqueness theorem applied to .
Because is open and closed, the only set that satisfies this is the empty set, or the entire space! Because , we find that must be the entire space.