Week 4 Discussion Notes

Table of Contents

Homework Comments

Giving Examples

When a problem asks you to give an example of something, you need to prove that your example works! For example, one of the problem asked you to find open sets AnRA_n \subseteq \R such that n=1An\bigcap_{n=1}^\infty A_n is neither open nor closed. Many of you just wrote

An=(0,1+1n)    n=1An=(0,1]A_n = \p{0, 1 + \frac{1}{n}} \implies \bigcap_{n=1}^\infty A_n = \poc{0, 1}

and left it at that. I wanted to have seen proof that the intersection is what you said it was, like the following:

"\supseteq"

Note that (0,1]An\poc{0, 1} \subseteq A_n for all n1n \geq 1, so by definition, (0,1]n=1An\poc{0, 1} \subseteq \bigcap_{n=1}^\infty A_n.

"\subseteq"

Let xn=1Anx \in \bigcap_{n=1}^\infty A_n. By definition, this means that 0<x<1+1n0 < x < 1 + \frac{1}{n}. Since all limits as nn\to\infty exist, we get

0<xlimn(1+1n)=1    x(0,1],0 < x \leq \lim_{n\to\infty} \p{1 + \frac{1}{n}} = 1 \iff x \in \poc{0, 1},

so the two sets are equal.

Limit Laws

I saw a very common error while grading the problem about equivalent metrics:

Example 1.

Let c>0c > 0, and assume {an}n,{bn}n\set{a_n}_n, \set{b_n}_n are sequences such that

0canbnandlimnbn=0.0 \leq ca_n \leq b_n \quad\text{and}\quad \lim_{n\to\infty} b_n = 0.

The following argument is wrong:

limncan=limnbn=0(squeeze theorem)    climnan=0(limit law)    limnan=0.\begin{aligned} \lim_{n\to\infty} ca_n = \lim_{n\to\infty} b_n = 0 &\quad \p{\text{squeeze theorem}} \\ \implies c \lim_{n\to\infty} a_n = 0 &\quad \p{\text{limit law}} \\ \implies \lim_{n\to\infty} a_n = 0. \end{aligned}

The very first mistake made is in the second implication, where a limit law was used. Remember that to use a limit law, all related limits must exist. For this problem, we don't know if limnan\lim_{n\to\infty} a_n exists, so you can't apply any limit laws here.

It's easy to fix this argument, though. We just have to do things in a different order: divide by cc first to get

0anbnc.0 \leq a_n \leq \frac{b_n}{c}.

Then the squeeze theorem tells us two things: limnan\lim_{n\to\infty} a_n exists and that

limnan=limnbnc=1climnbn(limit law; limnbn exists)=0.\begin{aligned} \lim_{n\to\infty} a_n &= \lim_{n\to\infty} \frac{b_n}{c} \\ &= \frac{1}{c} \lim_{n\to\infty} b_n && \p{\text{limit law; } \lim_{n\to\infty} b_n \text{ exists}} \\ &= 0. \end{aligned}

Compact Metric Spaces

Definition

Let (X,d)\p{X, d} be a metric space. Then XX is compact if every sequence has a convergent subsequence.

It might not seem like it now, but compactness is one of the most important concepts in analysis. It will become much more clear once we start talking about continuity, but for now, we'll just try to gain some intuition for it.

I personally like to describe compact sets as sets which are "self-contained" or sets where there's "no escape." To illustrate:

Example 2.
  1. [0,1]\br{0, 1} (with respect to the Euclidean metric) is compact. (This is the Bolzano-Weierstrass theorem from MATH 131A.)
    • This is usually the first example that pops up in my head when I think about compactness.
  2. (0,1)\p{0, 1} is not compact.
    • For example, an=11na_n = 1 - \frac{1}{n} has no convergent subsequence. In other words, this sequence "escapes" the set (0,1)\p{0, 1}.
  3. R\R is not compact.
    • For example, an=na_n = n has no convergent subsequence. This sequence "escapes to infinity."

One of the most important theorems regarding compact sets is the following:

Theorem (Heine-Borel)

Let (X,d)\p{X, d} be a metric space and let EXE \subseteq X be a subset. The following are equivalent:

  1. EXE \subseteq X is compact (with respect to the restricted metric).
  2. EE is complete and totally bounded.
  3. Every open cover of EE has a finite subcover.
Remark.

In more abstract settings (e.g., topological spaces), (iii) is usually the definition of compactness. This is because it requires the least amount of machinery to state: it doesn't refer to the metric at all, but only the open sets in your space.

Generally, to prove a set is compact, you will want to try to use (i) or (ii), and if you want to use compactness of a set, (i) and (iii) are usually the most useful.

Example 3.

Show that [0,1]2\br{0, 1}^2 is compact (with respect to the Euclidean metric d2d_{\ell^2}).

Solution.

Let {x(n)}n\set{x^{\p{n}}}_n be a sequence in [0,1]2\br{0, 1}^2. If we look at the first coordinate of all these elements, then we get a sequence {x1(n)}n\set{x^{\p{n}}_1}_n of elements in [0,1]\br{0, 1}. But [0,1]\br{0, 1} is compact, so there exists a subsequence n1(k)n_1\p{k} of nn and x1[0,1]x_1 \in \br{0, 1} such that

limkx1(n1(k))=x1.\lim_{k\to\infty} x^{\p{n_1\p{k}}}_1 = x_1.

Now we have a subsequence of vectors {x(n1(k))}k\set{x^{\p{n_1\p{k}}}}_k whose first coordinates converges. However, it's still possible that the second coordinate does not converge, so we will need to run the same argument again:

{x2(n1(k))}k\set{x^{\p{n_1\p{k}}}_2}_k is a sequence of elements in [0,1]\br{0, 1}, so by compactness again, we get a subsequence n2(k)n_2\p{k} of n1(k)n_1\p{k} (so n2(k)n_2\p{k} is a sub-subsequence) and x2[0,1]x_2 \in \br{0, 1} such that

limkx2(n2(k))=x2.\lim_{k\to\infty} x^{\p{n_2\p{k}}}_2 = x_2.

Here's where it's important that we took a subsequence of our first subsequence: because {x1(n1(k))}k\set{x^{\p{n_1\p{k}}}_1}_k was a convergent sequence, any subsequence is still convergent and converges to the same limit. In other words,

limkx1(n2(k))=x1\lim_{k\to\infty} x^{\p{n_2\p{k}}}_1 = x_1

still. Thus,

x(n2(k))=(x1(n2(k)),x2(n2(k)))k(x1,x2)x^{\p{n_2\p{k}}} = \p{x^{\p{n_2\p{k}}}_1, x^{\p{n_2\p{k}}}_2} \xrightarrow{k\to\infty} \p{x_1, x_2}

(since convergence in each coordinate with respect to the absolute value is equivalent to convergence of the entire vector in d2d_{\ell^2}). In summary, we found a subsequence of {x(n)}n\set{x^{\p{n}}}_n which converges, so [0,1]2\br{0, 1}^2 is compact.

Remark.

While the proof had a lot of writing, the idea is relatively simple: apply compactness in each coordinate to get a subsequence that converges in each coordinate. The key detail is that we took a sub-subsequence to make sure that the first coordinate still converges when working on the second coordinate.

Exercise 1.

Show that [0,1]k\br{0, 1}^k is compact.

Example 4.

Let XX be an infinite set with the discrete metric. Prove that XX is not compact.

Solution.

There are multiple ways to prove this:

  1. Using (i) in Heine-Borel, we just need to construct a sequence which has no convergent subsequence. Here, it's important that XX is infinite:

    Let x1Xx_1 \in X be any point. Since XX is infinite, this means X{x1}X \setminus \set{x_1} \neq \emptyset, so there exists x2X{x1}x_2 \in X \setminus \set{x_1}, i.e., x1x2x_1 \neq x_2. Now suppose we have chosen x1,,xkXx_1, \ldots, x_k \in X which are all distinct. Then because XX is infinite, we know X{x1,,xk}X \setminus \set{x_1, \ldots, x_k} \neq \emptyset, so there exists xk+1Xx_{k+1} \in X which is different from x1,,xkx_1, \ldots, x_k.

    By induction, we obtain a sequence {xn}n\set{x_n}_n of XX such that if nmn \neq m, then xnxmx_n \neq x_m. Thus, given any subsequence n(k)n\p{k},

    d(xn(k),xn(k+1))=1d\p{x_{n\p{k}}, x_{n\p{k+1}}} = 1

    for all k1k \geq 1, so this subsequence cannot converge. Hence, {xn}n\set{x_n}_n has no convergent subsequence, so XX is not compact.

  2. Using (ii), we need to show that XX is not complete or not totally bounded. We already know that XX is complete (any metric space with the discrete metric is complete), so we'll want to prove that XX is not totally bounded.

    Recall that B(x,1)={x}B\p{x, 1} = \set{x} for any xXx \in X. Thus, if we set ε=1\epsilon = 1, any finite collection of open balls B(x1,1),,B(xn,1)B\p{x_1, 1}, \ldots, B\p{x_n, 1} satisfies

    i=1nB(xi,1)=i=1n{xi}={x1,,xn}.\bigcup_{i=1}^n B\p{x_i, 1} = \bigcup_{i=1}^n \set{x_i} = \set{x_1, \ldots, x_n}.

    But XX is infinite, so this can't cover XX, i.e., XX is not totally bounded.

  3. To prove this using (iii), we can use the same approach as using (ii). Notice that

    X=xX{x}=xXB(x,1).X = \bigcup_{x \in X} \set{x} = \bigcup_{x \in X} B\p{x, 1}.

    Given any finite subcollection B(x1,1),,B(xn,1)B\p{x_1, 1}, \ldots, B\p{x_n, 1}, we have

    i=1nB(xi,1)={x1,,xn}\bigcup_{i=1}^n B\p{x_i, 1} = \set{x_1, \ldots, x_n}

    like before. Thus, {B(x,1)}xX\set{B\p{x, 1}}_{x \in X} is an open cover that does not have a finite subcover, so XX is not compact.

Example 5.

Show that C([0,1])C\p{\br{0, 1}} is not compact with respect to the sup\sup-metric.

Solution.

If fn(x)=nf_n\p{x} = n, then any subsequence is unbounded, i.e.,

limkfn(k)(x)=\lim_{k\to\infty} f_{n\p{k}}\p{x} = \infty

for all x[0,1]x \in \br{0, 1}. Thus, no subsequence can converge in C([0,1])C\p{\br{0, 1}}, so C([0,1])C\p{\br{0, 1}} is not compact.

(In this example, our sequence "escapes to infinity.")

Example 6.

Show that the closed unit ball in C([0,1])C\p{\br{0, 1}} is not compact with respect to the sup\sup-metric, i.e., show that the set

B={fC([0,1])|supx[0,1]f(x)1}B = \set{f \in C\p{\br{0, 1}} \st \sup_{x \in \br{0, 1}} \abs{f\p{x}} \leq 1}

is not compact.

Solution.

If fn(x)=xnf_n\p{x} = x^n, then

limnfn(x)={0if 0x<1,1if x=1.\lim_{n\to\infty} f_n\p{x} = \begin{cases} 0 & \text{if } 0 \leq x < 1, \\ 1 & \text{if } x = 1. \end{cases}

Suppose {fn}n\set{f_n}_n has a convergent subsequence {fn(k)}k\set{f_{n\p{k}}}_k, i.e., there exists fC([0,1])f \in C\p{\br{0, 1}} such that fn(k)f_{n\p{k}} converges uniformly to ff. The uniform and pointwise limits of a sequence of functions (if they both exist) must be the same:

f(x)=limkfn(k)(x)={0if 0x<1,1if x=1.f\p{x} = \lim_{k\to\infty} f_{n\p{k}}\p{x} = \begin{cases} 0 & \text{if } 0 \leq x < 1, \\ 1 & \text{if } x = 1. \end{cases}

But this contradicts the fact that ff was continuous. Thus, {fn}n\set{f_n}_n has no convergent subsequence, so BB is not compact.

(In this example, our sequence "escapes" the set C([0,1])C\p{\br{0, 1}} altogether.)

Homework Hints

Problem 5

Reminder: Infinite sums are defined as limits, i.e.,

n=1an=limNn=1Nan.\sum_{n=1}^\infty \abs{a_n} = \lim_{N\to\infty} \sum_{n=1}^N \abs{a_n}.

This means that when proving the triangle inequality, you should use a limit law at some point.

Hint: You can write

{{an}n1(N)|n=1an1}={{an}n1(N)|n=1an01}.\set{\set{a_n}_n \in \ell^1\p{\N} \st \sum_{n=1}^\infty \abs{a_n} \leq 1} = \set{\set{a_n}_n \in \ell^1\p{\N} \st \sum_{n=1}^\infty \abs{a_n - 0} \leq 1}.

If you understand what this hint means, then showing the the set is closed and bounded is a one-liner.