Skip to content

Completeness of the Real Numbers and Cauchy Sequences: The Absence of Gaps

Prerequisite:Limits and Continuity: Reading ε-δ as a Contract on ErrorThe Grammar of Mathematics: Reading and Writing Sets and Logic

Raw
  • The field R\mathbb{R} of real numbers is an ordered field together with one extra requirement: completeness. The field and order axioms alone cannot distinguish R\mathbb{R} from the rational field Q\mathbb{Q}, and they cannot even prove that 2\sqrt{2} exists.
  • Here we adopt completeness in the form of the axiom “every increasing sequence that is bounded above converges”, and from it we derive, without skipping any step, the Archimedean property, the existence of suprema, the density of the rationals and of the irrationals, the Bolzano–Weierstrass theorem, and the convergence of Cauchy sequences.
  • The Archimedean property (every real number is smaller than some natural number) does not follow from the ordered-field axioms. It is a consequence of completeness, and it can be read as the statement that “there are no infinitely small numbers”.
  • Convergence of Cauchy sequences means that convergence can be decided without naming the limit. This is the practical watershed separating calculus as a computational technique from real analysis as a study of foundations.
  • The completeness established here reappears, in changed form, again and again: in uniform convergence, in the convergence theorems of Lebesgue integration, and in the completeness of LpL^p spaces (the Riesz–Fischer theorem).

1. Motivation: what calculus used silently

Section titled “1. Motivation: what calculus used silently”

In calculus we learned the rules for computing limits, derivatives and integrals. Along the way we accepted the following facts without proof, or on the strength of a picture.

  • The number 2\sqrt{2} exists.
  • If a continuous function changes sign, it takes the value 00 somewhere in between (the intermediate value theorem).
  • A continuous function on a bounded closed interval attains a maximum.
  • An increasing sequence that is bounded above converges.

Every one of these depends on the single fact that the real line has no gaps. This becomes plain once we move the stage to the world Q\mathbb{Q} of rational numbers. The function f(x)=x22f(x) = x^2 - 2 is continuous on Q\mathbb{Q}, with f(0)=2f(0) = -2 negative and f(2)=2f(2) = 2 positive. Nevertheless no rational qq satisfies f(q)=0f(q) = 0. The intermediate value theorem fails over Q\mathbb{Q} (Remark 5.2[Continuous Functions and Uniform Continuity]). The extreme value theorem breaks in the same way. The function g(x)=1x22g(x) = \dfrac{1}{x^2 - 2} is continuous on the bounded closed interval [0,2]Q[0, 2] \cap \mathbb{Q} of Q\mathbb{Q}, yet it is not even bounded, because x2x^2 can be brought arbitrarily close to 22.

Neither the rules of arithmetic (the field axioms) nor the rules governing inequalities (the order axioms) distinguish Q\mathbb{Q} from R\mathbb{R}: both are ordered fields. So the four facts above can never be derived from arithmetic and order alone, and one further requirement must be imposed. That requirement is completeness.

Historically this realisation came late. Analysis up to the eighteenth century leaned on an intuition of “magnitude”, and the question of what a real number is was not asked. Bolzano (1817) attempted a “purely analytic proof” of the intermediate value theorem, and Cauchy’s Cours d’analyse (1821) rebuilt calculus around the notion of limit; but neither supplied a definition of the real numbers themselves. In 1872 two constructions appeared — Dedekind’s “cuts” and Cantor’s (and Méray’s) “fundamental sequences” — and only then were the reals defined. Real analysis is the discipline of rederiving from axioms what calculus took for granted. This article is its first step.

2. Preliminaries: ordered fields and convergence of sequences

Section titled “2. Preliminaries: ordered fields and convergence of sequences”

Let us first record, as axioms, the “arithmetic and order” part, that is, everything except completeness. Making this explicit lets us say later, with precision, that a given statement does not follow from the ordered-field axioms alone.

Definition 2.1Ordered field

Let a set KK carry an addition ++, a multiplication \cdot and a total order \le satisfying the following three conditions. Then (K,+,,)(K, +, \cdot, \le) is called an ordered field.

  1. (K,+,)(K, +, \cdot) is a field: addition and multiplication are associative and commutative, there is an additive identity 00 and a multiplicative identity 101 \ne 0, every element aa has an additive inverse a-a, every element a0a \ne 0 has a multiplicative inverse a1a^{-1}, and the distributive law a(b+c)=ab+aca(b + c) = ab + ac holds.
  2. For all a,b,cKa, b, c \in K, if aba \le b then a+cb+ca + c \le b + c.
  3. For all a,bKa, b \in K, if 0a0 \le a and 0b0 \le b then 0ab0 \le ab.

Both Q\mathbb{Q} and R\mathbb{R} are ordered fields. In any ordered field 0<10 < 1 follows. Indeed, a20a^2 \ge 0 for every aa: if a0a \ge 0 this is immediate from condition 3, while if a0a \le 0 we add a-a to both sides using condition 2 to get a0-a \ge 0 and then apply condition 3 to (a)2=a2(-a)^2 = a^2. Hence 1=1201 = 1^2 \ge 0, and together with 101 \ne 0 this gives 0<10 < 1. Consequently 1, 1+1, 1+1+1, 1,\ 1 + 1,\ 1 + 1 + 1,\ \ldots is, by condition 2, a strictly increasing sequence of positive elements, each step adding 11. In particular these elements are pairwise distinct, so every ordered field contains a copy of the natural numbers, and with it copies of the integers and of the rationals. Throughout, N={1,2,3,}\mathbb{N} = \{1, 2, 3, \ldots\} does not include 00.

We define the absolute value by a=max{a,a}|a| = \max\{a, -a\}. Adding the inequalities aaa \le |a|, aa-a \le |a|, bbb \le |b| and bb-b \le |b| in pairs gives a+ba+ba + b \le |a| + |b| and (a+b)a+b-(a + b) \le |a| + |b|, hence the triangle inequality a+ba+b|a + b| \le |a| + |b|. This inequality is used repeatedly in what follows.

Definition 2.2Convergence, boundedness and monotonicity of sequences

Let (an)n1(a_n)_{n \ge 1} be a sequence of elements of an ordered field KK.

  • We say that it converges to LKL \in K if ε>0, NN, nN, anL<ε\forall \varepsilon > 0,\ \exists N \in \mathbb{N},\ \forall n \ge N,\ |a_n - L| < \varepsilon, and we write limnan=L\lim_{n \to \infty} a_n = L or anLa_n \to L.
  • It is bounded if there is an M>0M > 0 with anM|a_n| \le M for every nn.
  • It is increasing if anan+1a_n \le a_{n+1} for every nn. It is decreasing if the inequality is reversed.

Remark 2.3

The limit is unique. Indeed, suppose anLa_n \to L and anLa_n \to L' with LLL \ne L'. Taking ε=LL/2>0\varepsilon = |L - L'| / 2 > 0, we have anL<ε|a_n - L| < \varepsilon and anL<ε|a_n - L'| < \varepsilon for all sufficiently large nn, so the triangle inequality gives LLLan+anL<2ε=LL|L - L'| \le |L - a_n| + |a_n - L'| < 2\varepsilon = |L - L'|, a contradiction. This uniqueness is exactly what we shall need later when we assert that a certain limit “does not exist inside Q\mathbb{Q}”.

3. The completeness axiom and the Archimedean property

Section titled “3. The completeness axiom and the Archimedean property”

There are several equivalent ways to formulate completeness (we collect them after Theorem 4.2 and in the Appendix at the end of the article). Here we take as our axiom the form most familiar from calculus.

Axiom 3.1Completeness axiom (monotone convergence principle)

Let (an)n1(a_n)_{n \ge 1} be a sequence of real numbers that is increasing and bounded above, that is, anan+1a_n \le a_{n+1} for every nn and there exists MRM \in \mathbb{R} with anMa_n \le M for every nn. Then (an)(a_n) converges to some real number.

What this axiom asserts is that a destination has been provided. The sequence 1, 1.4, 1.41, 1.414, 1,\ 1.4,\ 1.41,\ 1.414,\ \ldots is increasing and never exceeds 22, but inside Q\mathbb{Q} there is nowhere for it to go. Inside R\mathbb{R} there is: that is the content of the axiom. From now on, R\mathbb{R} means an ordered field satisfying this axiom.

The first consequence is the Archimedean property. The name sounds elementary, but note that it does not follow from the ordered-field axioms.

Theorem 3.2Archimedean property

The following hold.

  1. For every xRx \in \mathbb{R} there exists nNn \in \mathbb{N} with n>xn > x.
  2. For every ε>0\varepsilon > 0 there exists NNN \in \mathbb{N} with 1/N<ε1/N < \varepsilon. In particular limn1/n=0\lim_{n \to \infty} 1/n = 0.
  3. limn2n=0\lim_{n \to \infty} 2^{-n} = 0.
Proof(Theorem 3.2)

(1) Suppose the conclusion fails, so that there is an xRx \in \mathbb{R} with nxn \le x for every nNn \in \mathbb{N}. The sequence an=na_n = n is increasing and, by this assumption, has xx as an upper bound. Hence by Axiom 3.1 the sequence (an)(a_n) converges to some real number LL. Taking ε=1/2\varepsilon = 1/2 in Definition 2.2, there is an NN such that anL<1/2|a_n - L| < 1/2 for all nNn \ge N. Applying this to n=Nn = N and n=N+1n = N + 1 and using the triangle inequality,

1=aN+1aNaN+1L+LaN<12+12=11 = |a_{N+1} - a_N| \le |a_{N+1} - L| + |L - a_N| < \tfrac12 + \tfrac12 = 1

which gives the contradiction 1<11 < 1. Hence (1) holds.

(2) Let ε>0\varepsilon > 0. Apply (1) with x=1/εx = 1/\varepsilon to obtain NNN \in \mathbb{N} with N>1/εN > 1/\varepsilon. Multiplying both sides of N>1/ε>0N > 1/\varepsilon > 0 by the positive number ε/N\varepsilon / N gives ε>1/N\varepsilon > 1/N. Moreover, if nNn \ge N then 0<1/n1/N<ε0 < 1/n \le 1/N < \varepsilon, so 1/n0<ε|1/n - 0| < \varepsilon, which proves 1/n01/n \to 0.

(3) We have 2nn2^n \ge n for every nNn \in \mathbb{N}. Indeed, 212 \ge 1 for n=1n = 1, and assuming 2nn2^n \ge n we get 2n+1=22n2n=n+nn+12^{n+1} = 2 \cdot 2^n \ge 2n = n + n \ge n + 1, so the claim follows by induction. Hence 0<2n1/n0 < 2^{-n} \le 1/n, and (2) together with the squeeze gives 2n02^{-n} \to 0. Spelling out the squeeze: given ε>0\varepsilon > 0, take the NN from (2); then 2n0=2n1/n<ε|2^{-n} - 0| = 2^{-n} \le 1/n < \varepsilon for nNn \ge N.

Example 3.3An ordered field in which the Archimedean property fails

That the Archimedean property is not a consequence of the ordered-field axioms can be checked by a counterexample. The set of all rational functions with real coefficients,

R(t)={p(t)q(t) | p,q real polynomials, q0}\mathbb{R}(t) = \left\{ \frac{p(t)}{q(t)} \ \middle|\ p, q \text{ real polynomials},\ q \ne 0 \right\}

is a field. Order it by declaring that f>0f > 0 means f(s)>0f(s) > 0 for all sufficiently large real ss. A rational function that is not identically 00 has a constant sign for all large ss, so this does define a total order, and conditions 2 and 3 of Definition 2.1 hold as well. In this ordered field, tnt - n is positive for all large ss for every nNn \in \mathbb{N}, so t>nt > n. Thus the element tt exceeds every natural number and the Archimedean property fails. Its reciprocal 1/t1/t is an “infinitesimal”: positive, yet smaller than every 1/n1/n.

In this sense the Archimedean property states that there are no infinitely large and no infinitely small elements, and what guarantees it is the completeness axiom. That is the content of Theorem 3.2.

Before proving anything further, here is a map of how the statements ahead depend on one another.

flowchart TD
A["Axiom: an increasing sequence bounded above converges"] --> B["Archimedean property"]
C["Monotone subsequence lemma"]
A --> D["Existence of suprema"]
B --> D
D --> E["Existence of square roots"]
B --> F["Existence of the integer part"]
F --> G["Density of the rationals"]
G --> H["Density of the irrationals"]
E --> H
C --> I["Bolzano-Weierstrass theorem"]
A --> I
I --> J["Cauchy sequences converge"]
The chain of reasoning starting from the completeness axiom. An arrow means 'is used to prove'

4. Existence of suprema and the construction of square roots

Section titled “4. Existence of suprema and the construction of square roots”

Definition 4.1Upper bound, supremum, infimum

Let SRS \subset \mathbb{R}.

  • An element bRb \in \mathbb{R} is an upper bound of SS if xbx \le b for every xSx \in S. If an upper bound exists, SS is said to be bounded above.
  • An element LRL \in \mathbb{R} is a supremum of SS if LL is an upper bound of SS and LbL \le b for every upper bound bb of SS; that is, the supremum is the least upper bound. If it exists it is unique (two of them would each be at most the other), and we write it supS\sup S.
  • Lower bound, bounded below and infimum infS\inf S are defined in the same way with the inequalities reversed.

The supremum differs from a maximum in that it need not belong to SS. The set S={xR0<x<1}S = \{x \in \mathbb{R} \mid 0 < x < 1\} has no maximum, yet supS=1\sup S = 1. The guarantee that a least upper bound exists even when a maximum does not is precisely the next theorem.

Theorem 4.2Existence of suprema (Weierstrass)

If SRS \subset \mathbb{R} is non-empty and bounded above, then supS\sup S exists. Likewise, if SS is non-empty and bounded below, then infS\inf S exists.

Proof(Theorem 4.2)

We build a sequence converging to the supremum by repeatedly halving an interval (bisection).

Construction of the sequences. Below we index from n=0n = 0; shifting everything by 11 turns the sequences into sequences of the form used in Definition 2.2, so Axiom 3.1 applies unchanged. Since SS \ne \emptyset, pick some s0Ss_0 \in S and set a0=s01a_0 = s_0 - 1. As s0Ss_0 \in S and s0>a0s_0 > a_0, the number a0a_0 is not an upper bound of SS. By hypothesis an upper bound b0b_0 exists, and a0<s0b0a_0 < s_0 \le b_0 gives a0<b0a_0 < b_0.

Now suppose an<bna_n < b_n, that ana_n is not an upper bound of SS and that bnb_n is. Take the midpoint mn=(an+bn)/2m_n = (a_n + b_n)/2 and set

  • an+1=ana_{n+1} = a_n, bn+1=mnb_{n+1} = m_n if mnm_n is an upper bound of SS;
  • an+1=mna_{n+1} = m_n, bn+1=bnb_{n+1} = b_n if mnm_n is not an upper bound of SS.

Since an<bna_n < b_n implies an<mn<bna_n < m_n < b_n, in either case an+1<bn+1a_{n+1} < b_{n+1}, with an+1a_{n+1} not an upper bound and bn+1b_{n+1} an upper bound. Moreover anan+1a_n \le a_{n+1} and bn+1bnb_{n+1} \le b_n, and the widths satisfy

bn+1an+1=bnan2,hencebnan=b0a02nb_{n+1} - a_{n+1} = \frac{b_n - a_n}{2}, \qquad \text{hence} \quad b_n - a_n = \frac{b_0 - a_0}{2^{n}}

(the second identity by induction on nn).

Existence of the limit. The sequence (an)(a_n) is increasing and an<bnb0a_n < b_n \le b_0 for every nn, so it is bounded above. By Axiom 3.1 there is an LRL \in \mathbb{R} with anLa_n \to L. We show next that bnLb_n \to L. Let ε>0\varepsilon > 0. Apply Theorem 3.2(3) with ε=ε2(b0a0)>0\varepsilon' = \dfrac{\varepsilon}{2(b_0 - a_0)} > 0 to obtain N1N_1 with 2n<ε2^{-n} < \varepsilon' for nN1n \ge N_1; then bnan=(b0a0)2n<ε/2b_n - a_n = (b_0 - a_0)2^{-n} < \varepsilon/2 for nN1n \ge N_1. Also, since anLa_n \to L, there is N2N_2 with anL<ε/2|a_n - L| < \varepsilon/2 for nN2n \ge N_2. For nmax{N1,N2}n \ge \max\{N_1, N_2\} the triangle inequality gives

bnLbnan+anL<ε2+ε2=ε|b_n - L| \le |b_n - a_n| + |a_n - L| < \frac{\varepsilon}{2} + \frac{\varepsilon}{2} = \varepsilon

so bnLb_n \to L.

LL is the supremum. First, LL is an upper bound. Otherwise there is an xSx \in S with x>Lx > L. Applying bnLb_n \to L with ε=xL>0\varepsilon = x - L > 0, we find an nn with bnL<xL|b_n - L| < x - L and hence bn<L+(xL)=xb_n < L + (x - L) = x, contradicting the fact that bnb_n is an upper bound of SS. So LL is an upper bound.

Second, LL is the least upper bound. It suffices to show that no c<Lc < L is an upper bound. Applying anLa_n \to L with ε=Lc>0\varepsilon = L - c > 0, we find an nn with anL<Lc|a_n - L| < L - c and hence an>L(Lc)=ca_n > L - (L - c) = c. This ana_n is not an upper bound of SS, so some xSx \in S satisfies x>an>cx > a_n > c. Therefore cc is not an upper bound. Together this gives L=supSL = \sup S.

The infimum. If SS is non-empty and bounded below, then S={xxS}-S = \{-x \mid x \in S\} is non-empty and bounded above (if bb is a lower bound of SS then b-b is an upper bound of S-S), so sup(S)\sup(-S) exists by what we have just proved. That infS=sup(S)\inf S = -\sup(-S) follows at once from the equivalence xc    xcx \ge c \iff -x \le -c.

Theorem 4.2 is often adopted itself as the completeness axiom, under the name “least upper bound property”. Here we derived it from Axiom 3.1. Conversely, Axiom 3.1 can be derived from Theorem 4.2 (use the characterisation in Exercise 8.1 and check that the supremum of the range of an increasing sequence (an)(a_n) is its limit). The two are equivalent.

Let us test the power of this theorem by constructing 2\sqrt{2}. That “a square root of 22 exists” is something to be proved from the definition of R\mathbb{R}.

Proposition 4.3Existence of positive square roots

There is exactly one real number α\alpha with α2=2\alpha^2 = 2 and α>0\alpha > 0.

Proof(Proposition 4.3)

Set S={xRx>0, x2<2}S = \{x \in \mathbb{R} \mid x > 0,\ x^2 < 2\}. Since 1>01 > 0 and 12=1<21^2 = 1 < 2 we have 1S1 \in S, so SS \ne \emptyset. Also, if x>2x > 2 then x2>2x>4>2x^2 > 2x > 4 > 2 and hence xSx \notin S; thus every element of SS is at most 22, i.e. 22 is an upper bound. By Theorem 4.2 the number α=supS\alpha = \sup S exists, and 1S1 \in S gives α1>0\alpha \ge 1 > 0.

We now show that α2<2\alpha^2 < 2 and α2>2\alpha^2 > 2 are both impossible. As preparation, note that for positive u,vu, v we have u2<v2    u<vu^2 < v^2 \implies u < v (contrapositive: if uv>0u \ge v > 0 then u2uvv2u^2 \ge uv \ge v^2).

Case α2<2\alpha^2 < 2. By Theorem 3.2(2) we may choose nNn \in \mathbb{N} with

1n<min{1, 2α22α+1}\frac{1}{n} < \min\left\{ 1,\ \frac{2 - \alpha^2}{2\alpha + 1} \right\}

(the right-hand side is positive). Put h=1/nh = 1/n. From 0<h<10 < h < 1 we get h2<hh^2 < h, whence

(α+h)2=α2+2αh+h2<α2+2αh+h=α2+(2α+1)h<α2+(2α2)=2.(\alpha + h)^2 = \alpha^2 + 2\alpha h + h^2 < \alpha^2 + 2\alpha h + h = \alpha^2 + (2\alpha + 1)h < \alpha^2 + (2 - \alpha^2) = 2 .

Since also α+h>0\alpha + h > 0, we have α+hS\alpha + h \in S; as α\alpha is an upper bound this forces α+hα\alpha + h \le \alpha, i.e. h0h \le 0, contradicting h>0h > 0.

Case α2>2\alpha^2 > 2. Again by Theorem 3.2(2), choose nn with

1n<min{α, α222α}\frac{1}{n} < \min\left\{ \alpha,\ \frac{\alpha^2 - 2}{2\alpha} \right\}

and put k=1/nk = 1/n. From 0<k<α0 < k < \alpha we get αk>0\alpha - k > 0, and

(αk)2=α22αk+k2>α22αk>α2(α22)=2.(\alpha - k)^2 = \alpha^2 - 2\alpha k + k^2 > \alpha^2 - 2\alpha k > \alpha^2 - (\alpha^2 - 2) = 2 .

Then every xSx \in S satisfies x2<2<(αk)2x^2 < 2 < (\alpha - k)^2, and since x>0x > 0 and αk>0\alpha - k > 0 the remark above gives x<αkx < \alpha - k. So αk\alpha - k is an upper bound of SS, and αk<α\alpha - k < \alpha contradicts the fact that α\alpha is the least upper bound.

Hence α2=2\alpha^2 = 2. For uniqueness, if β>0\beta > 0 satisfies β2=2\beta^2 = 2 then (αβ)(α+β)=α2β2=0(\alpha - \beta)(\alpha + \beta) = \alpha^2 - \beta^2 = 0, and α+β>0\alpha + \beta > 0 forces α=β\alpha = \beta. We write this α\alpha as 2\sqrt{2}.

That this 2\sqrt{2} is irrational follows from the familiar argument by contradiction. If 2=p/q\sqrt{2} = p/q with p,qp, q coprime natural numbers, then p2=2q2p^2 = 2q^2, so pp is even; writing p=2pp = 2p' gives 4p2=2q24p'^2 = 2q^2, hence q2=2p2q^2 = 2p'^2 and qq is even too, contradicting coprimality. (For arguments of this type see Theorem 7.5[Techniques of Proof] in Proof techniques — induction and contradiction.) Combining these two results, we can say precisely in what way Q\mathbb{Q} fails to be complete.

Example 4.4A set with no supremum in the world of rational numbers

Consider SQ={xQx>0, x2<2}S_{\mathbb{Q}} = \{x \in \mathbb{Q} \mid x > 0,\ x^2 < 2\}. It is non-empty, since 1SQ1 \in S_{\mathbb{Q}}, and 22 is an upper bound. Nevertheless SQS_{\mathbb{Q}} has no supremum inside Q\mathbb{Q}.

Here is why. Suppose qQq \in \mathbb{Q} were the least upper bound of SQS_{\mathbb{Q}} within Q\mathbb{Q}. From 1SQ1 \in S_{\mathbb{Q}} we get q1>0q \ge 1 > 0. Now repeat the proof of Proposition 4.3 verbatim. The Archimedean property does hold in Q\mathbb{Q} (for a rational p/qp/q' with q1q' \ge 1 we have p/qp<p+1p/q' \le |p| < |p| + 1, which follows directly from the ordered-field axioms alone). Hence the increments h=1/nh = 1/n and k=1/nk = 1/n can be chosen rational in the same way: if q2<2q^2 < 2 then q+hSQq + h \in S_{\mathbb{Q}}, contradicting that qq is an upper bound, and if q2>2q^2 > 2 then the rational qkq - k is an upper bound, contradicting minimality. The only remaining possibility is q2=2q^2 = 2, which contradicts the irrationality of 2\sqrt{2}.

So Theorem 4.2 fails in Q\mathbb{Q} (Theorem 4.5[What Is a Number? From the Naturals to the Reals, and Why 1 = 0.999… Is True]). Although Q\mathbb{Q} is an ordered field and satisfies the Archimedean property, it is not complete. What is still missing once arithmetic, order and the Archimedean property are all in place is exactly completeness.

5. Density of the rationals and the irrationals

Section titled “5. Density of the rationals and the irrationals”

If completeness says “there are no gaps”, we naturally want to know how the gaps are filled as seen from the rational side. That is density. First we construct integer parts.

Lemma 5.1Existence of the integer part

For every xRx \in \mathbb{R} there is exactly one integer mm with mx<m+1m \le x < m + 1. We write it x\lfloor x \rfloor.

Proof(Lemma 5.1)

Set B={kZk>x}B = \{k \in \mathbb{Z} \mid k > x\}. By Theorem 3.2(1) there is n1Nn_1 \in \mathbb{N} with n1>xn_1 > x, so BB \ne \emptyset. Applying (1) again to x-x, take n2Nn_2 \in \mathbb{N} with n2>xn_2 > -x; then every kBk \in B satisfies k>x>n2k > x > -n_2, so BB is bounded below by n2-n_2. A non-empty set of integers that is bounded below has a least element (the set {k+n2+1kB}\{k + n_2 + 1 \mid k \in B\} is a non-empty subset of the natural numbers, hence has a least element by well-ordering; on well-ordering see Axiom 3.1[Techniques of Proof]).

Let m0=minBm_0 = \min B be that least element and put m=m01m = m_0 - 1. Then mm is an integer, and from m<m0m < m_0 and the minimality of m0m_0 we get mBm \notin B, i.e. mxm \le x. On the other hand m+1=m0Bm + 1 = m_0 \in B gives x<m+1x < m + 1.

For uniqueness, suppose integers mmm \ne m' both satisfy mx<m+1m \le x < m + 1 and mx<m+1m' \le x < m' + 1; we may assume m<mm < m'. As these are integers, m+1mm + 1 \le m', and combined with mxm' \le x this yields m+1xm + 1 \le x, contradicting x<m+1x < m + 1.

Theorem 5.2Density of the rationals

If a,bRa, b \in \mathbb{R} satisfy a<ba < b, then there is a rational number qq with a<q<ba < q < b.

Proof(Theorem 5.2)

Since ba>0b - a > 0, Theorem 3.2(2) provides nNn \in \mathbb{N} with 1n<ba\dfrac{1}{n} < b - a, i.e. n(ba)>1n(b - a) > 1. For this nn, apply Lemma 5.1 to nana and put m=na+1m = \lfloor na \rfloor + 1. By definition

m1na<m,that isna<mna+1.m - 1 \le na < m, \qquad \text{that is} \qquad na < m \le na + 1 .

Put q=m/nq = m/n. Since n>0n > 0, the left inequality na<mna < m gives a<m/n=qa < m/n = q. From the right inequality together with n(ba)>1n(b - a) > 1,

mna+1<na+n(ba)=nbm \le na + 1 < na + n(b - a) = nb

so dividing by n>0n > 0 gives q=m/n<bq = m/n < b. As mm is an integer and nn a natural number, qq is rational, and a<q<ba < q < b is proved.

Corollary 5.3Density of the irrationals

If a,bRa, b \in \mathbb{R} satisfy a<ba < b, then there is an irrational number ξ\xi (that is, ξRQ\xi \in \mathbb{R} \setminus \mathbb{Q}) with a<ξ<ba < \xi < b.

Proof(Corollary 5.3)

We use the number 2\sqrt{2} whose existence was guaranteed by Proposition 4.3. Since a2<b2a - \sqrt{2} < b - \sqrt{2}, Theorem 5.2 provides a rational qq with

a2<q<b2.a - \sqrt{2} < q < b - \sqrt{2} .

Put ξ=q+2\xi = q + \sqrt{2}; adding 2\sqrt{2} to each term gives a<ξ<ba < \xi < b. If ξ\xi were rational, then 2=ξq\sqrt{2} = \xi - q would be rational too, contradicting the irrationality of 2\sqrt{2}. Hence ξ\xi is irrational.

Example 5.4Producing a rational exactly as the proof of density prescribes

The proof of Theorem 5.2 is itself a recipe for producing a rational number. Let us construct one between a=2=1.41421356a = \sqrt{2} = 1.41421356\ldots and b=2+103b = \sqrt{2} + 10^{-3}.

Since ba=103b - a = 10^{-3}, we take an nn with 1/n<1031/n < 10^{-3}, say n=1001n = 1001. Next we evaluate na=10012na = 1001\sqrt{2}:

1001×1.41421356=1414.21356+1.41421356=1415.62771001 \times 1.41421356\ldots = 1414.21356\ldots + 1.41421356\ldots = 1415.6277\ldots

so na=1415\lfloor na \rfloor = 1415, hence m=1416m = 1416 and q=14161001q = \dfrac{1416}{1001}.

Let us check. Since 1416>1415.6277=1001a1416 > 1415.6277\ldots = 1001a, we have q>aq > a. Also 1001b=1001a+1001×103=1415.6277+1.001=1416.6287>14161001b = 1001a + 1001 \times 10^{-3} = 1415.6277\ldots + 1.001 = 1416.6287\ldots > 1416, so q<bq < b. In decimal form q=1416/1001=1.4145854q = 1416/1001 = 1.4145854\ldots, which indeed lies between 1.41421351.4142135\ldots and 1.41521351.4152135\ldots.

Remark 5.5

Density and completeness are different notions. Q\mathbb{Q} is dense in R\mathbb{R}, yet as Example 4.4 shows it is not complete. “Between any two points one can always squeeze in” is not the same as “there are no gaps”. The gap between the two is also visible from the point of view of cardinality: Q\mathbb{Q} is countable while R\mathbb{R} is uncountable, and by Corollary 5.3 the irrationals are dense as well. For how a countable dense set is scattered over an uncountable line, see Cardinality and infinity — infinities come in sizes. Incidentally, that the identity 0.999=10.999\ldots = 1 is a theorem following from completeness rather than a notational convention is treated in Theorem 6.3[What Is a Number? From the Naturals to the Reals, and Why 1 = 0.999… Is True] in What is a number? (is 1 = 0.999…?).

We now turn to the existence theorem most used in analysis. A bounded sequence need not converge (an=(1)na_n = (-1)^n is a counterexample). But one can always extract a convergent part, and that is the next theorem, used over and over in proofs of the extreme value theorem and of uniform continuity.

Definition 6.1Subsequence

Given a sequence (an)n1(a_n)_{n \ge 1} and a strictly increasing sequence of natural numbers n1<n2<n3<n_1 < n_2 < n_3 < \cdots, the sequence (ank)k1(a_{n_k})_{k \ge 1} is called a subsequence of (an)(a_n). Note that n11n_1 \ge 1 and nk+1>nkn_{k+1} > n_k give nkkn_k \ge k by induction.

The key to the proof is the following combinatorial lemma. What makes it striking is that it assumes no boundedness at all.

Lemma 6.2Monotone subsequence lemma

Every real sequence (an)n1(a_n)_{n \ge 1} has an increasing subsequence or a decreasing subsequence.

Proof(Lemma 6.2)

Call an index nn a peak if anama_n \ge a_m for every m>nm > n. A peak is the position of a term that is no smaller than any later term. We distinguish cases according to the number of peaks.

Infinitely many peaks. List them in increasing order as n1<n2<n3<n_1 < n_2 < n_3 < \cdots. For each kk, the index nkn_k is a peak and nk+1>nkn_{k+1} > n_k, so by the definition of a peak ankank+1a_{n_k} \ge a_{n_{k+1}}. Hence (ank)(a_{n_k}) is a decreasing subsequence.

Only finitely many peaks. If there are no peaks at all, put N=1N = 1; otherwise let NN be one more than the largest peak. In either case no index nNn \ge N is a peak. That nNn \ge N is not a peak means, by negating the definition, that there exists m>nm > n with am>ana_m > a_n. So put n1=Nn_1 = N, and once nkn_k is defined (it satisfies nkNn_k \ge N and so is not a peak) choose some m>nkm > n_k with am>anka_m > a_{n_k} and set nk+1=mn_{k+1} = m. This produces n1<n2<n_1 < n_2 < \cdots with an1<an2<a_{n_1} < a_{n_2} < \cdots, so (ank)(a_{n_k}) is an increasing subsequence.

a₂a₄a₆a₈a₁₀a₁₂123456789101112n
Peaks (in the accent colour) and the decreasing subsequence extracted from them. If there are infinitely many peaks, listing them already gives a decreasing sequence

Theorem 6.3Bolzano–Weierstrass theorem

Every bounded real sequence has a convergent subsequence. That is, if there is an M>0M > 0 with anM|a_n| \le M for every nn, then there exist a subsequence (ank)(a_{n_k}) of (an)(a_n) and an LRL \in \mathbb{R} with ankLa_{n_k} \to L.

Proof(Theorem 6.3)

By Lemma 6.2, the sequence (an)(a_n) has a monotone subsequence (ank)(a_{n_k}). Since (an)(a_n) is bounded, this subsequence satisfies ankM|a_{n_k}| \le M with the same MM and is therefore bounded.

If (ank)(a_{n_k}) is increasing, it is bounded above (by ankMa_{n_k} \le M) and so converges to some LL by Axiom 3.1.

If (ank)(a_{n_k}) is decreasing, put bk=ankb_k = -a_{n_k}. Then (bk)(b_k) is increasing and bounded above by bkMb_k \le M, so Axiom 3.1 gives an LL' with bkLb_k \to L'. Setting L=LL = -L', for every ε>0\varepsilon > 0 and all sufficiently large kk we get

ankL=bk+L=bkL<ε|a_{n_k} - L| = |-b_k + L'| = |b_k - L'| < \varepsilon

so ankLa_{n_k} \to L. In both cases a convergent subsequence has been obtained.

Example 6.4Following the construction of the lemma on a sequence with no peaks

Let an=(1)nnn+1a_n = (-1)^n \dfrac{n}{n+1}. Since an<1|a_n| < 1 the sequence is bounded, but it does not converge, because the even-indexed terms approach 11 and the odd-indexed terms approach 1-1.

This sequence has no peaks at all. Indeed, for every nn we have annn+1<1a_n \le \dfrac{n}{n+1} < 1, so 1an>01 - a_n > 0. By Theorem 3.2(2) there is an NN with 1N<1an\dfrac{1}{N} < 1 - a_n, so we may choose an even number 2m2m large enough that 2m+1N2m + 1 \ge N and 2m>n2m > n simultaneously. Then

a2m=2m2m+1=112m+111N>1(1an)=ana_{2m} = \frac{2m}{2m+1} = 1 - \frac{1}{2m+1} \ge 1 - \frac{1}{N} > 1 - (1 - a_n) = a_n

and since 2m>n2m > n, the index nn is not a peak. As nn was arbitrary, there are no peaks.

We are therefore in the second case of Lemma 6.2, and starting from N=1N = 1 we can build an increasing subsequence. Following the recipe: for n1=1n_1 = 1 (with a1=12a_1 = -\tfrac12) the smallest mm with am>12a_m > -\tfrac12 is 22 (with a2=23a_2 = \tfrac23); the next mm with am>23a_m > \tfrac23 is 44 (with a4=45a_4 = \tfrac45); then 66 (with a6=67a_6 = \tfrac67), and so on, giving

12, 23, 45, 67, 89, 1-\frac{1}{2},\ \frac{2}{3},\ \frac{4}{5},\ \frac{6}{7},\ \frac{8}{9},\ \ldots \longrightarrow 1

an increasing and bounded subsequence. By Axiom 3.1 it converges, and its limit is indeed 11. What Theorem 6.3 asserts is that this procedure always succeeds, for any bounded sequence.

7. Cauchy sequences and the completeness of the reals

Section titled “7. Cauchy sequences and the completeness of the reals”

Both Axiom 3.1 and Theorem 6.3 required structural information — monotonicity or boundedness — in order to conclude convergence. In practice, however, analysis deals with sequences such as k=1n(1)k+1k\sum_{k=1}^{n} \dfrac{(-1)^{k+1}}{k}, which are neither monotone nor of known limit. The tool for deciding convergence without knowing the limit is Cauchy’s condition.

Definition 7.1Cauchy sequence

A real sequence (an)n1(a_n)_{n \ge 1} is a Cauchy sequence (a fundamental sequence) if

ε>0, NN, m,nN,anam<ε.\forall \varepsilon > 0,\ \exists N \in \mathbb{N},\ \forall m, n \ge N,\quad |a_n - a_m| < \varepsilon .

Proposition 7.2Basic properties of Cauchy sequences

For a real sequence (an)(a_n) the following hold.

  1. If (an)(a_n) converges, then it is a Cauchy sequence.
  2. If (an)(a_n) is a Cauchy sequence, then it is bounded.
Proof(Proposition 7.2)

(1) Let anLa_n \to L and let ε>0\varepsilon > 0 be arbitrary. Applying Definition 2.2 with ε/2\varepsilon/2, take NN with anL<ε/2|a_n - L| < \varepsilon/2 for nNn \ge N. For m,nNm, n \ge N the triangle inequality gives

anamanL+Lam<ε2+ε2=ε|a_n - a_m| \le |a_n - L| + |L - a_m| < \frac{\varepsilon}{2} + \frac{\varepsilon}{2} = \varepsilon

so (an)(a_n) is a Cauchy sequence.

(2) Take ε=1\varepsilon = 1 in Definition 7.1 and fix the corresponding NN. For nNn \ge N, taking m=Nm = N gives anaN<1|a_n - a_N| < 1, and the triangle inequality yields

an=(anaN)+aNanaN+aN<1+aN.|a_n| = |(a_n - a_N) + a_N| \le |a_n - a_N| + |a_N| < 1 + |a_N| .

Now set M=max{a1,a2,,aN1, aN+1}M = \max\{|a_1|, |a_2|, \ldots, |a_{N-1}|,\ |a_N| + 1\} (a maximum of finitely many real numbers, hence well defined). If n<Nn < N then anM|a_n| \le M by the definition of MM; if nNn \ge N then an<aN+1M|a_n| < |a_N| + 1 \le M. In either case anM|a_n| \le M, so the sequence is bounded.

The converse — that every Cauchy sequence converges — is the heart of completeness, and it can be proved as a consequence of Axiom 3.1.

Theorem 7.3Completeness of the reals (Cauchy criterion)

A real sequence (an)n1(a_n)_{n \ge 1} converges if and only if it is a Cauchy sequence.

Proof(Theorem 7.3)

Necessity is Proposition 7.2(1). We prove sufficiency.

Let (an)(a_n) be a Cauchy sequence. By Proposition 7.2(2) it is bounded, so Theorem 6.3 gives a convergent subsequence (ank)(a_{n_k}) with limit LL. We show that the whole sequence (an)(a_n) converges to this LL.

Let ε>0\varepsilon > 0 be arbitrary. First apply Definition 7.1 with ε/2\varepsilon/2 to obtain N1N_1 with

m,nN1    anam<ε2.m, n \ge N_1 \implies |a_n - a_m| < \frac{\varepsilon}{2} .

Next apply ankLa_{n_k} \to L with ε/2\varepsilon/2 to obtain KK with ankL<ε/2|a_{n_k} - L| < \varepsilon/2 for kKk \ge K.

Now put k=max{K,N1}k = \max\{K, N_1\}. Then kKk \ge K, and nkkn_k \ge k (noted in Definition 6.1) gives nkN1n_k \ge N_1. Fix this single index nkn_k. For any nN1n \ge N_1 we have nN1n \ge N_1 and nkN1n_k \ge N_1, so the Cauchy condition applies and

anLanank+ankL<ε2+ε2=ε.|a_n - L| \le |a_n - a_{n_k}| + |a_{n_k} - L| < \frac{\varepsilon}{2} + \frac{\varepsilon}{2} = \varepsilon .

Since ε>0\varepsilon > 0 was arbitrary, anLa_n \to L.

The significance of this theorem is that convergence can be decided without having a candidate for the limit. Whether a sequence converges is settled purely by how close its terms are to one another, so the existence of a limit can be asserted before one knows what the limit is. Convergence tests for series, uniform convergence of sequences of functions, the construction of solutions of differential equations — most existence proofs in analysis have this shape.

Example 7.4A Cauchy sequence that does not converge in the world of rational numbers

Consider the sequence defined by x1=2x_1 = 2 and xn+1=xn2+1xnx_{n+1} = \dfrac{x_n}{2} + \dfrac{1}{x_n} (this is Newton’s method for x2=2x^2 = 2). It starts from a rational number and uses only rational arithmetic, so every xnx_n is rational. Computing,

x1=2,x2=32,x3=34+23=1712,x4=1724+1217=577408=1.4142156x_1 = 2,\quad x_2 = \frac{3}{2},\quad x_3 = \frac{3}{4} + \frac{2}{3} = \frac{17}{12},\quad x_4 = \frac{17}{24} + \frac{12}{17} = \frac{577}{408} = 1.4142156\ldots

which approaches 2=1.4142135\sqrt{2} = 1.4142135\ldots very quickly.

That this converges in R\mathbb{R} follows from Axiom 3.1. First, xn>0x_n > 0 by induction (each term is built from positive numbers). Next, for n1n \ge 1,

xn+12=xn222xn+22xn=(xn2)22xn0x_{n+1} - \sqrt{2} = \frac{x_n^2 - 2\sqrt{2}\,x_n + 2}{2x_n} = \frac{(x_n - \sqrt{2})^2}{2x_n} \ge 0

so xn2x_n \ge \sqrt{2} for n2n \ge 2. Both sides being positive, multiplying the inequality by itself also gives xn22x_n^2 \ge 2. Then

xnxn+1=xn21xn=xn222xn0x_n - x_{n+1} = \frac{x_n}{2} - \frac{1}{x_n} = \frac{x_n^2 - 2}{2x_n} \ge 0

so (xn)n2(x_n)_{n \ge 2} is decreasing with lower bound 2\sqrt{2}. Since (xn)n2(-x_n)_{n \ge 2} is increasing with upper bound 2-\sqrt{2}, Axiom 3.1 applies and it converges, hence so does (xn)(x_n). Writing LL for the limit, xn2x_n \ge \sqrt{2} for all n2n \ge 2 gives L2>0L \ge \sqrt{2} > 0. The sequence (xn+1)(x_{n+1}) is just (xn)(x_n) with shifted indices, so it converges to the same LL, and since L0L \ne 0 the limit law for quotients applies. Passing to the limit on both sides of the recursion gives L=L2+1LL = \dfrac{L}{2} + \dfrac{1}{L}; multiplying by 2L2L and rearranging gives L2=2L^2 = 2, and L>0L > 0 gives L=2L = \sqrt{2}.

Now, since (xn)(x_n) converges in R\mathbb{R}, it is a Cauchy sequence by Proposition 7.2(1). Only rational numbers occur in the Cauchy condition xnxm<ε|x_n - x_m| < \varepsilon, so this is also a “Cauchy sequence inside Q\mathbb{Q}”. Yet by the uniqueness in Remark 2.3 the limit can only be 2\sqrt{2}, which is not rational. In other words, in Q\mathbb{Q} a Cauchy sequence need not converge. Theorem 7.3 is a property specific to R\mathbb{R}.

Example 7.5Proving divergence with the Cauchy condition

Let sn=k=1n1ks_n = \displaystyle\sum_{k=1}^{n} \frac{1}{k}. The sequence (sn)(s_n) is increasing, but whether it is bounded above is not obvious at a glance. Here we use the negation of the Cauchy condition. Pairing the indices nn and 2n2n: as kk runs from n+1n+1 to 2n2n we have k2nk \le 2n and hence 1k12n\dfrac{1}{k} \ge \dfrac{1}{2n}, and there are nn such terms, so

s2nsn=k=n+12n1kn12n=12.|s_{2n} - s_n| = \sum_{k=n+1}^{2n} \frac{1}{k} \ge n \cdot \frac{1}{2n} = \frac{1}{2} .

Therefore, for ε=12\varepsilon = \dfrac{1}{2}, whatever NN we choose the pair n=Nn = N, m=2Nm = 2N satisfies smsnε|s_m - s_n| \ge \varepsilon, so (sn)(s_n) is not a Cauchy sequence. By the contrapositive of Theorem 7.3, (sn)(s_n) does not converge.

Note that divergence was established without invoking any candidate for the limit. The argument used here is exactly the Cauchy criterion for series (Theorem 3.6[級数と収束判定]). Convergence tests for series are treated in detail in Series and convergence tests.

Remark 7.6

The only thing appearing in the definition of a Cauchy sequence is the “distance between two points” anam|a_n - a_m|. The notion therefore lifts to arbitrary metric spaces, and a metric space in which every Cauchy sequence converges is called a complete metric space. The completeness of R\mathbb{R} will reappear in disguise throughout what follows.

In the next chapter, Continuous functions and uniform continuity, we shall see Theorem 6.3 give birth to the extreme value theorem for continuous functions on bounded closed intervals and to uniform continuity (Theorem 7.1[Continuous Functions and Uniform Continuity]). Completeness remains the foundation there as well.

Exercise 8.1Easy

Let SRS \subset \mathbb{R} be non-empty and bounded above, and let LRL \in \mathbb{R}. Show that L=supSL = \sup S holds if and only if the following two conditions hold.

  1. xLx \le L for every xSx \in S.
  2. For every ε>0\varepsilon > 0 there exists xSx \in S with x>Lεx > L - \varepsilon.
Solution

Necessity. Let L=supSL = \sup S. Condition 1 says that LL is an upper bound, which is the first half of Definition 4.1. We prove condition 2 by contradiction. Suppose that for some ε0>0\varepsilon_0 > 0 there is no xSx \in S with x>Lε0x > L - \varepsilon_0. Then every xSx \in S satisfies xLε0x \le L - \varepsilon_0, so Lε0L - \varepsilon_0 is an upper bound of SS. As LL is the least upper bound, LLε0L \le L - \varepsilon_0, i.e. ε00\varepsilon_0 \le 0, contradicting ε0>0\varepsilon_0 > 0.

Sufficiency. Assume conditions 1 and 2. By condition 1, LL is an upper bound. We show it is the least one. Let bb be any upper bound of SS and suppose b<Lb < L. Applying condition 2 with ε=Lb>0\varepsilon = L - b > 0, we obtain xSx \in S with x>Lε=bx > L - \varepsilon = b, contradicting the fact that bb is an upper bound. Hence bLb \ge L, so LL is the least upper bound, i.e. L=supSL = \sup S.

Exercise 8.2Standard

Let In=[an,bn]I_n = [a_n, b_n] (with anbna_n \le b_n) be a sequence of closed intervals with In+1InI_{n+1} \subset I_n for every nn and with bnan0b_n - a_n \to 0. Using Axiom 3.1, show that n1In\bigcap_{n \ge 1} I_n consists of exactly one point (the nested interval principle).

Solution

Preliminaries. The condition In+1InI_{n+1} \subset I_n is equivalent to anan+1a_n \le a_{n+1} and bn+1bnb_{n+1} \le b_n. Hence (an)(a_n) is increasing and (bn)(b_n) is decreasing. Moreover ambna_m \le b_n for all m,nm, n: indeed, if mnm \ge n then ambmbna_m \le b_m \le b_n, and if m<nm < n then amanbna_m \le a_n \le b_n.

Existence of the limit. The sequence (an)(a_n) is increasing and, by the observation above, has b1b_1 as an upper bound. By Axiom 3.1 there is an LL with anLa_n \to L. Since bn=an+(bnan)b_n = a_n + (b_n - a_n) and bnan0b_n - a_n \to 0 by hypothesis, for any ε>0\varepsilon > 0 and nn large enough we get bnLbnan+anL<ε|b_n - L| \le |b_n - a_n| + |a_n - L| < \varepsilon, so bnLb_n \to L.

LL lies in the intersection. Fix nn. Since ambna_m \le b_n for every mm, we have LbnL \le b_n (if L>bnL > b_n, then applying ε=Lbn>0\varepsilon = L - b_n > 0 would give am>Lε=bna_m > L - \varepsilon = b_n for large mm, a contradiction). Similarly anLa_n \le L (if an>La_n > L, then aman>La_m \ge a_n > L for all mnm \ge n, so amLanL>0|a_m - L| \ge a_n - L > 0 persists, contradicting amLa_m \to L). Hence LInL \in I_n, and as nn was arbitrary, LnInL \in \bigcap_n I_n.

Uniqueness. Suppose L,LnInL, L' \in \bigcap_n I_n with LLL \ne L', and set d=LL>0d = |L - L'| > 0. As both lie in InI_n, we have dbnand \le b_n - a_n for every nn; but bnan0b_n - a_n \to 0 gives an nn with bnan<db_n - a_n < d, a contradiction. So the intersection is the single point {L}\{L\}.

Exercise 8.3Standard

Show that the sequence defined by a1=1a_1 = 1 and an+1=2+ana_{n+1} = \sqrt{2 + a_n} (for n1n \ge 1) converges, and find its limit.

Solution

Preliminaries. The existence of c\sqrt{c} for a positive real cc is obtained by the same argument as in the proof of Proposition 4.3 with 22 replaced by cc, so we may use it below.

Boundedness. We show 0<an<20 < a_n < 2 for every nn by induction. For n=1n = 1 we have 0<1<20 < 1 < 2. Assuming 0<an<20 < a_n < 2, we get 2<2+an<42 < 2 + a_n < 4, so by monotonicity of the square root (for positive u,vu, v, u2<v2    u<vu^2 < v^2 \iff u < v) we get 2<an+1<2\sqrt{2} < a_{n+1} < 2, and in particular 0<an+1<20 < a_{n+1} < 2.

Monotonicity. We have an+12an2=(2+an)an2=(an2)(an+1)a_{n+1}^2 - a_n^2 = (2 + a_n) - a_n^2 = -(a_n - 2)(a_n + 1). From 0<an<20 < a_n < 2 we get an2<0a_n - 2 < 0 and an+1>0a_n + 1 > 0, so this quantity is positive. Since an+1>0a_{n+1} > 0 and an>0a_n > 0, this gives an+1>ana_{n+1} > a_n. Hence (an)(a_n) is increasing.

Convergence. Being increasing with upper bound 22, the sequence has a limit LL by Axiom 3.1. From ana1=1a_n \ge a_1 = 1 we get L1>0L \ge 1 > 0 (if L<1L < 1, then for ε=1L>0\varepsilon = 1 - L > 0 the inequality anLa1L=ε|a_n - L| \ge a_1 - L = \varepsilon would hold for every nn, contradicting convergence).

Determining the limit. Square the recursion to get an+12=2+ana_{n+1}^2 = 2 + a_n and let nn \to \infty. The sequence (an+1)(a_{n+1}) is (an)(a_n) with shifted indices, so it converges to the same LL (use the same NN for a given ε\varepsilon: if nNn \ge N then n+1Nn + 1 \ge N, so an+1L<ε|a_{n+1} - L| < \varepsilon). By the limit laws for products and sums (see Limits and continuity (the ε-δ argument)) we get L2=2+LL^2 = 2 + L, i.e. (L2)(L+1)=0(L - 2)(L + 1) = 0. Since L>0L > 0, we conclude L=2L = 2.

Exercise 8.4Hard

Prove the following two statements.

  1. For an=na_n = \sqrt{n} we have an+1an0|a_{n+1} - a_n| \to 0, yet (an)(a_n) is not a Cauchy sequence. Thus “the differences of consecutive terms tend to 00” is not a sufficient condition for being a Cauchy sequence.
  2. If there are constants C>0C > 0 and 0<r<10 < r < 1 with an+1anCrn|a_{n+1} - a_n| \le C r^n for every nn, then (an)(a_n) is a Cauchy sequence and therefore converges.
Solution

(1) Rationalising,

n+1n=(n+1)nn+1+n=1n+1+n12n.\sqrt{n+1} - \sqrt{n} = \frac{(n+1) - n}{\sqrt{n+1} + \sqrt{n}} = \frac{1}{\sqrt{n+1} + \sqrt{n}} \le \frac{1}{2\sqrt{n}} .

Given ε>0\varepsilon > 0, use Theorem 3.2(1) to take N>14ε2N > \dfrac{1}{4\varepsilon^2}. Then for nNn \ge N we have 2n>212ε=1ε2\sqrt{n} > 2 \cdot \dfrac{1}{2\varepsilon} = \dfrac{1}{\varepsilon}, so an+1an<ε|a_{n+1} - a_n| < \varepsilon, proving an+1an0|a_{n+1} - a_n| \to 0.

On the other hand (n)(\sqrt{n}) is not bounded. Given any M>0M > 0, Theorem 3.2(1) supplies an nn with n>M2n > M^2, and then n>M\sqrt{n} > M. By the contrapositive of Proposition 7.2(2), an unbounded sequence is not a Cauchy sequence.

(2) First we show rn0r^n \to 0 for 0<r<10 < r < 1. Since 1r>1\dfrac{1}{r} > 1 we may write 1r=1+h\dfrac{1}{r} = 1 + h with h>0h > 0. Bernoulli’s inequality (1+h)n1+nh(1 + h)^n \ge 1 + nh (by induction on nn: equality for n=1n = 1, and (1+h)n+1(1+nh)(1+h)=1+(n+1)h+nh21+(n+1)h(1+h)^{n+1} \ge (1 + nh)(1 + h) = 1 + (n+1)h + nh^2 \ge 1 + (n+1)h) gives

0<rn=1(1+h)n11+nh<1nh.0 < r^n = \frac{1}{(1+h)^n} \le \frac{1}{1 + nh} < \frac{1}{nh} .

Given ε>0\varepsilon > 0, taking n>1hεn > \dfrac{1}{h\varepsilon} by Theorem 3.2(1) gives rn<εr^n < \varepsilon, so rn0r^n \to 0.

Next let m>nm > n. Applying the triangle inequality repeatedly and using the formula for a geometric sum,

amank=nm1ak+1akk=nm1Crk=Crn1rmn1rCrn1r|a_m - a_n| \le \sum_{k=n}^{m-1} |a_{k+1} - a_k| \le \sum_{k=n}^{m-1} C r^k = C r^n \cdot \frac{1 - r^{m-n}}{1 - r} \le \frac{C r^n}{1 - r}

(the last inequality because 0<1rmn<10 < 1 - r^{m-n} < 1). Given ε>0\varepsilon > 0, since rn0r^n \to 0 we may take NN with rN<ε(1r)Cr^N < \dfrac{\varepsilon(1 - r)}{C}. For m,nNm, n \ge N: if m=nm = n then aman=0<ε|a_m - a_n| = 0 < \varepsilon; if mnm \ne n, letting mm denote the larger index, the estimate above gives

amanCrn1rCrN1r<ε|a_m - a_n| \le \frac{C r^n}{1 - r} \le \frac{C r^N}{1 - r} < \varepsilon

(here rnrNr^n \le r^N because 0<r<10 < r < 1 and nNn \ge N). Hence (an)(a_n) is a Cauchy sequence and converges by Theorem 7.3.

  • Teiji Takagi, Kaiseki Gairon (Introduction to Analysis), revised 3rd ed., Iwanami Shoten (in Japanese) — Chapter 1, “Basic concepts”. A classic treatment that introduces the continuity of the reals by cuts and builds the basic convergence theorems from there.
  • Mitsuo Sugiura, Kaiseki Nyumon I (Introduction to Analysis I), University of Tokyo Press, 1980 (in Japanese) — Chapter I. A detailed account of the axiomatic treatment of the reals and of the relations among suprema, the Archimedean property and the Bolzano–Weierstrass theorem.
  • W. Rudin, Principles of Mathematical Analysis, 3rd ed., McGraw-Hill, 1976 — Chapter 1 (the real and complex number systems, characterisation by the least upper bound property), Chapter 3 (sequences and series, Cauchy sequences and completeness).
  • Kazuo Matsuzaka, Shugo, Iso Nyumon (Introduction to Sets and Topology), Iwanami Shoten, 1968 (in Japanese) — the chapter constructing the reals from the rationals. It covers the construction by cuts and the uniqueness of the complete ordered field up to isomorphism.
  • R. Dedekind, Stetigkeit und irrationale Zahlen (On Numbers: Continuity and Irrational Numbers), Japanese translation by Isaburo Kono, Iwanami Bunko (in Japanese) — a translation of the original 1872 memoir. The way the question “what is the continuity of a line?” is posed is itself worth reading.

Appendix: equivalent formulations of completeness

Section titled “Appendix: equivalent formulations of completeness”

Equivalent formulations. For an ordered field KK the following conditions are all equivalent. Whichever one is chosen as the axiom, the same field of real numbers results.

ConditionStatement
Monotone convergence principleEvery increasing sequence bounded above converges (Axiom 3.1 of this article)
Least upper bound propertyEvery non-empty subset bounded above has a supremum (Theorem 4.2)
Dedekind cutsIf KK is split into two non-empty parts AA, BB such that every element of AA is at most every element of BB, then exactly one of the two — a greatest element of AA or a least element of BB — always exists
Bolzano–WeierstrassEvery bounded sequence has a convergent subsequence (Theorem 6.3)
Nested intervals + Archimedean propertyA nested sequence of closed intervals has a common point, and the Archimedean property holds
Cauchy completeness + Archimedean propertyEvery Cauchy sequence converges, and the Archimedean property holds

Why the Archimedean property is required separately. In the last two rows the Archimedean property is added as an extra condition. Dropping it destroys the equivalence. Indeed, there are known ordered fields that are non-Archimedean and yet in which every Cauchy sequence converges (a field of formal Laurent series with a suitable order is one example), so the Archimedean property cannot be derived from Cauchy completeness alone. By contrast, the monotone convergence principle and the least upper bound property adopted in this article derive the Archimedean property on their own, as we saw in Theorem 3.2. This asymmetry is worth remembering when gauging the “strength” of a form of completeness.

Existence and uniqueness. So far we have argued on the assumption that a complete ordered field R\mathbb{R} exists. Its existence is guaranteed by a construction from the rational field (Dedekind cuts, or completion by equivalence classes of Cauchy sequences). Furthermore, a complete ordered field is known to be unique up to isomorphism of ordered fields. That is why we may speak of the real numbers. For the details of the constructions, see the references above, in particular Matsuzaka’s Shugo, Iso Nyumon and Dedekind’s original memoir.

Report an error in this article ・Operated by: Mugen Giken LLCPricingTermsLegal notice

© 2026 夢現技研合同会社 ・Feeding the text to an LLM is welcome. Code samples are MIT licensed.