Professional Documents
Culture Documents
310 Induction
310 Induction
As it stands, this statement is neither true nor false: 8 is a variable and whether the statement is
true or false depends on what value of 8, from what universe, we're talking about. However,
is a (true) proposition. It asserts that a certain statement is true for every 8 in the universe .
is true for 8 œ "ß #ß $ß ÞÞÞ ß %! and then conclude that the statement is true for all natural
numbers 8. This would be an example of a conclusion drawn by “induction” in the
everyday use of the word. But this conclusion is incorrect: for 8 œ %",
8# 8 %" œ %"# %" %" œ %"# is not prime.
Both of these principles seem intuitively clear (see the discussion in class). We will see why they
are actually equivalentÞ For the moment, let's just practice using them.
3 œ
8
8Ð8 "Ñ
Example 1 Let T Ð8Ñ be the statement À # or more informally
3œ"
8Ð8 "Ñ
" ÞÞÞ 8 œ #
Prove that Ða8 − Ñ T Ð8Ñ is true.
Proof i) Step i) is called the base case for the induction the “starting point.”
T Ð"Ñ is the statement 3 œ
"
"Ð""Ñ
# , which is true.
3œ"
A good idea: write out T Ð5 "Ñ to be clear about what it says. T Ð5 "Ñ reads:
3 œ
5"
Ð5 "ÑÐ5 #Ñ Ð5 "ÑÐ5 #Ñ
# or, more informally, " ÞÞÞ 5 Ð5 "Ñ œ #
3œ"
To do this:
3 œ 3 Ð5 "Ñ œ
5" 5
5Ð5 "Ñ 5Ð5 "Ñ #Ð5 "Ñ Ð5 "ÑÐ5 #Ñ
# Ð5 "Ñ œ # œ #
3œ" 3œ"
Å by the induction hypothesis
which says that T Ð5 "Ñ is true. By PMI, a8 − T Ð8Ñ is true that is, T Ð8Ñ is true for all
8 − . ñ
Example 2 (PCI) Prove that every natural number 8 " is either a prime or a product of
primes. If we count a prime number as being a product of primes with “just one factor,” then we
could say that “every natural number bigger than " can be factored into primes.”
This is one part of the Fundamental Theorem of Arithmetic; the other part (which we will not
prove until later) says that the factorization is unique except for the order of the factors.
More formally, we are supposed to prove: a8 − T Ð8Ñ, where T Ð8Ñ is the (equivalent)
statement:
Ð8 œ "Ñ ” Ð8 is primeÑ ” Ð8 can be factored into primes)
ii) Suppose 5 " and assume T Ð8Ñ is true for all 8 5Þ (This is the “induction
hypothesis.”) We must show T Ð5Ñ is true.
Notice the similarities and differences between using PMI and PCI as illustrated in Examples 1
and 2.
With both methods, we need to start by verifying a base case: in Example 1-2, that T Ð"Ñ
is true.
With both methods, we need to prove that T Ð8Ñ is true for a certain value of 8 under a
certain assumption. This is the “induction step.”
a) With MI (Example 1), we need to show, assuming that T Ð5Ñ is true for some
value 5 , that T Ð5 "Ñ is also true À the induction hypothesis only involves a
single natural number 5 , the “immediate predecessor” of 5 "Þ
To illustrate: With PMI, the induction step shows, for example, that if
T Ð$Ñ is true, then T Ð%Ñ must also be true.
To illustrate: With PCI, then induction step shows, for example, that if
T Ð"Ñ and T Ð#Ñ and T Ð$Ñ are true, then T Ð%Ñ must be true.
The shift from using 5 " in the induction step (in PMI) to using 5 in the induction step (in PCI)
is a just a minor notational shift that is convenient and traditional: it's not really a significant
“difference” in the methods. The main difference is that PCI seems to give us much more to work
with than PMI: with PCI, we assume that all of T Ð"Ñß ÞÞÞß T Ð5 "Ñ are true and try to use this
information prove T Ð5Ñ. PCI seems to give us many more assumptions to use in proving T Ð5Ñ is
true.
In light of this observation, it may be surprising that PMI and PCI turn out to be logically
equivalent: either both are true statements about or both are false statements about .
If we assume PCI, we can prove PMI is also true, and vice-versa. (We will show this soon.)
However, this does not mean that they are equally useful in a given situation.
In Example 2, it's hard to see how we could prove that 5 factors into primes if the
induction assumption were only about the single number preceding 5 that is, if the
induction assumption were merely that 5 " factors into primes. In the proof in
Example 2, we need to know, somehow, that : and ; are products of primes and that's
what the induction hypothesis using PCI gives us!
Here's a more vivid illustration of PMI and PCI that might fix them in your memory:
PMI states that i) if " is red and ii) if a natural number must be red whenever its
immediate predecessor is red, then all natural numbers must be red.
PCI states that i) if " is red and ii) if a natural number must be red whenever all
its predecessors are red, then all natural numbers must be red.
There is another useful property of , called the well-ordering principle, that can sometimes be
used to prove a statement of the form a8 − T Ð8Ñ. It is stated in terms of subsets of .
Intuitively, this seems clear: if there were a nonempty subset E of with no smallest
element, we could choose a number +" − E; since E has no smallest element, there
would be an +# − E where +# +" à since +# is not the smallest element in E, there
would be a stiller smaller number +$ − E. Continuing in this way we could write down
an infinite decreasing sequence of natural numbers: +" +# +$ ÞÞÞ +8 ÞÞÞ and
this is intuitively impossible. Try it!
Suppose, say, +" œ "!$#"(à what could +# be? +$ ? Can you find an “infinite
descending sequence” "!$#"( +# +$ ÞÞÞ +8 ÞÞÞ ?
Notice that in this intuitive argument, we need that E Á g À that assumption is how we
get +" in E to start with. In fact, if E œ g, then E doesn't contain a smallest
element because E has no elements at all.
Can we justify rigorously why WOP a true statement about ? It turns out (another surprise?)
that all three of WOP, PMI and PCI are logically equivalent. As we will see later, PMI is “built-
into” the system at a very fundamental level, when is constructed from set theory and
therefore PCI and WOP are automatically “built-in” too. All three are very fundamental facts
about .
Because PMI, PCI and WOP are logically equivalent, any proof that can be done using one them
could also be done (at least in principle) using the otherÞ Sometimes one is more convenient to
use than the other, and sometimes choosing between them is just a matter of taste.
The following example gives a proof of the result in Example 1 using WOP instead of PMI.
Notice the difference in the approach; but equally important, notice the similarities in the algebra
that comes up. You can decide whether you prefer this argument to the one using PMI in
Example 1.
3 œ
5
5Ð5 "Ñ
# is false (*) and
3œ"
Since 3 œ
"
"Ð" "Ñ
# is true, we know 5 Á "ß so 5 "Þ Therefore 8 œ 5 " is still a natural
3œ"
number and smaller than 5 , so T Ð5 "Ñ must be true:
3 œ
5"
Ð5"ÑÐÐ5 " Ñ "Ñ Ð5"ÑÐ5 Ñ
# œ # is true. (**)
3œ"
Since the assumption that E Á g leads to a contradiction, it must be that E œ g; in other words,
3 œ
8
8Ð8 "Ñ
# is true for all 8 − . ñ
3œ"
Mathematical induction (in any of the equivalent forms PMI, PCI, WOP) is not just used to prove
equations. Example 2, in fact, uses PCI to prove part of the Fundamental Theorem of Arithmetic.
Examples 4 and 5 illustrate using induction to prove an inequality and to prove a result in
calculus.
ii) ÐInduction stepÑ Assume that T Ð5Ñ is true for some particular 5 − : for this 5 , /5 " 5Þ
We need to prove that T Ð5 "Ñ must be true, that is À /5" " Ð5 "Ñ œ # 5
So T Ð5 "Ñ is true.
. 8
Example 5 Prove that if 8 is a natural number, then .B B œ 8B8" Þ ÐYou many assume the
product rule for derivatives.Ñ
. 8
Proof Let T Ð8Ñ be the statement: .B B œ 8B8"
.
i) T Ð"Ñ is the statement that .B B œ " † B"" œ " † B! œ "
This is true from calculus, but we assume that you could prove it using the definition of
derivative: for 0 ÐBÑ œ Bß .B.
B œ lim 0 ÐB2Ñ2 0 ÐBÑ œ lim ÐB 22Ñ B œ lim 22 œ lim " œ "Þ
2Ä! 2Ä! 2Ä! 2Ä!
. 5
ii) Assume that .B B œ 5B5" for some particular 5 − (the induction hypothesis).
. 5" . 5 . 5 .
.B B œ .B ÐB † BÑ œ Ð .B B Ñ † B B5 Ð .B BÑ œ Ð5B5" ÑB B5 Ð"Ñ œ 5B5 B5 œ Ð5 "ÑB5
Å Å
the product rule by the induction hypothesis and
because T Ð"Ñ is true
WOP is stated in terms of sets: every nonempty subset of contains a smallest element. To
prove that the three statements are equivalent, we will reformulate PMI and PCI in the language
of set theory. Then each of PMI, PCI, WOP will be a statements about certain subsets of
Suppose W © Þ
i) checking that “T Ð"Ñ is true” is the same as checking that “" − W ,” and
ii) checking that “if T Ð5Ñ is true for some 5 , then T Ð5 "Ñ must also be true”
is the same as checking that “if 5 − W , then 5 " − W ”
______________________________________________________________________
Suppose W © Þ
i) checking that “T Ð"Ñ is true” is the same as checking that “" − W ,” and
ii) checking that
“when 5 " and T Ð8Ñ is true for every 8 5 , then T Ð5Ñ must also be true”
is the same as checking that
“when 5 " and 8 − W for every 8 5 , then 5 − WÞ
However, it's possible to state the set theoretic version of PCI more efficiently (and this is
what the textbook does) without mentioning i) at all. Simply drop “5 "” from ii) and
rewrite PCI as follows:
Suppose W ©
According to (*), to prove that W œ we should look at all 5 in (not just 5 ", as in
Part ii) on the preceding page) and argue that Ö8 − À 8 5× © W Ê 5 − W .
So why did I break off Step i) as a separate step? It wasn't necessary to do that. But
when 5 œ ", there are no 8's 5 , so when we try to show T Ð"Ñ is true, there aren't any
“previous values of 8” for which T Ð8Ñ is assumed to be true that is, T Ð"Ñ has to be
established “from scratch” without any “induction assumptions” to work with and
therefore it's usually done in a different way than when 5 "Þ Therefore, in practice, we
might as well state the case 5 œ " separately. It's probably a little clearer that way, even
if not quite so efficient as (*).
Perhaps you feel that WOP is easier to believe than the other two. But (to repeat) PMI,
PCI and WOP are equivalent statements: either all three are true statements in , or
none of them is true in .
Since is constructed from set theory in a way that makes PMI true (as we shall see),
all three statements are true in .
Proof We will show that the three statements are equivalent by giving three separate arguments
to show that:
Strategy: We will show (using PMI) that for every 8, Ö"ß #ß ÞÞÞß 8× © W . If that is
true, then 8 − W for every 8, which tells us that © WÞ Since we already
know W © ß we will conclude that W œ .
b) Assume that for some particular value 5 ,, we have Ö"ß #ß ÞÞÞß 5× © W that is,
assume Ö8 À 8 5 "× © WÞ By (*), we conclude that 5 " − WÞ Therefore
Ö"ß #ß ÞÞÞß 5ß 5 "× © WÞ
i) Since E has no smallest element, " Â E, so " − W . Since " − W is true, the
conditional statement ÐÖ5 À 5 "×Ñ Ê Ð" − WÑ is true.
Since 8  Wß we know 8 ". Therefore 5 œ 8 " is still natural number, and since 8
is the smallest natural number not in W , we must have 8 " − WÞ Let 5 œ 8 "Þ Then
5 − W but 5 " œ 8  W . This proves (*) (see the strategy). ñ
There are minor generalizations of PMI and PCI that are easy to use. Essentially they say that
the “base case” for the induction can be any integer 5! ; we don't have to start at ".
We put this at the end of these notes because, in fact, we could easily do without them (see the
final two examples). For example, here is the Generalized PMI; there is a similar generalization
for PCI, which you can easily write down.
Notice that here ™ is used in the hypothesis instead of . The only reason for that is to allow the
base case (“starting point”) for the induction to possibly be a negative integer 8! . The induction
could start, say, at 8 œ $Þ But in that case, the conclusion is NOT W œ ™; just that
W œ Ö8 − ™ À 8 $× œ “all integers the base case.”
i) 5! − W , and
then W œ Ö8 − ™ À 8 5! ×
To use GPMI: If we want to prove that T Ð8Ñ is true for all 8 ( (or all 8 $) we would
ii) Assume that T Ð5Ñ is true for some particular 5 ( (or some 5 $Ñ
and argue that T Ð5 "Ñ must also be true.
Since every natural number 8 automatically satisfies 8 "ß the last statement is equivalent to
ÐBe sure you're convinced that Ð‡Ñ and Ї‡Ñ are equivalent.Ñ