Skip to main content

ProofsPath · 11 min

Induction — Strong vs Weak

Important
For:GeneralResearch

Induction — Strong vs Weak

Why This Matters

Mathematical induction is the basic tool of finite combinatorics and the natural-number companion to well-ordering. There are two forms a contest writer needs to recognize on sight.

Weak (ordinary) induction. To prove P(n)P(n) for all nn0n \ge n_0:

  1. Base: prove P(n0)P(n_0).
  2. Step: assume P(n)P(n) and prove P(n+1)P(n + 1).

Strong induction. To prove P(n)P(n) for all nn0n \ge n_0:

  1. Base: prove P(n0)P(n_0) (sometimes several base cases).
  2. Step: assume P(n0),P(n0+1),,P(n)P(n_0), P(n_0 + 1), \ldots, P(n) and prove P(n+1)P(n + 1).

Over the natural numbers the two are logically equivalent: each implies the other, and both are equivalent to well-ordering. The choice between them is expository, not logical. Use whichever form makes the inductive step easiest to write.

Strong induction is the right tool when:

  • The recursive structure depends on more than just the immediate predecessor (e.g., Fibonacci-type recurrences: an+1a_{n+1} depends on ana_n and an1a_{n-1}).
  • You decompose a size-nn object into pieces of arbitrary smaller sizes (e.g., a polygon triangulated into smaller polygons; an integer factored into smaller integers).
  • The natural recursion does not preserve the immediate-predecessor shape (e.g., halving arguments: f(n)f(n) in terms of f(n/2)f(\lfloor n/2 \rfloor)).

Weak induction is the right tool when:

  • The recursive step is genuinely "one more" (sums, products, cardinalities of {1,2,,n}\{1, 2, \ldots, n\}).
  • The inductive hypothesis at nn is exactly what you need to produce the hypothesis at n+1n + 1.

Picking the wrong form does not break the proof, but it can double the bookkeeping. A practiced writer notices the recursion structure first and matches the induction form to it.

The Principle Itself

Theorem

The Principle of Mathematical Induction

Statement

If P(n0)P(n_0) is true and, for every nn0n \ge n_0, P(n)P(n+1)P(n) \Rightarrow P(n + 1), then P(n)P(n) is true for every nn0n \ge n_0.

Intuition

The natural numbers are generated by starting at n0n_0 and applying "successor" repeatedly. Induction says: a property that survives both the starting point and the successor step must hold at every reachable element, i.e., every natural number n0\ge n_0.

Equivalently, induction is the negation-form of well-ordering: if the set of counterexamples were non-empty, well-ordering gives it a smallest element mm, then P(m1)P(m - 1) true (since mm is smallest counterexample) plus the inductive step forces P(m)P(m) true, contradicting mm being a counterexample.

Proof Sketch

Suppose for contradiction that some mn0m \ge n_0 has P(m)P(m) false. Let S={nn0:P(n) false}S = \{n \ge n_0 : P(n) \text{ false}\}. Then SNS \subseteq \mathbb{N} and SS is non-empty (it contains mm). By well-ordering SS has a smallest element mm^*.

Since P(n0)P(n_0) is true, m>n0m^* > n_0, so m1n0m^* - 1 \ge n_0. Since m1<mm^* - 1 < m^*, m1Sm^* - 1 \notin S, so P(m1)P(m^* - 1) is true. By the inductive step, P(m)P(m^*) is true. But mSm^* \in S says P(m)P(m^*) is false, a contradiction.

Hence SS is empty: P(n)P(n) holds for all nn0n \ge n_0.

Why It Matters

The proof above shows that induction follows from well-ordering. The converse also holds: well-ordering follows from induction (plus a routine argument). So the two are logically equivalent. Most working mathematicians treat induction as the primary tool because it gives a procedure ("how do I produce the proof?") rather than just a guarantee ("a smallest element exists").

Failure Mode

Induction over N\mathbb{N} does not extend to the reals. "P(0)P(0) holds and P(x)P(x+1)P(x) \Rightarrow P(x + 1)" does not give PP on all reals, only on the natural numbers shifted by 0. Continuous analogs require different machinery (the continuity-based approach to induction over [0,1][0, 1], or the transfinite extension to ordinals). The natural-number structure is essential.

Strong Induction in Action: Prime Factorization

Example

Every integer $n \ge 2$ has a prime factorization

Problem. Show that every integer n2n \ge 2 can be written as a product of primes.

Solution. This is the canonical strong-induction problem. Weak induction does not fit naturally because n+1n + 1 does not factor "in terms of" nn. It factors in terms of pairs of smaller numbers whose sizes you do not know in advance.

Base. P(2)P(2): 2 is prime, hence a product of primes (a product with one factor).

Inductive step. Assume P(k)P(k) holds for every 2kn2 \le k \le n; we show P(n+1)P(n + 1).

Case 1: n+1n + 1 is prime. Then n+1n + 1 is itself a product of primes (a one-factor product). P(n+1)P(n + 1) holds.

Case 2: n+1n + 1 is composite. Then n+1=abn + 1 = a \cdot b with 2a,bn2 \le a, b \le n. By the strong inductive hypothesis, both aa and bb have prime factorizations. Concatenating the two gives a prime factorization of n+1n + 1.

In both cases P(n+1)P(n + 1) holds. By strong induction, every n2n \ge 2 has a prime factorization.

Notice that weak induction would not have given access to P(a)P(a) and P(b)P(b); it only gives P(n)P(n), and there is no natural way to extract aa or bb from n+1n + 1 at the rate of "one less". Strong induction is essential.

Weak Induction in Action: Sum of First nn Squares

Example

Sum of the first n squares

Problem. Show 12+22++n2=n(n+1)(2n+1)61^2 + 2^2 + \cdots + n^2 = \frac{n(n + 1)(2n + 1)}{6} for every n1n \ge 1.

Solution. Weak induction fits naturally because the LHS at n+1n + 1 is exactly LHS-at-nn plus (n+1)2(n+1)^2.

Base. n=1n = 1: LHS =1= 1, RHS =1236=1= \frac{1 \cdot 2 \cdot 3}{6} = 1. ✓

Inductive step. Assume k=1nk2=n(n+1)(2n+1)6\sum_{k=1}^n k^2 = \frac{n(n + 1)(2n + 1)}{6}. Add (n+1)2(n + 1)^2 to both sides: k=1n+1k2=n(n+1)(2n+1)6+(n+1)2=(n+1)[n(2n+1)+6(n+1)]6=(n+1)(n+2)(2n+3)6.\sum_{k=1}^{n+1} k^2 = \frac{n(n + 1)(2n + 1)}{6} + (n + 1)^2 = \frac{(n + 1) [n(2n + 1) + 6(n + 1)]}{6} = \frac{(n + 1)(n + 2)(2n + 3)}{6}. This matches the formula at n+1n + 1. ✓

By weak induction the formula holds for every n1n \ge 1.

Strong induction would work here too but is overkill: only P(n)P(n) enters the step, never P(n1)P(n - 1) or earlier.

When the Two Forms Look Very Different

Example

Triangulations of a convex polygon

Problem. Show that every triangulation of a convex nn-gon (using only diagonals between vertices) has exactly n2n - 2 triangles, for n3n \ge 3.

Strong-induction solution. Pick any diagonal in the triangulation; it splits the polygon into a kk-gon and an (nk+2)(n - k + 2)-gon, both convex and both triangulated by the diagonals of the original triangulation that fall on each side. By the strong inductive hypothesis the two sub-polygons contribute (k2)+((nk+2)2)=n2(k - 2) + ((n - k + 2) - 2) = n - 2 triangles.

If there are no diagonals (only possible when n=3n = 3), the polygon is a single triangle: 1=321 = 3 - 2. ✓

Weak-induction solution. Try to set up a proof where P(n)P(n+1)P(n) \Rightarrow P(n + 1). The issue: a triangulation of an (n+1)(n + 1)-gon does not naturally come with an embedded triangulation of an nn-gon. You can construct one (cut off an "ear", a triangle bounded by two adjacent sides of the polygon), but every triangulation has at least two ears, so the cut is non-canonical. The argument is more awkward.

The strong form is easier because the natural recursion is "split into two pieces of arbitrary sizes summing to n+2n + 2", not "remove one piece of size 1".

Common Mistakes

Watch Out

Forgetting the base case

The inductive step alone proves nothing. Without a base case, "P(n)P(n+1)P(n) \Rightarrow P(n + 1)" can hold for an entirely false property: e.g., P(n)P(n) = "n2+n+41n^2 + n + 41 is composite" satisfies the implication trivially when both P(n)P(n) and P(n+1)P(n + 1) are false, but the property is also false for small nn. The base case is what anchors the chain to reality.

Watch Out

Multiple base cases for strong induction

Strong induction with a recursion of depth dd (e.g., an+1=an+an1a_{n+1} = a_n + a_{n - 1} has depth 2) needs dd base cases, not 1. Forgetting this is the most common error in Fibonacci-type problems. Check: when you write the inductive step at the smallest nn where it applies, do all the hypotheses you need actually exist? If the step at n+1n + 1 uses P(n)P(n) and P(n1)P(n - 1), then you need P(n0)P(n_0) and P(n0+1)P(n_0 + 1) as base cases.

Watch Out

Off-by-one on the hypothesis

The inductive hypothesis at nn gives you P(n)P(n), not P(n+1)P(n + 1). A common pattern: the writer assumes "P(n)P(n)" but uses a fact that requires P(n+1)P(n + 1) in disguise. Re-read the step and check that every appeal to the hypothesis really does use P(n)P(n) (or, in strong induction, P(k)P(k) for some knk \le n).

Watch Out

Inducting on the wrong variable

Many problems have multiple natural integer parameters. Picking the wrong one to induct on can make the step impossible. Example: a problem about m×nm \times n grids may need induction on m+nm + n, not on mm alone or nn alone. If your induction seems to stall, try a different inductive parameter.

Watch Out

Reverse induction is a separate technique

Cauchy's proof of AM-GM uses reverse induction: prove P(n)P(n) for nn a power of 2, then "fill in" by showing P(n+1)P(n)P(n + 1) \Rightarrow P(n). This is a valid technique but it is not ordinary induction; treating it as such confuses the direction of implication.

Exercises

ExerciseCore

Problem

Show by induction that 1+3+5++(2n1)=n21 + 3 + 5 + \cdots + (2n - 1) = n^2 for every n1n \ge 1. Decide whether weak or strong induction is the natural fit, and justify briefly.

ExerciseCore

Problem

Show by strong induction that every postage of n8n \ge 8 cents can be made using only 3-cent and 5-cent stamps.

ExerciseAdvanced

Problem

Define the Fibonacci numbers by F1=F2=1F_1 = F_2 = 1 and Fn+1=Fn+Fn1F_{n + 1} = F_n + F_{n - 1} for n2n \ge 2. Show that gcd(Fn,Fn+1)=1\gcd(F_n, F_{n + 1}) = 1 for every n1n \ge 1.

Cross-Network Links

References

See structured references block. Primary entry points: Velleman How to Prove It Ch 6 for the technique with worked examples; Engel Problem-Solving Strategies Ch 1 for olympiad-flavored applications; Knuth TAOCP Vol 1 §1.2.1 for the algorithmic form (loop invariants are induction in disguise); Halmos Naive Set Theory §12 for the foundational construction.