What's the difference between simple induction and strong induction?

Solution 1:

With simple induction you use "if $p(k)$ is true then $p(k+1)$ is true" while in strong induction you use "if $p(i)$ is true for all $i$ less than or equal to $k$ then $p(k+1)$ is true", where $p(k)$ is some statement depending on the positive integer $k$.

They are NOT "identical" but they are equivalent.

It is easy to see that if strong induction is true then simple induction is true: if you know that statement $p(i)$ is true for all $i$ less than or equal to $k$, then you know that it is true, in particular, for $i=k$ and can use simple induction.

It is harder to prove, but still true, that if strong induction is true, then simple induction is true. That is what we mean by "equivalent".

Here we have a question. It is not why we still have "weak" induction - it's why we still have "strong" induction when this is not actually any stronger.

My opinion is that the reason this distinction remains is that it serves a pedagogical purpose. The first proofs by induction that we teach are usually things like $\forall n\left[\sum_{i=0}^n i= \frac{n(n+1)}{2}\right]$. The proofs of these naturally suggest "weak" induction, which students learn as a pattern to mimic.

Later, we teach more difficult proofs where that pattern no longer works. To give a name to the difference, we call the new pattern "strong induction" so that we can distinguish between the methods when presenting a proof in lecture. Then we can tell a student "try using strong induction", which is more helpful than just "try using induction".

Solution 2:

One example of the use of strong induction is in the inductive proof that any prime $p\not \equiv 3 \pmod 4$ is the sum of squares of two integers. We have $2=1^2+1^2.$ For prime $p\equiv 1 \pmod 4,$ at some point in the proof we need to employ the inductive hypothesis that every prime $q$ such that $p>q\not \equiv 3 \pmod 4$ is the sum of two squares, because (after a fair bit of other work) such a $q$ appears in the algebra but we don't know which one it is.