What does "A horse may stumble, though he has four feet." mean?

Solution 1:

It means that even when something is very steady (four feet firmly planted on the ground), it can still be unstable at times. The implication is that a firm foundation isn't always enough, even though it's a very good start.