Can we starve to death?
The answer can be found on the minecraft wiki page on hunger.
If you have 90%-100% food you will regain health slowly, but if you have 0% you will lose health instead. On easy the player's health would slowly drop to 5 hearts, 0.5 hearts on normal, and all the way to death on hard.