Microsoft Word: delete blank lines or empty paragraphs
Solution 1:
@mutzmatron is right, replacing ^p^p with ^p actually is the proper way.
However, when my documents contains e.g. ^p^p^p^p or similar, it won't pick them all up and will again leave ^p^p. So I've to run this search/replace operation a few times until all cases have been covered.