Mac Mini with Ubuntu how to restore MacOS
The keyboard light that was blinking helped. Searching for reason where that would happen said there was not enough power to the keyboard. The (non-Apple) keyboard was going through a KVM switch (which actually is powered). So I figured there is something it doesn't like about the keyboard.
After directly connecting an Apple keyboard to the Mac Mini I was able to start the recovery process.