Supermicro Server fails to boot from NVMe SSD
I have found a solution to this problem. It turns out that it is not possible to boot from NVMe in BIOS mode. Only UEFI is supported. However, my install disk was booted in BIOS mode, so the installer tried to configure things as such. The solution was to go into the BIOS setup, force the boot order to only consider UEFI devices and then re-install the operating system. The Ubuntu Wiki has more information on making sure to install in UEFI mode. In particular, if the boot menu is black rather than purple, you're in UEFI mode.