Ubutnu 20.04 fresh install / no bootable device
After some searching I have found the following answer: https://askubuntu.com/questions/913397/how-to-change-ubuntu-install-from-legacy-to-uefi. The issues was that my live USB only boots in BIOS mode (rather than UEFI) and thus incorrectly installs Ubuntu.