Force a headless server to load video drivers for the GPU?

I am running a headless server on Ubuntu, with the objective of using GPU's for non graphics computation. However, I have found that without the monitor plugged in the kernel fails to load the graphics drivers.

Is there any reason that I can't use modprobe or some other mechanism to force the driver to load at boot (I have no idea if the driver will tolerate the absence of a monitor), or am I taking the wrong route entirely?

What's the best practice for resolving this?

A VGA or DVI dummy plug will allow the GPU to start without a monitor. For example, these can be purchased or built yourself.