Error while installing virtualbox

Solution 1:

This (french) article describes the same error on Debian : Virtualbox & vboxdrv.
The solution there was to delete two files and reinstall Virtualbox as follows

rm -r /etc/init.d/vboxdrv
rm -r /var/lib/update-rc.d/vboxdrv 
apt-get install virtualbox virtualbox-dkms virtualbox-guest-utils virtualbox-guest-additions virtualbox-qt

The article also lists a solution that works for Fedora :

/etc/init.d/vboxdrv setup

A comment later remarks that apt-get purge virtualbox should have been used instead of apt-get remove, which would have also removed the init script, so maybe this is the real cause of your problem, that can be solved simply by doing purge.