Reload driver for USB card reader without restart?
Solution 1:
I have made some progress and a partial answer to my question is that it is not the driver that fails but Apple's smart card daemon. Restarting it
sudo killall pcscd
sudo /usr/sbin/pcscd -fda
has so far solved my problem everytime.