I will drive into town... but I can't drive
It's a bit pedantic to quibble over such use of drive. I've never heard anyone take issue with...
He is sailing to Calais this afternoon
He flew to New York yesterday
...in contexts where he is a passenger (not a sailor or a pilot).