How to keep ssh connected when I connect to a VPN tunnel?
The answer was to add --ifconfig-noexec
Quoting from man page:
Don't actually execute ifconfig/netsh commands, instead pass --ifconfig parameters to scripts using environmental variables.
openvpn --ifconfig-noexec --config /path/to/client-config.ovpn