Linux connect to OpenVPN but leave a separate local connection
It's generally called split routing.
You'd have to set up a routing table, telling your operating system that the backup target is reachable over VPN, and the rest of the internet is reachable via some other means.