Understanding Windows Routing Tables and Default Gateways
Solution 1:
Failback to default route is normal behaviour since Vista, you can read about this in the following article: Source IP address selection on a Multi-Homed Windows Computer.
Loop issue caused by misconfigured router, which sends packets back using different subnet, instead of dropping them.