Change Windows explorer font size

I'd like to increase the font size in Windows Explorer. By default it's very small, and I don't really like that for navigating folders and finding files.

Here's what it looks like by default:

When I change the font-size to Medium (125%) in Control Panel > Appearance and Personalization > Display:

(To best see the differences, open the images above in new tabs as they are scaled when shown on this page.)

The problem is that increasing the font size to Medium affects everything, and some things just look very odd at that size, like icon captions, title bars and things like that.

Is there a way to change the font size for Windows Explorer only?

1. Go to Windows 10 Settings (shortcut: Win + I)
2. Ease of Access->Display
3. Make text bigger OR Make everything bigger