Shift scroll doesn't horizontally scroll with any external mouse
The issue was that I was using Mos to enable smooth scrolling on my Mac.
However, it removes the ability to scroll horizontally using the shift key by default. To reenable this behavior, go to Mos Settings > Advanced and then select "Shift" as the horizontal scrolling key. That should do it!