Remove / hide the "All Apps" shortcut from the Start Menu --- or uninstall them totally

Solution 1:

Part 1. Install Classic Shell open Settings then the Customize Start Menu tab. Drag Apps out of Current menu items into Available commands.

Part 2. Now they're hidden try to ignore them. Tweak Control Panel, Default Programs to replace where possible with programs you prefer.

Classic Shell's Customize Start Menu tab