Block/Remove "Web"/Bing Search from Windows 10
Solution 1:
One of the more recent builds (10162) supports doing this through the standard search interface.
Simply click in the windows search text box, click the "Gear" icon, and use the slider below the text "Search online and include web results".
Solution 2:
Answer was found here.
Workaround, figured there would be a GPO for it. Bring up the group policy editor (gpedit.msc), go to Computer Configuration->Administrative Templates->Windows Components->Search. Enable the policies called "Don't search the web or display web results in Search" and the one right after it that's for metered connections. That'll get it off the start menu anyway, the search app itself still uses Bing of course. The settings screen is obviously bugged.