If I uninstall Minecraft Forge, will it also remove the mods I installed?

If you launch the forge client, you should be able to enable and disable mods. If you launch the regular Minecraft client, you will not be able to play your Forge mods at all. All you have to do is launch the default client for Minecraft, and not the Forge one.

Deleting the Forge client shouldn't remove any mods that you installed, the Forge client is just a way to access those mods, it doesn't actually contain the mods in the client. The mods you install are stored in a separate file then the client. If you want to play without mods then get the standard Minecraft client or Badlion client, either one should work.