How do I get Windows 7 to NOT use the recycling Bin on a removable drive?

Solution 1:

Recycle Bin is a system directory and gets created anyway. There may be a registry hack, but restoring the OS, or installing a hotfix may reset it - so don't bother.

To avoid seeing the Recycle Bin, do the following:

1. Hide operating system files in "Folder and search options":

   

2. Make sure deleted files do not get copied to the Recycle Bin (by right-clicking it):

   

3. Hide the Recycle Bin by personalizing the desktop:

   

Solution 2:

but Windows still creates the "Recycling Bin" folder

That is pretty easy to be avoided:

Delete the folder, open Notepad and save the blank file as $Recycle.Bin in the root directory of the drive in question, now Windows cannot create the folder.

If you want to use the Recycle Bin again on this drive, just delete the file.