How to remove an URL protocol default handler

Edit ~/Library/Preferences/com.apple.LaunchServices.plistin Property List Editor (part of Apple's developer tools) and remove the entry in LSHandlers with the LSHandlerURLScheme in question.

E.g. you'd select and delete Item 12 if you wanted to remove mailto associations on my system:

enter image description here