How to always insert single and double quotes?
The problem lies in your keyboard layout which uses 'dead keys', probably your keyboard layout is US International.
Go to System Preferences -> Language and Text -> Input Sources and choose another layout, such as US Extended.