Prevent Mail pop up automatically when there's a new email
Solution 1:
IF you go to Notifications > Mail you should be able to change the Mail Alert Style to "None" to avoid mail alerts altogether.
Source: https://discussions.apple.com/thread/4306641