How to prevent automatic emptying of Deleted Items when exiting Outlook 2010?

Click on the "File" tab, and select "Options".

Switch to the "Advanced" pane, and clear the "Empty Deleted Items folders when exiting Outlook" option:

Advanced Options pane