How do you enter binary numbers in OS X Calculator?

Click "show binary" button, this shows in your screenshot, and then you can click the "bit" you want to set.