Does OS X Keep A Log Of Downloaded Files On My Mac?

Yes, at: ~/Library/Preferences/com.apple.LaunchServices.QuarantineEvents.

OS X uses the data in this file for the warning messages that come up when you open a downloaded app.