What "futuristic" songs play during Bioshock Infinite and when?

Solution 1:

Song Location
God Only Knows by The Beach Boys Welcome Center
Girls Just Wanna Have Fun by Robert Hazard (another version was recorded and popularized by Cyndi Lauper) Battleship Bay
Tainted Love by Ed Cobb (originally recorded by Gloria Jones) The Graveyard Shift (the bar in Shantytown)
Fortunate Son by Creedence Clearwater Revival Bull Yard
Shiny Happy People by R.E.M. Port Prosperity
Everybody Wants To Rule The World by Tears for Fears Memorial Gardens

Sources:
BioShock Infinite end credits
BioShock Infinite IGN Wiki, "Secret Song Covers" article
@hammar's comment on this answer