Do I receive bonuses for the building a leader's unique building replaces?
Yup.
The buildings are fundamentally equivalent in the game, which is why you need to build a Pyramid in every city (instead of a monument) if you're seeking to build the National Epic, and the same thing follows if you're building Steles instead.