How can I annex a puppet city in Civilization V?

Solution 1:

Just left click it =)

Solution 2:

As Jens says, if you click on the city name, a dialog box should pop up asking if you want to annex the city, or if you want to leave it as a puppet (and it should indicate the Happiness impact of such a decision).

Is this not the case for you?