How to delete a building in pixel people
Solution 1:
As far as I know, unless there is another place your worker can move to, you simply can't. A good alternative would be to move the stadium as far away from the rest of your stuff as possible, but I believe that is the best you can do.
Solution 2:
I thought I'd share this here, to to answer half of the question in case people are still looking at this:
"A vital addition to the townscape, the building firm houses the blueprints required to replicate any of the structures sent down by the mothership. Buildings can also be deleted so long as they are not one of a kind. TRIVIA: The interiors department was founded by gifted designer Chen De'Liah."
From Building Firm - Pixel People Wiki.
Also, here's a screenshot from my game, showing that a message "Cannot delete the only building left" appears at the top when when I try to delete a building, of which I only have one:
So, while copies of a building can be deleted, the original cannot.
This is still true as of update 1.60 (Oct 23, 2013)