Do special buildings need citizens to produce benefits?
The building will still have its normal effect without assigning people to it. In this case, a bank with no merchant will still add +25% gold.
Specialist slots just give you the option of creating a specialist in that building. They won't directly affect how effective the building is but they do produce resources and, more importantly, great person points.