Why is it "hats off" and not "hat's off"?
Solution 1:
It's "hats" because it's implied that there are multiple hats involved.
Hats off to Susan for doing such a great job.
This is an invitation for everyone (except Susan) to take their (figurative) hats off to congratulate Susan on her hard work.