The first thing to say is that punctuation isn't grammar. The second thing to say is that punctuation is there to help the reader and if it doesn't do that it serves no purpose. In your example, either the exclamation mark or the comma would be helpful. The two together most certainly are not.