How should I punctuate/capitalize the following question? [closed]

The capitalization is correct, and a third option you could consider is

“What’s that—a dishrag?”

using an em dash.

This punctuation guide may interest you.