Support for HTML in Swing Components is limited to 3.2, but valign="middle" should work.
valign="middle"