How to start a math blog?

I'd like to start a blog where I can write mathematics related notes. The intended audience is mainly myself, but I don't mind it being available for public viewing. I'd like to keep setting up, installation, etc. down to the bare minimum, and edilikewise cost. While blog hosting services are a dime a dozen, they don't usually allow for the smooth integration of math and text, as on this forum, for instance. Any tips will be much appreciated.

EDIT: After exploring several alternatives (see my comment to Qiaochu Yuan's answer below), I've settled on Blogger + Math Jax (see Antti Yrjonen's step by step guide, including Sobresaliente's comment to it).

Why Blogger rather than WordPress? Because WordPress.com does not enable to install the Math Jax plugin.

Why do I need the MathJax plugin for? What's wrong with WordPress's native LaTeX support? For one, I'd like to be able to copy-and-paste between this forum (math.stackexchange.com) and my blog.

Wordpress is a fairly straightforward answer. There are already many math blogs on it, e.g. Terence Tao's and Tim Gowers'. Requires minimal setup.

If you don't want such a complex panel or want to start simple.

Just make an account on "http://blogger.com" or "https://www.tumblr.com/". They are very straight forward. And later you can move on to a professionally managed platform if you start getting a lot of traffic.