Irreducible, finite Markov chains are positive recurrent

I am under the impression that an irreducible, finite Markov chain is necessarily positive recurrent. How might I show this?

Regards, Jon


You are right. What argument is useful for you depends on your definitions and what you've learned about Markov chains so far.

Here is one way to look at it. If $x$ is a null state, then the chain spends very little time in $x$, more precisely, $${1\over n}\sum_{j=1}^n 1_{[X_j=x]}\to 0 \text{ almost surely.} $$ Therefore, for any finite set $F$ of null states we also have $${1\over n}\sum_{j=1}^n 1_{[X_j\in F]}\to 0 \text{ almost surely.} $$

But the chain must be spending its time somewhere, so if the state space itself is finite, there must be a positive state. A positive state is necessarily recurrent, and if the chain is irreducible then all states are positive recurrent.