Markov chains: is "aperiodic + irreducible" equivalent to "regular"?

Solution 1:

For a finite MC it holds that

aperiodic + irreducible $\Leftrightarrow$ ergodic $\Leftrightarrow$ regular

as you expected. For an infinite MC it holds that

aperiodic + irreducible + positive recurrent $\Leftrightarrow$ ergodic,

and being "regular" in the infinite setting would require a more precise definition.

................................ explanations following ................................

For every finite or inifinite Markov chain (MC) it holds that

$aperiodic + irreducible + positive~recurrent \Leftrightarrow ergodic$.

See for example here for a proof. For every finite MC, irreducibility already implies positive recurrence, see here for a proof.

Further, for every finite MC we have that

$aperiodic + irreducible \Leftrightarrow regular$.

Proof sketch: the definition of a finite irreducible MC gives that $\forall i, j \in \Omega : \exists k > 0 : P^k[i,j] > 0$. However, there might be no $k$ such that all entries are simultaneously positive - due to periodicities. But if the chain is additionally aperiodic, it follows that $\exists k > 0 : \forall i, j \in \Omega : P^k[i,j] > 0$, which matches your definition of being regular.

Finally, I don't see a canonical way how you would generalize the property "regular" to infinite Markov chains. So, I just ignore the term "regular" for infinite chains here.