New posts in markov-chains

Is ergodic markov chain both irreducible and aperiodic or just irreducible?

If $P$ is the transition matrix of a reversible Markov chain, why are its eigenvalues real?

eigenvalues-eigenvectors markov-chains

Transformation of state-space that preserves Markov property

probability-theory markov-chains markov-process

How can I obtain or sample a random Rubiks Cube shuffle?

markov-chains recreational-mathematics random-walk sampling rubiks-cube

Why is this stochastic process a Markov chain?

probability probability-distributions stochastic-processes markov-chains conditional-probability

Probability brain teaser with infinite loop

probability markov-chains puzzle

Are finite state irreducible continuous Markov chains identifiable in general?

statistics markov-chains maximum-likelihood transition-matrix

About eigenvalues of probability matrices

linear-algebra markov-chains

Time to reach a final state in a random dynamical system (answer known, proof unknown)

combinatorics probability-theory discrete-mathematics markov-chains

Is this stochastic matrix has a steady state equivalent to Perron Frobenius theorem？

linear-algebra markov-chains markov-process

How often does it happen that the oldest person alive dies?

statistics markov-chains actuarial-science