New posts in markov-chains

Power of Stochastic Matrix

matrices markov-chains exponentiation stochastic-matrices

Equilibrium distributions of Markov Chains

probability stochastic-processes markov-chains

Expected number of turns for a rook to move to top right-most corner?

probability markov-chains

How do Markov Chain Chatbots work?

artificial-intelligence probability chatbot markov-chains

Stochastic kernel as linear operator

probability-theory stochastic-processes operator-theory markov-chains

1D random walk-probability to go back to origin

probability-theory markov-chains random-walk

Irreducible, finite Markov chains are positive recurrent

probability markov-chains

What are some modern books on Markov Chains with plenty of good exercises?

reference-request stochastic-processes markov-chains book-recommendation

Is a Markov chain the same as a finite state machine?

math statistics state-machine fsm markov-chains

Convergence of discrete-time Markov chain to Feller processes

probability-theory stochastic-processes markov-chains markov-process stochastic-analysis

Example of a Markov chain transition matrix that is not diagonalizable?

linear-algebra examples-counterexamples markov-chains

Limit of power of Markov matrix

linear-algebra matrices limits markov-chains

Characterize stochastic matrices such that max singular value is less or equal one.

linear-algebra matrices markov-chains

Transition matrix exercise

probability stochastic-processes markov-chains markov-process transition-matrix

Can you hear the pins fall from bowling game scores?

recreational-mathematics markov-chains dimension-theory-analysis manifolds-with-boundary inverse-problems

Perron-Frobenius theorem

linear-algebra matrices markov-chains

is it possible to have a variable amount of elifs in an if/elif/else chain?

python loops logic markov-chains

Game of draughts, expected value of first move advantage

probability combinatorics markov-chains expected-value gambling

2D Random Walk Hitting Time

probability markov-chains random-walk

Why is PageRank an eigenvector problem?

linear-algebra eigenvalues-eigenvectors markov-chains