A Markov chain is a directed graph with edge weights summing to 1 at each vertex — a stochastic variant of graph-theory. The stationary distribution is an eigenvector of the transition matrix.