Numerical Solution of Markov Chains