Discrete stochastic processes, numerical methods for Markov chains and polynomial time algorithms.- Stochastic optimal control problems...