Stav dette: Elements of the Theory of Markov processes and their applications