SMS dit: Finite state markovian decision processes