An observation of a discrete time Markov control process having a finite number of states and possible decisions. Derman (Ann. Math. Stat., 35, 1964) has shown that, for criteria involving limiting average probabilities of visits to state-decision pa...
