To show that a pure, stationary optimal policy that minimizes expected cost per unit time exists for all Markov renewal programs with a finite state space and finite action space. (The results do not extend to the case where the action space is coun...
