An extension of RM-5208, [Multichain Markov Renewal Programs], to cover the case of completely ergodic MRPs. Policies that are nearly optimal for small discount rates are found by linear programming. More precisely, the policies are [(g,w)]-optimal...