In denumerable state, denumerable action sequential decision problems in which the reward function has uniformly bounded second moment, the optimal reward for the decisionmaker who restricts himself to the countable set of stationary policies consist...