This paper frames a broad set of questions about how preparedness can be meaningfully measured and lays out some of the ingredients needed to answer them, provides some background on the national preparedness system and on current approaches for assessing emergency preparedness, and introduces the concept of response reliability, an alternative way of thinking about measuring preparedness.