This paper reviews a variety of recently proposed models for the analysis of observer agreement. The discussion includes latent class and latent trait models, signal detection theory models, item response and Rasch models, association and quasi-symme...