As published in the Journal of Educational Measurement (JEM), June 14, 2021

Abstract: 

Decision consistency (DC) is the reliability of a classification decision based on a test score. In professional credentialing, the decision is often a high-stakes pass/fail decision. The current methods for estimating DC are computationally complex. The purpose of this research is to provide a computationally and conceptually simple method for estimating DC that produces results comparable to, and at times potentially better than, the widely used Livingston-Lewis method.

Authors and Affiliations:

  • Amanda A. Wolkowitz, Senior Psychometrician, Alpine Testing Solutions, Inc., 51 W. Center Street, #514, Orem, UT 84057, United States