In an effort to streamline and simplify URAC’s scoring approach across accreditation programs, the Quality, Research, and Measurement (QR&M) team embarked on a project to discover the simplest approach to accreditation scoring while maintaining accuracy and rigor. Through the engagement of a professional statistician, robust methods were used to approximate a “true and real” application review score and compare it to seven unique scenarios that were then tested using four methods of score calculation.

Based on the analysis and findings, adoption recommendations were then developed through consensus, in collaboration with Product Development (PD) and Accrediting and Client Services (AC&S).  Recommended scoring parameters and adoption method were presented to and unanimously adopted by the Executive Team on September 12, 2019. Major components of the new methodology, currently termed the “2-4-8” method, include:

• Element will be assigned weights of 2, 4, or 8, where most current mandatory standards will be transformed into a weight of 8.
• Introduction of “Mandatory Gatekeepers”, or those vital few Element of Performance Groups that must be met for an organization to achieve accreditation or certification. If missed, the organization will be recommended to the Accreditation Committee for denial.
• Elimination of module multipliers (i.e., 0.30 for Core and 0.70 for Module).
• Roll-up method (i.e., averaging of points at the Element of Performance Group level) is maintained with modification.
• Elimination of “partially met” for weighted elements.

The benefits to this implementation are the reduced number of scoring approaches (from six to one), a reduction in scoring calculation steps by 40%, mandatory EPGs will be counted once and reduced by at least 50% in any given program, roll-up changes will ensure equitable contribution of points based on the level within the standards hierarchy, and the elimination of the “partially met” designation aligns rating scales across weighted and mandatory elements, while also supporting the way in which standards are currently being written.

At this time, QR&M, PD and AC&S are working through adopting this method into new program offerings, namely Population Health, Independent Medical Examiner, and Contact Center; as well as evaluating the approach within the Case Management program. This scoring methodology will be employed for all new programs and revisions moving forward. 

We are excited by this work and will keep you apprised of updates as we move forward.