A new method for agreement evaluation based on AC1
ZHANG Jingwen
XU Jun
AN Shengli
Abstract：Medical studies use various methods for assessing agreement among different raters or measurement methods. Many of these coefficients have limitations,and among them the paradoxes of kappa are the best known.To achieve a higher accuracy and reliability, we propose an alternative statistic method based on AC1, known as CEA, which adjusts the chance agreement. We explored the influences of the prevalence rate and chance agreement probability on the total agreement and compared the accuracy and stability of kappa, AC1and CEA coefficient through simulations and real data analysis. The proposed method offers a stable and reliable option for assessing agreement of binary data.
Keywords：agreementKappa coefficientAC1coefficientcategorical variables
Publication Date：2018-01-01
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：5( 455-459 )