Skip to main content

Advertisement

Table 3 Agreement between rounds within the same raters and between different pairs of raters in the three rounds

From: Developing a diagnostic checklist of traditional Chinese medicine symptoms and signs for psoriasis: a Delphi study

Agreement status Same rater, different round (mean ± SD) Pairs of raters (mean ± SD)
  First round Second round Third round  
Kappa1 statistics     
First round 1.0 0.12 ± 0.12
Second round 0.34 ± 0.20 1.0 0.16 ± 0.13
Third round 0.42 ± 0.19 0.96 ± 0.06 1.0 0.18 ± 0.12
Intraclass correlation     
coefficient (ICC)     
Agreement 0.23 0.26 0.26
Consistency 0.27 0.29 0.29
  1. 1 Quadratic weighted kappa statistics.
  2. SD, standard deviation; ICC, intraclass correlation coefficient.