Table 3 Agreement between rounds within the same raters and between different pairs of raters in the three rounds
Agreement status | Same rater, different round (mean ± SD) | Pairs of raters (mean ± SD) | ||
|---|---|---|---|---|
| Â | First round | Second round | Third round | Â |
Kappa1 statistics | Â | Â | Â | Â |
First round | 1.0 | — | — | 0.12 ± 0.12 |
Second round | 0.34 ± 0.20 | 1.0 | — | 0.16 ± 0.13 |
Third round | 0.42 ± 0.19 | 0.96 ± 0.06 | 1.0 | 0.18 ± 0.12 |
Intraclass correlation | Â | Â | Â | Â |
coefficient (ICC) | Â | Â | Â | Â |
Agreement | 0.23 | 0.26 | 0.26 | — |
Consistency | 0.27 | 0.29 | 0.29 | — |