| Complete agreement at first reading | Two categories at first reading | Three categories at first reading | Four categories at first reading | Inter-observer values at first reading | Inter-observer values at second reading | Intra-observer agreement (Mean kappa) |
---|---|---|---|---|---|---|---|
All 12 raters | 41.9 | 40.0 | 15.2 | 2.9 | 0.61 | 0.59 | 0.73 |
8 senior raters | 58.1 | 30.5 | 11.4 | - | 0.66 | 0.70 | 0.77 |
4 junior registrars | 56.2 | 38.1 | 5.7 | - | 0.59 | 0.50 | 0.66 |
4 senior registrars | 65.7 | 27.6 | 6.7 | - | 0.63 | 0.72 | 0.79 |
4 consultants | 67.6 | 27.6 | 4.8 | - | 0.66 | 0.67 | 0.74 |