Login / Signup

Reliability of assessment of medical students' non-technical skills using a behavioural marker system: does clinical experience matter?

Benjamin ClarkeSamantha E SmithEmma Claire PhillipsAilsa HamiltonJoanne KerinsVictoria R Tallentire
Published in: BMJ simulation & technology enhanced learning (2020)
Using 11 newly trained raters with high levels of clinical experience produced highly reliable ratings that surpassed the prespecified inter-rater reliability standard; however, a single rater from this group would not achieve sufficiently reliable ratings. This is consistent with previous studies using other medical behavioural marker systems. This study demonstrated a decrease in inter-rater reliability of raters with lower levels of clinical experience, suggesting caution when using this population as raters for assessment of non-technical skills.
Keyphrases
  • medical students
  • healthcare