How well do workplace-based assessments support summative entrustment decisions? A multi-institutional generalisability study.
Michael S RyanKatherine A GielissenDongho ShinRobert A PereraMaryellen GusicGary FerenchickAllison OwnbyWilliam B CutrerVivian ObesoSally A SantenPublished in: Medical education (2024)
The results from this study describe relatively low reliability in the WBAs obtained across seven sites. Generalisability for these instruments may be less dependent on factors such as faculty development, rater engagement or scale selection. When used for formative feedback, data from these instruments may be useful. However, such instruments do not consistently provide reasonable reliability to justify their use in high-stakes summative entrustment decisions.