E pluribus unum: prospective acceptability benchmarking from the Contouring Collaborative for Consensus in Radiation Oncology crowdsourced initiative for multiobserver segmentation.
Diana LinKareem A WahidBenjamin E NelmsRenjie HeMohammed A NaserSimon DukeMichael V ShererJohn P ChristodouleasAbdallah S R MohamedMichael CisloJames D MurphyClifton D FullerErin F GillespiePublished in: Journal of medical imaging (Bellingham, Wash.) (2023)
Multiple nonexpert-generated consensus ROIs met or exceeded expert-derived acceptability thresholds. Five nonexperts could potentially generate consensus segmentations for most ROIs with performance approximating experts, suggesting nonexpert segmentations as feasible cost-effective AI inputs.