Crowdsourcing to Assess Speech Quality Associated With Velopharyngeal Dysfunction.
Kaylee PaulsgroveErin MillerKristy SeidelSara L KinterRaymond TsePublished in: The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association (2020)
Crowdsourcing shows promise as a rapid way to obtain large numbers of speech assessments. Reliability of repeated assessments was acceptable. Large groups of naive raters yield comparable evaluations of overall speech acceptability, intelligibility, and quality, but are not consistent with expert raters for specific speech characteristics such as resonance and nasal air emission.