Objective: To assess the ability of otolaryngology residents to rate the hypernasal resonance of patients with velopharyngeal dysfunction. We hypothesize that experience (postgraduate year [PGY] level) and training will result in improved ratings of speech samples.
Study design: Prospective cohort study.
Setting: Otolaryngology training programs at 2 academic medical centers.
Subjects and methods: Thirty otolaryngology residents (PGY 1-5) were enrolled in the study. All residents rated 30 speech samples at 2 separate times. Half the residents completed a training module between the rating exercises, with the other half serving as a control group. Percentage agreement with the expert rating of each speech sample and intrarater reliability were calculated for each resident. Analysis of covariance was used to model accuracy at session 2.
Results: The median percentage agreement at session 1 was 53.3% for all residents. At the second session, the median scores were 53.3% for the control group and 60% for the training group, but this difference was not statistically significant. Intrarater reliability was moderate for both groups. Residents were more accurate in their ratings of normal and severely hypernasal speech. There was no correlation between rating accuracy and PGY level. Score at session 1 positively correlated with score at session 2.
Conclusion: Perceptual training of otolaryngology residents has the potential to improve their ratings of hypernasal speech. Length of time in residency may not be best predictor of perceptual skill. Training modalities incorporating practice with hypernasal speech samples could improve rater skills and should be studied more extensively.
Keywords: cleft palate; hypernasal resonance; resident education; velopharyngeal dysfunction.
© American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.