Effect of detailing the teaching ward rounds scoring rubric on improving scoring consistency
Zhang Aiwu
Jiang Tao
Fu Yuanzheng
Zhao Guoxiang
Gao Zhen
Yu Caixia
Guo Wanwei
Abstract：Objective To explore the improvement of scoring consistency in teaching ward rounds supervision of standardized residency training through detailing the teaching ward rounds scoring rubric,and analyze its practical application.Methods A total of 24 internal supervisory experts from the Affiliated Guangdong Second Provincial People's Hospital of Jinan University were randomly divided into two groups:the standard group and the modified group.The standard group used the Teaching Ward Rounds Guidelines for Standardized Residency Training(2021 Edition)scoring rubric,while the modified group used a detailed version of the same rubric.Each teaching ward round was independently scored by two supervisory experts,with the scoring process accompanied by staff from the Department of Medical Education to ensure consistency.Pearson correlation coefficients between sub-items and total scores,as well as internal reliability indicators(Cronbach's α),were calculated.In addition,intraclass correlation coefficients(ICC)were used to analyze scoring consistency,and a Z-test was performed to compare group differences.Results From July to September 2024,a total of 28 teaching ward round activities were supervised,with 15 in the standard group and 13 in the modified group.The modified group demonstrated significantly higher consistency in total scores and 15 sub-items compared with the standard group(P<0.001).In terms of sub-item consistency,except for"Preparation 3,""Implementation 4/7/9","Skills 4"and"Overall Impression 4",other sub-items in the modified group showed significantly better consistency than in the standard group(all P<0.05).The Cronbach's α value of the modified group's scoring rubric was 0.769,higher than 0.708 of the standard group,indicating higher internal consistency and reliability.Conclusion Detailing the teaching ward rounds scoring rubric can significantly improve scoring consistency and offers an effective approach to enhance supervision quality.
Keywords：standardized residency trainingteaching ward roundsin-hospital supervisionscore consistency
Publication Date：2025-11-20
Online Publishing Date：2025-11-17(First online date of this platform, not the publication date of the document)
Pages：5( 815-819 )