Design and empirical evidence of a teaching performance evaluation scheme for supervising physicians in comprehensive hospitals based on key performance indicators

Shi Dandan; Xu Zhongqing; Chen Bo; Huang Qiong; Mi Yikai; Fan Xiaoyu

doi:10.3969/j.issn.2096-4293.2025.04.006

Abstract：Objective To construct a supervising physicians teaching performance evaluation plan based on key performance indicators for comprehensive hospitals and verify its feasibility.Methods Using literature research and,guided by the Structure Process Outcome(SPO)model,the teaching performance of residency training teachers in comprehensive hospitals was divided into three dimensions:teacher ethics and style,teaching ability(structure);teaching process(process);and teaching outcomes(results).Combined with expert consultation and key performance indicator(KPI)identification methods,a supervising physicians teaching performance evaluation index system was generated,which included 4 primary indicators and 11 secondary indicators,and corresponding scoring methods were designed to form an evaluation plan.Reliability calculation,difficulty calculation and discrimination calculation were conducted using the teaching performance evaluation scores of 605 supervising physicians in 2022 and 2023.The questionnaire survey method was used to calculate the content validity of the indicator system,and to analyze the feasibility and scientificity of the plan.Results The average score of teaching performance evaluation in 2022 was(22.43±11.28)points,and the average score of teaching performance evaluation in 2023 was(24.18±12.04)points,with a test-retest reliability of 0.892.The difficulty coefficient for implementing the teaching performance plan in 2023 was 0.242,and the discrimination index was 0.521.The content validity index(CVI)of 11 secondary indicators was>0.7,corresponding to a total CVI of>0.7 for the primary indicators.Conclusion This study constructs a supervising physicians teaching performance evaluation plan for comprehensive hospitals,with good robustness,good content validity,good discrimination and certain difficulty,which can be used for the performance evaluation of supervising physicians teaching.