Research on assessment method of human operational capability in complex discrete operational tasks under extreme environments

ZHENG Jian; WANG Meng; QIN Haibo; HU Yong; CAO Ziqing; WANG Yanlei; HUANG Weifen

doi:10.16289/j.cnki.1002-0837.2025.06007

Abstract：Objectives To establish an assessment method of operational capability on using work sample tests,select typical complex discrete operational tasks under extreme environments,and obtain baseline data from a representative population;to evaluate the discriminability,reliability,and other psychometric metrics of the assessment method;and to propose recommendations for scoring criteria in operational capability testing.Methods The assessment method was designed according to the"five unifications"requirements of work sample tests,including the selection of typical extreme environment operational tasks,evaluation metrics,and test procedures.A pre-experiment involving 10 volunteers was conducted to preliminarily validate the test procedures,finalize the selected operational tasks,and streamline evaluation metrics.Forty volunteers completed a formal experiment which was evaluating human operational capability by high-complexity and medium-complexity discrete extreme environment operational tasks.Performance metrics such as task completion time and accuracy scores were analyzed.Results(1)Operational accuracy scores significantly decreased as task complexity increased.A significant positive correlation was observed between accuracy scores of medium-complexity and high-complexity tasks(P<0.01).(2)For medium-complexity tasks,accuracy scores were significantly negatively correlated with task completion time(P<0.01),indicating higher accuracy corresponded to shorter completion times.(3)The split-half method was used to analyze the reliability of the experiment results,with a reliability coefficient of 0.66,demonstrating good reliability.The methods,materials,and expert evaluations were derived from actual extreme environment missions,confirming the test's validity.Conclusions The operational capability assessment method based on work sample tests which was proposed in this paper can effectively evaluate human operational capability in discrete complex operational tasks within the extreme environment domain.