Research on emergency teleoperation robot system based on mixed reality
CHEN Chao
WAN Chaoji
YANG Xu
HE Zhizhou
LEI Xiaowu
NIE Hengli
Abstract：In order to avoid the injury of disaster rescuers during the rescue process,this paper proposes an emergency teleoperation robot system based on mixed reality helmets.The system consists of three modules,in which the mixed reality human-computer interaction interface and the digital twin of the interactive robot are designed.The field robot module is equipped with a McLun differential chassis vehicle,and NVIDIA's Jetson Xavier NX developer kit is used to control the robot's movement,and the robotic arm with adaptive grippers is used to grab the target object.A data transfer platform is provided in the cloud server module,and the control instructions are transmitted in real time using a custom data protocol.The experimental results show that the hardware equipment of the system is lightweight,which can make full use of the experience and wisdom of the operator,improve the rescue efficiency,ensure the safety of the rescuers,and further avoid casualties.
Keywords：mixed realityemergency robotsremote operationdigital twin
Publication Date：2024-10-28
Online Publishing Date：2025-08-15(First online date of this platform, not the publication date of the document)
Pages：7( 44-50 )