A method of controlling a robot includes: receiving, by a computing device, from one or more sensors, sensor data reflecting an environment of the robot, the one or more sensors configured to have a field of view that spans at least 150 degrees with respect to a ground plane of the robot; providing, by the computing device, video output to an extended reality (XR) display usable by an operator of the robot, the video output reflecting the environment of the robot; receiving, by the computing device, movement information reflecting movement by the operator of the robot; and controlling, by the computing device, the robot to move based on the movement information.
SYSTEMS AND METHODS FOR ROBOTIC MANIPULATION USING EXTENDED REALITY
SYSTEME UND VERFAHREN ZUR ROBOTERMANIPULATION MIT ERWEITERTER REALITÄT
SYSTÈMES ET PROCÉDÉS DE MANIPULATION ROBOTIQUE UTILISANT LA RÉALITÉ ÉTENDUE
2025-01-15
Patent
Electronic Resource
English
SYSTEMS AND METHODS FOR ROBOTIC MANIPULATION USING EXTENDED REALITY
European Patent Office | 2023
|System and method for robotic manipulation using augmented reality
European Patent Office | 2024
|