This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. ; Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019 ; Cataloged from student-submitted PDF version of thesis. ; Includes bibliographical references (pages 103-112). ; In recent years, intensive research has centered around using small, perception-driven robotic systems (e.g. quadrotor vehicles) for complex tasks at operational speeds. Although much progress has been made towards that end in the fields of online-planning, fast-perception, and agile-control, most robotic systems are still confined to controlled laboratory settings due to cost, safety, and repeatability. In this thesis, we introduce a few novel contributions that we believe could assist the greater robotics community to bring their robotics systems out of the lab and into the real world. First, we introduce FlightGoggles, a photorealistic sensor simulator for perception-driven robotic vehicles. FlightGoggles provides photorealistic exteroceptive sensor simulation using graphics assets generated with photogrammetry and provides the ability to combine synthetic exteroceptive measurements generated in silico in real time and vehicle dynamics and proprioceptive measurements generated in motio by vehicle(s) in flight in a motion-capture facility. Second, we present The Blackbird Dataset, a large-scale dataset for UAV perception in aggressive flight containing over 10 hours of flight data across 171 flights at velocities up to 13.8ms⁻¹ in 5 environments with some dynamic elements. Third, we introduce a virtual reality framework for FlightGoggles that enables multi-agent or robot-human interaction in a safe manner by superimposing position data from multiple motion capture spaces into a unified virtual reality environment. Fourth, we propose an extension of FlightGoggles using augmented reality for aircraft-in-the-loop experiments that aims to aid sim-to-real transfer from simulated to real-world cameras. Lastly, we study applications of FlightGoggles in the greater robotics community through the AlphaPilot autonomous drone racing challenge and survey approaches and results from the top AlphaPilot teams, which may be of independent interest. ; by Winter Joseph Guerra. ; M. Eng. ; M.Eng. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science
Photorealistic sensor simulation for perception-driven robotics using virtual reality
2019-01-01
1145019349
Hochschulschrift
Elektronische Ressource
Englisch
DDC: | 629 |
Non-photorealistic rendering as a feedback strategy in virtual reality for rehabilitation
BASE | 2024
|British Library Online Contents | 1997
|Photorealistic scene presentation: virtual video camera
SPIE | 1994
|Reality and Virtual Reality in Mobile Robotics
British Library Conference Proceedings | 2000
|Virtual reality simulator for robotics learning
IEEE | 2015
|