This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. ; Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019 ; Cataloged from student-submitted PDF version of thesis. ; Includes bibliographical references (pages 103-112). ; In recent years, intensive research has centered around using small, perception-driven robotic systems (e.g. quadrotor vehicles) for complex tasks at operational speeds. Although much progress has been made towards that end in the fields of online-planning, fast-perception, and agile-control, most robotic systems are still confined to controlled laboratory settings due to cost, safety, and repeatability. In this thesis, we introduce a few novel contributions that we believe could assist the greater robotics community to bring their robotics systems out of the lab and into the real world. First, we introduce FlightGoggles, a photorealistic sensor simulator for perception-driven robotic vehicles. FlightGoggles provides photorealistic exteroceptive sensor simulation using graphics assets generated with photogrammetry and provides the ability to combine synthetic exteroceptive measurements generated in silico in real time and vehicle dynamics and proprioceptive measurements generated in motio by vehicle(s) in flight in a motion-capture facility. Second, we present The Blackbird Dataset, a large-scale dataset for UAV perception in aggressive flight containing over 10 hours of flight data across 171 flights at velocities up to 13.8ms⁻¹ in 5 environments with some dynamic elements. Third, we introduce a virtual reality framework for FlightGoggles that enables multi-agent or robot-human interaction in a safe manner by superimposing position data from multiple motion capture spaces into a unified virtual reality environment. Fourth, we propose an extension of FlightGoggles using augmented reality for aircraft-in-the-loop experiments that aims to aid sim-to-real transfer from simulated to real-world cameras. Lastly, we study applications of FlightGoggles in the greater robotics community through the AlphaPilot autonomous drone racing challenge and survey approaches and results from the top AlphaPilot teams, which may be of independent interest. ; by Winter Joseph Guerra. ; M. Eng. ; M.Eng. Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Photorealistic sensor simulation for perception-driven robotics using virtual reality



    Erscheinungsdatum :

    2019-01-01


    Anmerkungen:

    1145019349


    Medientyp :

    Hochschulschrift


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    Non-photorealistic rendering as a feedback strategy in virtual reality for rehabilitation

    Quintana, David / Rodríguez Benítez, Antonio / Sbert, Mateu et al. | BASE | 2024

    Freier Zugriff

    Virtual reality and robotics

    Tachi, S. | British Library Online Contents | 1997


    Photorealistic scene presentation: virtual video camera

    Johnson, Michael J. / Rogers, Joel Clark W. | SPIE | 1994


    Reality and Virtual Reality in Mobile Robotics

    Duffy, B. / O'Hare, G. / O'Donoghue, R. et al. | British Library Conference Proceedings | 2000


    Virtual reality simulator for robotics learning

    Crespo, Raul / Garcia, Rene / Quiroz, Samuel | IEEE | 2015