The use of partially automated driving systems raises concerns about potential responsibility issues, posing risk to the system safety, acceptance, and adoption of these technologies. The concept of meaningful human control has emerged in response to the responsibility gap problem, requiring the fulfillment of two conditions, tracking and tracing. While this concept has provided important philosophical and design insights on automated driving systems, there is currently little knowledge on how meaningful human control relates to subjective experiences of actual users of these systems. To address this gap, our study aimed to investigate the alignment between the degree of meaningful human control and drivers’ perceptions of safety and trust in a real-world partially automated driving system. We utilized previously collected data from interviews with Tesla "Full Self-Driving" (FSD) Beta users, investigating the alignment between the user perception and how well the system was tracking the users’ reasons. We found that tracking of users’ reasons for driving tasks (such as safe maneuvers) correlated with perceived safety and trust, albeit with notable exceptions. Surprisingly, failure to track lane changing and braking reasons was not necessarily associated with negative perceptions of safety. However, the failure of the system to track expected maneuvers in dangerous situations always resulted in low trust and perceived lack of safety. Overall, our analyses highlight alignment points but also possible discrepancies between perceived safety and trust on the one hand, and meaningful human control on the other hand. Our results can help the developers of automated driving technology to design systems under meaningful human control and are perceived as safe and trustworthy.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Meaningful Human Control Perspective on User Perception of Partially Automated Driving Systems: A Case Study of Tesla Users


    Beteiligte:


    Erscheinungsdatum :

    02.06.2024


    Format / Umfang :

    914759 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    User Perception of Partially Automated Driving Systems: A Meaningful Human Control Perspective on the Perception among Tesla Users

    Suryana, Lucas Elbert / Nordhoff, Sina / Calvert, Simeon C. et al. | ArXiv | 2024

    Freier Zugriff

    Driver Behavior While Operating Partially Automated Systems: Tesla Autopilot Case Study

    Shutko, John / Osafo-Yeboah, Benjamin / Rockwell, Chris et al. | British Library Conference Proceedings | 2018


    Driver Behavior While Operating Partially Automated Systems: Tesla Autopilot Case Study

    Osafo-Yeboah, Benjamin / Rockwell, Chris / Shutko, John et al. | SAE Technical Papers | 2018


    Full platoon control in Truck Platooning: A Meaningful Human Control perspective

    Calvert, Simeon C. / Mecacci, Giulio / Heikoop, Daniel D. et al. | IEEE | 2018


    Driving tomorrows cars: Tesla Roadster

    Reynolds,K. / Tesla,US | Kraftfahrwesen | 2008