The use of partially automated driving systems raises concerns about potential responsibility issues, posing risk to the system safety, acceptance, and adoption of these technologies. The concept of meaningful human control has emerged in response to the responsibility gap problem, requiring the fulfillment of two conditions, tracking and tracing. While this concept has provided important philosophical and design insights on automated driving systems, there is currently little knowledge on how meaningful human control relates to subjective experiences of actual users of these systems. To address this gap, our study aimed to investigate the alignment between the degree of meaningful human control and drivers’ perceptions of safety and trust in a real-world partially automated driving system. We utilized previously collected data from interviews with Tesla "Full Self-Driving" (FSD) Beta users, investigating the alignment between the user perception and how well the system was tracking the users’ reasons. We found that tracking of users’ reasons for driving tasks (such as safe maneuvers) correlated with perceived safety and trust, albeit with notable exceptions. Surprisingly, failure to track lane changing and braking reasons was not necessarily associated with negative perceptions of safety. However, the failure of the system to track expected maneuvers in dangerous situations always resulted in low trust and perceived lack of safety. Overall, our analyses highlight alignment points but also possible discrepancies between perceived safety and trust on the one hand, and meaningful human control on the other hand. Our results can help the developers of automated driving technology to design systems under meaningful human control and are perceived as safe and trustworthy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Meaningful Human Control Perspective on User Perception of Partially Automated Driving Systems: A Case Study of Tesla Users


    Contributors:


    Publication date :

    2024-06-02


    Size :

    914759 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    User Perception of Partially Automated Driving Systems: A Meaningful Human Control Perspective on the Perception among Tesla Users

    Suryana, Lucas Elbert / Nordhoff, Sina / Calvert, Simeon C. et al. | ArXiv | 2024

    Free access

    Driver Behavior While Operating Partially Automated Systems: Tesla Autopilot Case Study

    Osafo-Yeboah, Benjamin / Rockwell, Chris / Shutko, John et al. | SAE Technical Papers | 2018


    Driver Behavior While Operating Partially Automated Systems: Tesla Autopilot Case Study

    Shutko, John / Osafo-Yeboah, Benjamin / Rockwell, Chris et al. | British Library Conference Proceedings | 2018


    Full platoon control in Truck Platooning: A Meaningful Human Control perspective

    Calvert, Simeon C. / Mecacci, Giulio / Heikoop, Daniel D. et al. | IEEE | 2018


    Driving tomorrows cars: Tesla Roadster

    Reynolds,K. / Tesla,US | Automotive engineering | 2008