This paper presents an approach which combines LiDAR sensors and cameras of a mobile multi-sensor system to obtain information about pedestrians in the vicinity of the sensor platform. Such information can be used, for example, in the context of driver assistance systems. In the first step, our approach starts by using LiDAR sensor data to detect and track pedestrians, benefiting from LiDAR’s capability to directly provide accurate 3D data. After LiDAR-based detection, the approach leverages the typically higher data density provided by 2D cameras to determine the body pose of the detected pedestrians. The approach combines several state-of-the-art machine learning techniques: it uses a neural network and a subsequent voting process to detect pedestrians in LiDAR sensor data. Based on the known geometric constellation of the different sensors and the knowledge of the intrinsic parameters of the cameras, image sections are generated with the respective regions of interest showing only the detected pedestrians. These image sections are then processed with a method for image-based human pose estimation to determine keypoints for different body parts. These keypoints are finally projected from 2D image coordinates to 3D world coordinates using the assignment of the original LiDAR points to a particular pedestrian.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Information Acquisition on Pedestrian Movements in Urban Traffic with a Mobile Multi-Sensor System


    Beteiligte:
    Borgmann, Björn (Autor:in) / Hebel, Marcus (Autor:in) / Arens, Michael (Autor:in) / Stilla, Uwe (Autor:in)

    Kongress:

    2021


    Erscheinungsdatum :

    2021


    Format / Umfang :

    8 pages


    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    ADAPTIVELY CONTROLLING TRAFFIC MOVEMENTS FOR PEDESTRIAN SAFETY

    MALKES WILLIAM / OVERSTREET WILLIAMS / PRICE JEFFERY et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    ADAPTIVELY CONTROLLING TRAFFIC MOVEMENTS FOR PEDESTRIAN SAFETY

    MALKES WILLIAM A / OVERSTREET WILLIAM S / PRICE JEFFERY R et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    Adaptively controlling traffic movements for pedestrian safety

    MALKES WILLIAM A / OVERSTREET WILLIAM S / PRICE JEFFERY R et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    A Sensor Network for Urban Traffic Information Acquisition, pp

    Hesheng, Z. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2010


    SN-UTIA: A sensor network for urban traffic information acquisition

    Hesheng Zhang, / Cheng Pan, / Jun Yang, et al. | IEEE | 2010