This paper presents an approach which combines LiDAR sensors and cameras of a mobile multi-sensor system to obtain information about pedestrians in the vicinity of the sensor platform. Such information can be used, for example, in the context of driver assistance systems. In the first step, our approach starts by using LiDAR sensor data to detect and track pedestrians, benefiting from LiDAR’s capability to directly provide accurate 3D data. After LiDAR-based detection, the approach leverages the typically higher data density provided by 2D cameras to determine the body pose of the detected pedestrians. The approach combines several state-of-the-art machine learning techniques: it uses a neural network and a subsequent voting process to detect pedestrians in LiDAR sensor data. Based on the known geometric constellation of the different sensors and the knowledge of the intrinsic parameters of the cameras, image sections are generated with the respective regions of interest showing only the detected pedestrians. These image sections are then processed with a method for image-based human pose estimation to determine keypoints for different body parts. These keypoints are finally projected from 2D image coordinates to 3D world coordinates using the assignment of the original LiDAR points to a particular pedestrian.


    Access

    Download


    Export, share and cite



    Title :

    Information Acquisition on Pedestrian Movements in Urban Traffic with a Mobile Multi-Sensor System


    Contributors:

    Conference:

    2021


    Publication date :

    2021


    Size :

    8 pages


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    Unknown




    ADAPTIVELY CONTROLLING TRAFFIC MOVEMENTS FOR PEDESTRIAN SAFETY

    MALKES WILLIAM / OVERSTREET WILLIAMS / PRICE JEFFERY et al. | European Patent Office | 2019

    Free access

    ADAPTIVELY CONTROLLING TRAFFIC MOVEMENTS FOR PEDESTRIAN SAFETY

    MALKES WILLIAM A / OVERSTREET WILLIAM S / PRICE JEFFERY R et al. | European Patent Office | 2019

    Free access

    Adaptively controlling traffic movements for pedestrian safety

    MALKES WILLIAM A / OVERSTREET WILLIAM S / PRICE JEFFERY R et al. | European Patent Office | 2022

    Free access

    Improving Pedestrian Movements in Congested Urban Areas

    Punchihewa, C. S. / Bandara, J. M. S. J. | Springer Verlag | 2023


    A Sensor Network for Urban Traffic Information Acquisition, pp

    Hesheng, Z. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2010