This paper presents a method to reconstruct three-dimensional object motion trajectories in stereo video sequences. We apply stereo matching to each image pair of a stereo sequence to compute corresponding binocular disparities. By combining instance-aware semantic segmentation techniques and optical flow cues, we track two-dimensional object shapes on pixel level. This allows us to determine for each frame pair object specifc disparities and corresponding object points. By applying Structure from Motion (SfM) we compute camera poses with respect to background structures. We embed the vehicle trajectories into the environment reconstruction by combining the object point cloud of each image pair with corresponding camera poses contained in the background SfM reconstruction. We show qualitative results on the KITTI and CityScapes dataset and compare our method quantitatively with previously published monocular approaches on synthetic data of vehicles in an urban environment. We achieve an average trajectory error of 0:11 meter.


    Access

    Download


    Export, share and cite



    Title :

    3D Object Trajectory Reconstruction using Stereo Matching and Instance Flow based Multiple Object Tracking


    Contributors:

    Publication date :

    2019-01-01


    Remarks:

    Fraunhofer IOSB


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    004 / 629



    3D Object Trajectory Reconstruction using Instance-Aware Multibody Structure from Motion and Stereo Sequence Constraints

    Bullinger, Sebastian / Bodensteiner, Christoph / Arens, Michael et al. | IEEE | 2019


    An Algorithm for Multiple Object Trajectory Tracking

    Han, M. / Xu, W. / Tao, H. et al. | British Library Conference Proceedings | 2004


    Multi-Stereo 3D Object Reconstruction

    Hernandez, C. / Schmitt, F. | British Library Conference Proceedings | 2002


    An algorithm for multiple object trajectory tracking

    Mei Han, / Wei Xu, / Hai Tao, et al. | IEEE | 2004


    Object-Tracking with Stereo Vision

    Huber, E. L. / Baker, K. / American Institute of Aeronautics and Astronautics et al. | British Library Conference Proceedings | 1994