This paper presents a method to reconstruct three-dimensional object motion trajectories in stereo video sequences. We apply stereo matching to each image pair of a stereo sequence to compute corresponding binocular disparities. By combining instance-aware semantic segmentation techniques and optical flow cues, we track two-dimensional object shapes on pixel level. This allows us to determine for each frame pair object specifc disparities and corresponding object points. By applying Structure from Motion (SfM) we compute camera poses with respect to background structures. We embed the vehicle trajectories into the environment reconstruction by combining the object point cloud of each image pair with corresponding camera poses contained in the background SfM reconstruction. We show qualitative results on the KITTI and CityScapes dataset and compare our method quantitatively with previously published monocular approaches on synthetic data of vehicles in an urban environment. We achieve an average trajectory error of 0:11 meter.


    Access

    Download


    Export, share and cite



    Title :

    3D Object Trajectory Reconstruction using Stereo Matching and Instance Flow based Multiple Object Tracking


    Contributors:

    Publication date :

    2019-01-01


    Remarks:

    Fraunhofer IOSB


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    004 / 629



    3D OBJECT TRAJECTORY RECONSTRUCTION USING INSTANCE-AWARE MULTIBODY STRUCTURE FROM MOTION AND STEREO SEQUENCE CONSTRAINTS

    Bullinger, Sebastian / Bodensteiner, Christoph / Arens, Michael et al. | British Library Conference Proceedings | 2019


    3D Object Trajectory Reconstruction using Instance-Aware Multibody Structure from Motion and Stereo Sequence Constraints

    Bullinger, Sebastian / Bodensteiner, Christoph / Arens, Michael et al. | IEEE | 2019


    Visual object tracking based on objectness measure with multiple instance learning

    Hua, Weixin / Mu, Dejun / Guo, Dawei et al. | British Library Online Contents | 2017


    An algorithm for multiple object trajectory tracking

    Mei Han, / Wei Xu, / Hai Tao, et al. | IEEE | 2004


    An Algorithm for Multiple Object Trajectory Tracking

    Han, M. / Xu, W. / Tao, H. et al. | British Library Conference Proceedings | 2004