With the growing prevalence of site surveillance cameras and rapid developments in computer vision techniques, much effort has been made to develop vision-based safety monitoring methods. An excavator is one of the most used pieces of construction equipment, yet its revolving mechanical arm poses major risks for struck-by accidents. Previous works that leverage computer vision techniques have attempted to monitor such risks by capturing a 3D representation of the excavator arm using either stereo vision or deep learning models. However, stereo vision requires rigid camera setups, while deep learning models require vast amounts of annotated 3D excavator pose, which are cumbersome to collect from real excavators. These drawbacks limit the practicality of such methods in actual construction applications. Therefore, we propose an optimization-based algorithm capable of estimating 3D excavator poses using monocular camera images with no dependency on annotated 3D training data. Specifically, the proposed algorithm attempts to find the optimal 3D excavator pose by imposing rigid kinematic constraints (e.g., arm length and bending directions) while also minimizing re-projection joint errors in 2D. The kinematic constraints help to resolve the inherent depth ambiguity from 2D images, while the re-projection 2D joint errors serve as the objective function for the optimization process. Tests using synthetically generated data sets showed a mean 3D location error of 0.16 m for key excavator joints, demonstrating the capabilities of this proposed optimization-based method. Moreover, the proposed method does not require the demanding preparation works typically required for collecting 3D excavator poses, making it a practical tool to facilitate excavator safety monitoring in actual construction environments.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3D Excavator Pose Estimation: Direct Optimization from 2D Pose Using Kinematic Constraints


    Contributors:
    Wen, Leyang (author) / Kim, Daeho (author) / Liu, Meiyin (author) / Lee, SangHyun (author)

    Conference:

    ASCE International Conference on Computing in Civil Engineering 2021 ; 2022 ; Orlando, Florida



    Publication date :

    2022-05-24




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    3D Excavator Pose Estimation: Direct Optimization from 2D Pose Using Kinematic Constraints

    Wen, Leyang / Kim, Daeho / Liu, Meiyin et al. | TIBKAT | 2022


    Kinematic self retargeting: A framework for human pose estimation

    Zhu, Y. / Dariush, B. / Fujimura, K. | British Library Online Contents | 2010


    POSE ESTIMATION

    CHAKRAVARTY PUNARJAY / MISHRA SUBODH / PARCHAMI MOSTAFA et al. | European Patent Office | 2023

    Free access

    Pose Estimation Using LBP

    Solai, K. / Raajan, N.R. | IEEE | 2018


    Object pose estimation

    SHRIVASTAVA SHUBHAM / PANDEY GAURAV / CHAKRAVARTY PUNARJAY | European Patent Office | 2024

    Free access