The invention is a method of using computer vision to control systems consisting of a combination of holonomic and nonholonomic degrees of freedom such as a wheeled rover equipped with a robotic arm, a forklift, and earth-moving equipment such as a backhoe or a front-loader. Using vision sensors mounted on the mobile system and the manipulator, the system establishes a relationship between the internal joint configuration of the holonomic degrees of freedom of the manipulator and the appearance of features on the manipulator in the reference frames of the vision sensors. Then, the system, perhaps with the assistance of an operator, identifies the locations of the target object in the reference frames of the vision sensors. Using this target information, along with the relationship described above, the system determines a suitable trajectory for the nonholonomic degrees of freedom of the base to follow towards the target object. The system also determines a suitable pose or series of poses for the holonomic degrees of freedom of the manipulator. With additional visual samples, the system automatically updates the trajectory and final pose of the manipulator so as to allow for greater precision in the overall final position of the system.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    Mobile camera-space manipulation


    Contributors:

    Publication date :

    2001-02-27


    Type of media :

    Miscellaneous


    Type of material :

    No indication


    Language :

    English




    Camera manipulation tool development

    Kellow, Barri | BASE | 2021

    Free access

    Space Robotics: Towards an Architecture for Autonomous Mobile Manipulation

    Vasile, Massimiliano / Becerra, Victor M. / Kirchner, Frank et al. | AIAA | 2014


    Pre-image Backchaining in Belief Space for Mobile Manipulation

    Kaelbling, Leslie Pack / Lozano-Pérez, Tomás | British Library Conference Proceedings | 2011


    VEHICLE CAMERA SYSTEM WITH IMAGE MANIPULATION

    LU YUESHENG | European Patent Office | 2020

    Free access

    Vehicle camera system with image manipulation

    LU YUESHENG | European Patent Office | 2021

    Free access