In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form of reducing the search space, several methods to extract point cloud data and a mobile robot to interact with the objects. The framework consists of the following components: The implementation of a CNN to extract a Region of Interest (ROI) from an image corresponding to a door or cabinet. Several vision based techniques to detect handles inside the ROI and its 3D positioning. A complementary plane segmentation method to differentiate door/cabinet from the handle. An algorithm to fuse both approaches robustly and extract essential information from the handle for robotic grasping (i.e. handle point cloud, door plane model, grasping locations, turning orientation, orthogonal vector to door). A mobile robot for grasping the handle. The system assumes no prior knowledge of the environment.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping


    Beteiligte:

    Erscheinungsdatum :

    2017-01-01


    Anmerkungen:

    Maurin , A L , Ravn , O & Andersen , N A 2017 , Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping . in Proceedings of 2017 3rd International Conference on Control, Automation and Robotics . IEEE , pp. 144-9 , 2017 3rd International Conference on Control, Automation and Robotics , Nagoya , Japan , 24/04/2017 . https://doi.org/10.1109/ICCAR.2017.7942676



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Grasping Unknown Objects Using Convolutional Neural Networks

    Krishna Prasad, Pranav (M.Sc.) | BASE | 2020

    Freier Zugriff

    Grasping Unknown Objects Using Convolutional Neural Networks

    Krishna Prasad, Pranav / Stähle, Benjamin / Chernov, Igor et al. | BASE | 2020

    Freier Zugriff

    Real-Time Traffic Sign Recognition Using Convolutional Neural Networks

    Rao, Aditya / Motwani, Rahul / Sarguroh, Naveed et al. | Springer Verlag | 2021



    Car door grasping device

    LIU XIAOBO / JIAO JING / ZHANG YU et al. | Europäisches Patentamt | 2023

    Freier Zugriff