This work presents a method of information fusion involving data captured by both a standard charge-coupled device (CCD) camera and a time-of-flight (ToF) camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time-of-flight information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time, this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localisation. Further development of these methods will make it possible to identify objects and their position in the real world and to use this information to prevent possible collisions between the robot and such objects.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Visual sensor fusion for active security in robotic industrial environments



    Erscheinungsdatum :

    2014-06-12


    Anmerkungen:

    doi:10.1186/1687-6180-2014-88
    EURASIP Journal on Advances in Signal Processing 2014, 2014:88



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629





    An architecture for intelligent robotic sensor fusion

    Murphy, Robin Roberson | TIBKAT | 1993


    3D Modeling of Indoor Environments for a Robotic Security Guard

    Biber, P. / Fleck, S. / Duckett, T. | IEEE | 2005


    Visual Sensor Fusion and Data Sharing across Connected Vehicles for Active Safety

    Radha, Hayder / Al-Qassab, Hothaifa / Al-Qizwini, Mohammed et al. | SAE Technical Papers | 2018


    VISUAL SENSOR FUSION AND DATA SHARING ACROSS CONNECTED VEHICLES FOR ACTIVE SAFETY

    RADHA HAYDER / AL-QASSAB HOTHAIFA | Europäisches Patentamt | 2020

    Freier Zugriff