This work presents an application of the Microsoft Kinect camera for an autonomous mobile robot. In order to drive autonomously one main issue is the ability to recognize signalling panels positioned overhead. The Kinect camera can be applied in this task due to its double integrated sensor, namely vision and distance. The vision sensor is used to perceive the signalling panel, while the distance sensor is applied as a segmentation filter, by eliminating pixels by their depth in the object’s background. The approach adopted to perceive the symbol from the signalling panel consists in: a) applying the depth image filter from the Kinect camera; b) applying Morphological Operators to segment the image; c) a classification is carried out with an Artificial Neural Network and a simple Multilayer Perceptron network that can correctly classify the image. This work explores the Kinect camera depth sensor and hence this filter avoids heavy computational algorithms to search for the correct location of the signalling panels. It simplifies the next tasks of image segmentation and classification. A mobile autonomous robot using this camera was used to recognize the signalling panels on a competition track of the Portuguese Robotics Open.


    Access

    Download


    Export, share and cite



    Title :

    Vision and distance integrated sensor (Kinect) for an autonomous robot



    Publication date :

    2011-01-01


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Binocular Vision Sensor (Kinect)-Based Pedestrian Following Mobile Robot

    Zhang, Huang ;Yan, Rui Jun ;Zhou, Wen Shen | Trans Tech Publications | 2014


    A Robot Collision Avoidance Method Using Kinect and Global Vision

    Wu, Haibin / Huang, Jianfeng / Yang, Xiaoning et al. | BASE | 2017

    Free access

    Autonomous Exploration Using Kinect and Laser Range Finder

    J. Du / D. Dresscher / S. Stramigioli et al. | BASE | 2012

    Free access


    Human Body Kinematics and the Kinect Sensor

    Ganea, D. / Mereuta, E. / Mereuta, C. | British Library Conference Proceedings | 2014