Highlights Develop a dataset of Mars scenes from numerous raw Mars images. Compare performance of three common deep learning models to select the appropriate one. Conduct transfer learning and data augmentation to enhance selected model’s generation capacity. Deep learning can realize autonomous, real-time Martian terrain classification.

    Abstract Scene information plays a crucial role in motion control, attitude perception, and path planning for wheeled planetary rovers (WPRs). Terrain recognition is the fundamental component of scene recognition. Due to the rich information, visual sensors are usually used in terrain classification. However, teleoperation delay prevents WPRs from using visual information efficiently. End-to-end learning method of deep learning (DL) that does not need complex image preprocessing was proposed to deal with this issue. This paper first built a terrain dataset (consists of loose sand, bedrock, small rock, large rock, and outcrop) using real Mars images to directly support You Only Look Once (YOLOv5) to test its performance on terrain classification. Because the capability of end-to-end training scheme is positively correlated with dataset, the performance of YOLOv5 can be significantly improved by exploiting orders of magnitude more data. The best combination of hyperparameters and models was achieved by slightly tuning YOLOv5, and data augmentation was also applied to optimize its accuracy. Furthermore, its performance was compared with two other end-to-end network architectures. Deep learning algorithms can be used in the future planetary exploration missions, such as WPRs autonomy improvement, traversability analysis, and avoiding getting trapped.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Terrain classification using mars raw images based on deep learning algorithms with application to wheeled planetary rovers


    Beteiligte:
    Guo, Junlong (Autor:in) / Zhang, Xingyang (Autor:in) / Dong, Yunpeng (Autor:in) / Xue, Zhao (Autor:in) / Huang, Bo (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-04-17


    Format / Umfang :

    6 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Vibration-based terrain classification for planetary exploration rovers

    Brooks, C.A. / Iagnemma, K. | Tema Archiv | 2005


    Terrain Classification and Classifier Fusion for Planetary Exploration Rovers

    Halatci, Ibrahim / Brooks, Christopher A. / Iagnemma, Karl | IEEE | 2007


    Terrain Adaptive Navigation for Mars Rovers

    Matthies, Larry H. / Helmick, Daniel M. / Angelova, Anelia et al. | NTRS | 2007


    Terrain Adaptive Navigation for Mars Rovers

    Helmick, Daniel M. / Angelova, Anelia / Livianu, Matthew et al. | IEEE | 2007


    Design issues for Mars planetary rovers

    Lee, Gordon K. F. / Dejarnette, Fred R. / Walberg, Gerald D. | NTRS | 1993