In this paper, we present a novel visual servoing (VS) approach based on latent Denoising Diffusion Probabilistic Models (DDPMs), that explores the application of generative models for vision-based navigation of UAVs (Uncrewed Aerial Vehicles). Opposite to classical VS methods, the proposed approach allows reaching the desired target view, even when the target is initially not visible. This is possible thanks to the learning of a latent representation that the DDPM uses for planning and a dataset of trajectories encompassing target-invisible initial views. A compact representation is learned from raw images using a Cross-Modal Variational Autoencoder. Given the current image, the DDPM generates trajectories in the latent space driving the robotic platform to the desired visual target. The approach has been validated in simulation using two generic multi-rotor UAVs (a quadrotor and a hexarotor). The results show that we can successfully reach the visual target, even if not visible in the initial view. A video summary with simulations can be found in: https://youtu.be/2Hb3nkkcszE.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Invisible Servoing: A Visual Servoing Approach with Return-Conditioned Latent Diffusion


    Beteiligte:


    Erscheinungsdatum :

    14.05.2025


    Format / Umfang :

    5317908 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Visual servoing - Nonlinear observer approach

    Hashimoto, K. / Kimura, H. | British Library Online Contents | 1995


    Visual Servoing Systems

    Copot, Cosmin / Ionescu, Clara Mihaela / Muresan, Cristina I. | Springer Verlag | 2020


    Robotic Visual Servoing Based on Snakes

    Xia, L. / Gu, S. / Luo, D. et al. | British Library Conference Proceedings | 2000


    Visual Servoing of Legged Robots

    Echegoyen, Z. | British Library Online Contents | 2012


    Survey of Robot Visual Servoing

    Zhao, Q.-j. / Lian, G.-y. / Sun, Z.-q. | British Library Online Contents | 2001