In this paper, we present a novel visual servoing (VS) approach based on latent Denoising Diffusion Probabilistic Models (DDPMs), that explores the application of generative models for vision-based navigation of UAVs (Uncrewed Aerial Vehicles). Opposite to classical VS methods, the proposed approach allows reaching the desired target view, even when the target is initially not visible. This is possible thanks to the learning of a latent representation that the DDPM uses for planning and a dataset of trajectories encompassing target-invisible initial views. A compact representation is learned from raw images using a Cross-Modal Variational Autoencoder. Given the current image, the DDPM generates trajectories in the latent space driving the robotic platform to the desired visual target. The approach has been validated in simulation using two generic multi-rotor UAVs (a quadrotor and a hexarotor). The results show that we can successfully reach the visual target, even if not visible in the initial view. A video summary with simulations can be found in: https://youtu.be/2Hb3nkkcszE.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Invisible Servoing: A Visual Servoing Approach with Return-Conditioned Latent Diffusion


    Contributors:


    Publication date :

    2025-05-14


    Size :

    5317908 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Visual Servoing Systems

    Copot, Cosmin / Ionescu, Clara Mihaela / Muresan, Cristina I. | Springer Verlag | 2020


    Visual servoing - Nonlinear observer approach

    Hashimoto, K. / Kimura, H. | British Library Online Contents | 1995


    A robotic visual servoing system

    Scaggs, T.E. | IEEE | 1993


    TUDOR initial visual servoing experiments

    Malzahn, Jörn / Phung, Anh Son / Hoffmann, Frank et al. | TIB AV-Portal | 2011

    Free access

    Survey of Robot Visual Servoing

    Zhao, Q.-j. / Lian, G.-y. / Sun, Z.-q. | British Library Online Contents | 2001