Deep Generative Models (DGMs) can learn flexible latent variable representations of images while avoiding intractable computations, common in Bayesian inference. However, investigating the properties of inference in Variational Autoencoders (VAEs), a major class of DGMs, reveals severe problems in their uncertainty representations. Here we draw inspiration from classical computer vision to introduce an inductive bias into the VAE by incorporating a global explaining-away latent variable, which remedies defective inference in VAEs. Unlike standard VAEs, the Explaing-Away VAE (EA-VAE) provides uncertainty estimates that align with normative requirements across a wide spectrum of perceptual tasks, including image corruption, interpolation, and out-of-distribution detection. We find that restored inference capabilities are delivered by developing a motif in the inference network (the encoder) which is widespread in biological neural networks: divisive normalization. Our results establish EA-VAEs as reliable tools to perform inference under deep generative models with appropriate estimates of uncertainty.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Uncertainty in latent representations of variational autoencoders optimized for visual tasks


    Beteiligte:
    Catoni, Josefina (Autor:in) / Martos, Domonkos (Autor:in) / Csikor, Ferenc (Autor:in) / Ferrante, Enzo (Autor:in) / Milone, Diego H. (Autor:in) / Meszéna, Balázs (Autor:in) / Orbán, Gergő (Autor:in) / Echeveste, Rodrigo (Autor:in)

    Erscheinungsdatum :

    2024


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Adaptive Compression of the Latent Space in Variational Autoencoders

    Sejnova, Gabriela / Vavrecka, Michal / Stepanova, Karla | ArXiv | 2023

    Freier Zugriff


    Variational Autoencoders

    Ghojogh, Benyamin / Crowley, Mark / Karray, Fakhri et al. | Springer Verlag | 2022


    Failure Modes of Variational Autoencoders and Their Effects on Downstream Tasks

    Yacoby, Yaniv / Pan, Weiwei / Doshi-Velez, Finale | ArXiv | 2020

    Freier Zugriff

    Deep Tracking Portfolios Using Autoencoders and Variational Autoencoders

    Urrego, Daniel Aragón / Nieto, Oscar Eduardo Reyes / Quimbayo, Carlos Andrés Zapata | Springer Verlag | 2024