After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an interpretable and factorized representation of latent variable by modifying their objective function or model architecture. To disentangle the latent variable, some models show lower quality of reconstructed images and others increase the model complexity which is hard to train. In this paper, we propose a simple disentangling method based on a traditional whitening process. The proposed method is applied to the latent variables of variational auto-encoder (VAE), although it can be applied to any generative models with latent variables. In experiment, we apply the proposed method to simple VAE models and experiment results confirm that our method finds more interpretable factors from the latent space while keeping the reconstruction error the same as the conventional VAE's error.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Disentangling Latent Factors of Variational Auto-Encoder with Whitening


    Beteiligte:
    Hahn, Sangchul (Autor:in) / Choi, Heeyoul (Autor:in)

    Erscheinungsdatum :

    2018


    Anmerkungen:

    ICANN 2019


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Joint Training of Variational Auto-Encoder and Latent Energy-Based Model

    Han, Tian / Nijkamp, Erik / Zhou, Linqi et al. | ArXiv | 2020

    Freier Zugriff

    AVAE: Adversarial Variational Auto Encoder

    Plumerault, Antoine / Borgne, Hervé Le / Hudelot, Céline | ArXiv | 2020

    Freier Zugriff

    Variational auto encoder for mixed data types

    Europäisches Patentamt | 2020

    Freier Zugriff

    Disentangled Variational Auto-Encoder for Semi-supervised Learning

    Li, Yang / Pan, Quan / Wang, Suhang et al. | ArXiv | 2017

    Freier Zugriff