We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep features, we also implement a generative adversarial training mechanism to force the VAE to output realistic and natural images. We present experimental results to show that the VAE trained with our new method outperforms state of the art in generating face images with much clearer and more natural noses, eyes, teeth, hair textures as well as reasonable backgrounds. We also show that our method can learn powerful embeddings of input face images, which can be used to achieve facial attribute manipulation. Moreover we propose a multi-view feature extraction strategy to extract effective image representations, which can be used to achieve state of the art performance in facial attribute prediction.


    Access

    Download


    Export, share and cite



    Title :

    Improving Variational Autoencoder with Deep Feature Consistent and Generative Adversarial Training


    Contributors:
    Hou, Xianxu (author) / Sun, Ke (author) / Shen, Linlin (author) / Qiu, Guoping (author)

    Publication date :

    2019


    Remarks:

    Accepted in Neurocomputing, 2019. arXiv admin note: text overlap with arXiv:1610.00291



    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Deep Feature Consistent Variational Autoencoder

    Hou, Xianxu / Shen, Linlin / Sun, Ke et al. | ArXiv | 2016

    Free access

    A crash occurrence risk prediction model based on variational autoencoder and generative adversarial network

    Zhu, Wenqi / Lü, Chaofeng / Chen, Xiqun (and Michael) | Taylor & Francis Verlag | 2024


    Symmetric Variational Autoencoder and Connections to Adversarial Learning

    Chen, Liqun / Dai, Shuyang / Pu, Yunchen et al. | ArXiv | 2017

    Free access


    NVAE: A Deep Hierarchical Variational Autoencoder

    Vahdat, Arash / Kautz, Jan | ArXiv | 2020

    Free access