Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Leveraging insights from classical methods of inference we introduce $\textit{Relaxed-Responsibility Vector-Quantisation}$, a novel way to parameterise discrete latent variables, a refinement of relaxed Vector-Quantisation. This enables a novel approach to hierarchical discrete variational autoencoder with numerous layers of latent variables that we train end-to-end. Unlike discrete VAEs with a single layer of latent variables, we can produce realistic-looking samples by ancestral sampling: it is not essential to train a second generative model over the learnt latent representations to then sample from and then decode. Further, we observe different layers of our model become associated with different aspects of the data.


    Access

    Download


    Export, share and cite



    Title :

    Relaxed-Responsibility Hierarchical Discrete VAEs


    Contributors:

    Publication date :

    2020


    Remarks:

    10 Pages


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    HIERARCHICAL VAES KNOW WHAT THEY DON'T KNOW

    HAVTORN, JAKOB D. / FRELLSEN, JES / HAUBERG, SØREN et al. | TIBKAT | 2022


    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Free access

    Optimizing Hierarchical Image VAEs for Sample Quality

    Luhman, Eric / Luhman, Troy | ArXiv | 2022

    Free access

    On Incorporating Inductive Biases into VAEs

    Miao, Ning / Mathieu, Emile / Siddharth, N. et al. | ArXiv | 2021

    Free access