Decomposition of the evidence lower bound (ELBO) objective of VAE used for density estimation revealed the deficiency of VAE for representation learning and suggested ways to improve the model. In this paper, we investigate whether we can get similar insights by decomposing the ELBO for semi-supervised classification using VAE model. Specifically, we show that mutual information between input and class labels decreases during maximization of ELBO objective. We propose a method to address this issue. We also enforce cluster assumption to aid in classification. Experiments on a diverse datasets verify that our method can be used to improve the classification performance of existing VAE based semi-supervised models. Experiments also show that, this can be achieved without sacrificing the generative power of the model.


    Access

    Download


    Export, share and cite



    Title :

    Deep Dive into Semi-Supervised ELBO for Improving Classification Performance


    Contributors:

    Publication date :

    2021


    Remarks:

    Under Review


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Resetting a fixed broken ELBO

    Cukier, Robert I. | ArXiv | 2023

    Free access

    A deep dive into metallurgical failure

    British Library Online Contents | 2008



    Deep dive

    Tema Archive | 1974


    A Deep Dive Into Magna’s Powertrain Innovations

    Springer India-New Delhi | Springer Verlag | 2016