Generative models often incur the catastrophic forgetting problem when they are used to sequentially learning multiple tasks, i.e., lifelong generative learning. Although there are some endeavors to tackle this problem, they suffer from high time-consumptions or error accumulation. In this work, we develop an efficient and effective lifelong generative model based on variational autoencoder (VAE). Unlike the generative adversarial network, VAE enjoys high efficiency in the training process, providing natural benefits with few resources. We deduce a lifelong generative model by expending the intrinsic reconstruction character of VAE to the historical knowledge retention. Further, we devise a feedback strategy about the reconstructed data to alleviate the error accumulation. Experiments on the lifelong generating tasks of MNIST, FashionMNIST, and SVHN verified the efficacy of our approach, where the results were comparable to SOTA.


    Access

    Download


    Export, share and cite



    Title :

    Lifelong Generative Learning via Knowledge Reconstruction


    Contributors:
    Huang, Libo (author) / An, Zhulin (author) / Zhi, Xiang (author) / Xu, Yongjun (author)

    Publication date :

    2022


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Knowledge: A Lifelong Necessity

    Corey, Françoise R. | Emerald Group Publishing | 2000


    Lifelong Vehicle Trajectory Prediction Framework Based on Generative Replay

    Bao, Peng / Chen, Zonghai / Wang, Jikai et al. | IEEE | 2023


    Lifelong Learning: The Challenge for Schools

    Varela, M. M. | British Library Conference Proceedings | 1993


    Lifelong Education

    Bottomley, Laura J. | Online Contents | 2003