Generative models often incur the catastrophic forgetting problem when they are used to sequentially learning multiple tasks, i.e., lifelong generative learning. Although there are some endeavors to tackle this problem, they suffer from high time-consumptions or error accumulation. In this work, we develop an efficient and effective lifelong generative model based on variational autoencoder (VAE). Unlike the generative adversarial network, VAE enjoys high efficiency in the training process, providing natural benefits with few resources. We deduce a lifelong generative model by expending the intrinsic reconstruction character of VAE to the historical knowledge retention. Further, we devise a feedback strategy about the reconstructed data to alleviate the error accumulation. Experiments on the lifelong generating tasks of MNIST, FashionMNIST, and SVHN verified the efficacy of our approach, where the results were comparable to SOTA.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Lifelong Generative Learning via Knowledge Reconstruction


    Beteiligte:
    Huang, Libo (Autor:in) / An, Zhulin (Autor:in) / Zhi, Xiang (Autor:in) / Xu, Yongjun (Autor:in)

    Erscheinungsdatum :

    2022


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Knowledge: A Lifelong Necessity

    Corey, Françoise R. | Emerald Group Publishing | 2000


    Lifelong Vehicle Trajectory Prediction Framework Based on Generative Replay

    Bao, Peng / Chen, Zonghai / Wang, Jikai et al. | IEEE | 2023


    Lifelong Learning: The Challenge for Schools

    Varela, M. M. | British Library Conference Proceedings | 1993


    Lifelong Education

    Bottomley, Laura J. | Online Contents | 2003


    Pedagogical Agents as Facilitators for Lifelong Learning

    Johnson, W. L. | British Library Conference Proceedings | 1999