In this work we present an unsupervised approach to summarize sentences in abstractive way using Variational Autoencoder (VAE). VAE are known to learn a semantically rich latent variable, representing high dimensional input. VAEs are trained by learning to reconstruct the input from the probabilistic latent variable. Explicitly providing the information about output length during training influences the VAE to not encode this information and thus can be manipulated during inference. Instructing the decoder to produce a shorter output sequence leads to expressing the input sentence with fewer words. We show on different summarization data sets, that these shorter sentences can not beat a simple baseline but yield higher ROUGE scores than trying to reconstruct the whole sentence.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Unsupervised Abstractive Sentence Summarization using Length Controlled Variational Autoencoder


    Beteiligte:

    Erscheinungsdatum :

    2018


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Deep recurrent neural networks for abstractive text summarization

    Klönne, Marie | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2018

    Freier Zugriff

    Variational Autoencoder

    Okadome, Takeshi | Springer Verlag | 2025


    Variational Autoencoder

    Pinheiro Cinelli, Lucas / Araújo Marins, Matheus / Barros da Silva, Eduardo Antúnio et al. | Springer Verlag | 2021


    Autoencoding Variational Autoencoder

    Cemgil, A. Taylan / Ghaisas, Sumedh / Dvijotham, Krishnamurthy et al. | ArXiv | 2020

    Freier Zugriff

    Variational Lossy Autoencoder

    Chen, Xi / Kingma, Diederik P. / Salimans, Tim et al. | ArXiv | 2016

    Freier Zugriff