Different from data-oriented communication systems that primarily focus on how to accurately transmit every bit of data, task-oriented semantic communication systems only transmit the specific semantic information required by downstream tasks, strive to minimize the communication overhead and maintain competitive tasks execution performance in the presence of channel noise. However, it is worth noting that in many scenarios, the transmitted semantic information needs to be dynamically modified according to the users' preferences in a conversational and interactive way, which few existing works take into consideration. In this paper, we propose a novel cross-modal editable semantic communication system, named Editable-DeepSC, to tackle this challenge. By utilizing inversion methods based on StyleGAN priors, Editable-DeepSC takes cross-modal text-image pairs as the inputs and transmits the edited information of images based on textual instructions. Extensive numerical results demonstrate that our proposed Editable-DeepSC can achieve remarkable editing effects and transmission efficiency under the perturbations of channel noise, outperforming existing data-oriented communication methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Editable-DeepSC: Cross-Modal Editable Semantic Communication Systems


    Beteiligte:
    Yu, Wenbo (Autor:in) / Chen, Bin (Autor:in) / Zhang, Qinshan (Autor:in) / Xia, Shu-Tao (Autor:in)


    Erscheinungsdatum :

    24.06.2024


    Format / Umfang :

    839901 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Editable dynamic textures

    Doretto, G. / Soatto, S. | IEEE | 2003


    Editable Dynamic Textures

    Doretto, G. / Soatto, S. / IEEE | British Library Conference Proceedings | 2003


    CONTEXTUAL EDITABLE SPEECH RECOGNITION METHODS AND SYSTEMS

    BALADHANDAPANI GOBINATHAN / SAPTHARISHI HARIHARAN / KANAGARAJAN SIVAKUMAR | Europäisches Patentamt | 2023

    Freier Zugriff

    Editable vehicle control method and device

    TAN WEN / XIONG ZHILONG | Europäisches Patentamt | 2022

    Freier Zugriff

    CONTEXTUAL EDITABLE SPEECH RECOGNITION METHODS AND SYSTEMS

    BALADHANDAPANI GOBINATHAN / SAPTHARISHI HARIHARAN / KANAGARAJAN SIVAKUMAR | Europäisches Patentamt | 2023

    Freier Zugriff