In this work we explore the potentialities of a framework for the representation of audio-visual signals using decompositions on overcomplete dictionaries. Redundant decompositions may describe audio-visual sequences in a concise fashion, preserving good representation properties thanks to the use of redundant, well designed, dictionaries. We expect that this helps us overcome two typical problems of multimodal fusion algorithms. On one hand, classical representation techniques, like pixel-based measures (for the video) or Fourier-like transforms (for the audio), take into account only marginally the physics of the problem. On the other hand, the input signals have large dimensionality. The results we obtain by making use of sparse decompositions of audio-visual signals over redundant codebooks are encouraging and show the potentialities of the proposed approach to multimodal signal representation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Analysis of multimodal signals using redundant representations


    Beteiligte:
    Monaci, G. (Autor:in) / Divorra Escoda, O. (Autor:in) / Vandergheynst, P. (Autor:in)


    Erscheinungsdatum :

    2005-01-01


    Format / Umfang :

    208031 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Analysis of Multimodal Signals using Redundant Representations

    Monaci, G. / Escoda, O. D. / Vandergheynst, P. | British Library Conference Proceedings | 2005


    REDUNDANT PLC SIGNALS EVALUATION

    KNOSMANN MICHAEL / MICHAELSEN ARNE / OTREMBA ROBERT et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Learning Multimodal Representations for Drowsiness Detection

    Qian, Kun / Koike, Tomoya / Nakamura, Toru et al. | IEEE | 2022


    Recoded and Non-Recoded Trinary Signed-Digit Multipliers Designs Using Redundant Bit Representations

    Cherri, A. / Alam, M. / IEEE | British Library Conference Proceedings | 1998


    Multimodal biometric authentication using quality signals in mobile communications

    Bigun, J. / Fierrez-Aguilar, J. / Ortega-Garcia, J. et al. | IEEE | 2003