In this work we explore the potentialities of a framework for the representation of audio-visual signals using decompositions on overcomplete dictionaries. Redundant decompositions may describe audio-visual sequences in a concise fashion, preserving good representation properties thanks to the use of redundant, well designed, dictionaries. We expect that this helps us overcome two typical problems of multimodal fusion algorithms. On one hand, classical representation techniques, like pixel-based measures (for the video) or Fourier-like transforms (for the audio), take into account only marginally the physics of the problem. On the other hand, the input signals have large dimensionality. The results we obtain by making use of sparse decompositions of audio-visual signals over redundant codebooks are encouraging and show the potentialities of the proposed approach to multimodal signal representation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Analysis of multimodal signals using redundant representations


    Contributors:


    Publication date :

    2005-01-01


    Size :

    208031 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Analysis of Multimodal Signals using Redundant Representations

    Monaci, G. / Escoda, O. D. / Vandergheynst, P. | British Library Conference Proceedings | 2005


    REDUNDANT PLC SIGNALS EVALUATION

    KNOSMANN MICHAEL / MICHAELSEN ARNE / OTREMBA ROBERT et al. | European Patent Office | 2022

    Free access

    Learning Multimodal Representations for Drowsiness Detection

    Qian, Kun / Koike, Tomoya / Nakamura, Toru et al. | IEEE | 2022


    Recoded and Non-Recoded Trinary Signed-Digit Multipliers Designs Using Redundant Bit Representations

    Cherri, A. / Alam, M. / IEEE | British Library Conference Proceedings | 1998


    Multimodal biometric authentication using quality signals in mobile communications

    Bigun, J. / Fierrez-Aguilar, J. / Ortega-Garcia, J. et al. | IEEE | 2003