In this work we explore the potentialities of a framework for the representation of audio-visual signals using decompositions on overcomplete dictionaries. Redundant decompositions may describe audio-visual sequences in a concise fashion, preserving good representation properties thanks to the use of redundant, well designed, dictionaries. We expect that this helps us overcome two typical problems of multimodal fusion algorithms. On one hand, classical representation techniques, like pixel-based measures (for the video) or Fourier-like transforms (for the audio), take into account only marginally the physics of the problem. On the other hand, the input signals have large dimensionality. The results we obtain by making use of sparse decompositions of audio-visual signals over redundant codebooks are encouraging and show the potentialities of the proposed approach to multimodal signal representation.
Analysis of multimodal signals using redundant representations
2005-01-01
208031 byte
Conference paper
Electronic Resource
English
Analysis of Multimodal Signals using Redundant Representations
British Library Conference Proceedings | 2005
|Recoded and Non-Recoded Trinary Signed-Digit Multipliers Designs Using Redundant Bit Representations
British Library Conference Proceedings | 1998
|Multimodal Biometric Authentication Using Quality Signals in Mobile Communications
British Library Conference Proceedings | 2003
|