Trabajo presentado a la ACM on Multimedia Conference, celebrada en California (USA) del 23 al 27 de octubre de 2017. ; In this paper we are interested in recognizing human actions from sequences of 3D skeleton data. For this purpose we combine a 3D Convolutional Neural Network with body representations based on Euclidean Distance Matrices (EDMs), which have been recently shown to be very effective to capture the geometric structure of the human pose. One inherent limitation of the EDMs, however, is that they are defined up to a permutation of the skeleton joints, i.e., randomly shuffling the ordering of the joints yields many different representations. In oder to address this issue we introduce a novel architecture that simultaneously, and in an end-to-end manner, learns an optimal transformation of the joints, while optimizing the rest of parameters of the convolutional network. The proposed approach achieves state-of-the-art results on 3 benchmarks, including the recent NTU RGB-D dataset, for which we improve on previous LSTM-based methods by more than 10 percentage points, also surpassing other CNN-based methods while using almost 1000 times fewer parameters. ; This work has been supported by the Spanish Ministry of Economy and Competitiveness through the ROBINSTRUCT project (TIN2014- 58178-R) and the María de Maeztu grant to IRI (MDM-2016-0656). Additionally, we gratefully acknowledge financial support from the DIGIMAP project, funded under grant #860375 by the Austrian Research Promotion Agency (FFG). ; Peer Reviewed


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    3D CNNs on distance matrices for human action recognition



    Erscheinungsdatum :

    2017-01-01



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    3D CNNs on distance matrices for human action recognition

    Hernández Ruiz, Alejandro José / Porzi, Lorenzo / Rota Bulò, Samuel et al. | BASE | 2017

    Freier Zugriff

    Cooperative environment recognition utilizing UWB waveforms and CNNs

    Mäkela, Maija / Rantanen, Jesperi / Ilinca, Julian et al. | BASE | 2020

    Freier Zugriff

    Emotion Recognition from 3D Motion Capture Data using Deep CNNs

    Haris Zacharatos / Christos Gatzoulis / Panayiotis Charalambous et al. | BASE | 2021

    Freier Zugriff


    Deep CNNs With Spatially Weighted Pooling for Fine-Grained Car Recognition

    Hu, Qichang / Wang, Huibing / Li, Teng et al. | IEEE | 2017