In this paper, we propose to model an action based on both the shape and the motion of the performing object. When the object performs an action in 3D, the points on the outer boundary of the object are projected as 2D (x, y) contour in the image plane. A sequence of such 2D contours with respect to time generates a spatiotemporal volume (STV) in (x, y, t), which can be treated as 3D object in the (x, y, t) space. We analyze STV by using the differential geometric surface properties to identify action descriptors capturing both spatial and temporal properties. A set of action descriptors is called an action sketch. The first step in our approach is to generate STV by solving the point correspondence problem between consecutive frames. The correspondences are determined using a two-step graph theoretical approach. After the STV is generated, actions descriptors are computed by analyzing the differential geometric properties of STV. Finally, using these descriptors, we perform action recognition, which is also formulated as graph theoretical problem. Several experimental results are presented to demonstrate our approach.
Actions sketch: a novel action representation
2005-01-01
388341 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Sketch Mapping: Concept Representation for Stylists
British Library Conference Proceedings | 1998
|Sketch mapping: concept representation for stylists
Kraftfahrwesen | 1998
|Video Primal Sketch: A Unified Middle-Level Representation for Video
British Library Online Contents | 2015
|GWLB - Gottfried Wilhelm Leibniz Bibliothek | 2015
|View-Invariant Representation and Recognition of Actions
British Library Online Contents | 2002
|