Skip to Main content Skip to Navigation
Conference papers

Towards a Hand Skeletal Model for Depth Images Applied to Capture Music-like Finger Gestures

Abstract : The Intangible Cultural Heritage (ICH) implies gestural knowledge and skills in performing arts, such as music, and its preservation and transmission is a worldwide challenge according to UNESCO. This paper presents an ongoing research that aims at the development of a computer vision methodology for the recognition of music-like complex hand and finger gestures performed in space. This methodology can contribute both to the analysis of classical music playing schools, such as the European and the Russian, and to the finger gesture control of sound as a new interface for musical expression. An implementation of a generic method for building body subpart classification model applied in musical gestures is presented. A robust classification model from a reduced training dataset, as well as a method for spatial aggregation of the classification results, which provides a confidence measure on each hand subpart location is developed. A 80% pixel-wise classification accuracy and 95% ponctual subpart location accuracy is achieved when musical finger gestures with a semi-closed hand are performed in front of the camera and the rotation around camera axis is not too important.
Document type :
Conference papers
Complete list of metadata

https://hal-mines-paristech.archives-ouvertes.fr/hal-00875721
Contributor : Fabien Moutarde Connect in order to contact the contributor
Submitted on : Tuesday, October 22, 2013 - 3:40:18 PM
Last modification on : Tuesday, January 5, 2021 - 5:20:01 PM
Long-term archiving on: : Thursday, January 23, 2014 - 4:27:17 AM

File

finger_music-like_gestures_CMM...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00875721, version 1

Citation

Arnaud Dapogny, Raoul de Charette, Sotiris Manitsaris, Fabien Moutarde, Alina Glushkova. Towards a Hand Skeletal Model for Depth Images Applied to Capture Music-like Finger Gestures. 10th Int. Symposium on Computer Music Multidisciplinary Research (CMMR'2013), Oct 2013, Marseille, France. ⟨hal-00875721⟩

Share

Metrics

Record views

727

Files downloads

641