Finger musical gesture recognition in 3D space without any tangible instrument for performing arts

Abstract : This paper proposes a marker–less computer vision methodology for the simultaneous recognition of complex finger musical gestures performed in space without any tangible musical instrument. Image analysis techniques are applied in order to detect and identify the fingertips on a video. Scale and rotation invariance techniques are also applied. The finger gesture recognition and prediction is based on the stochastic modelling of the extracted high–level features with the help of hidden Markov models and Gaussian mixture models. The applications concern directly the finger gesture control of sound in performing arts. The proposed system can be considered in the long term as an intangible musical instrument that implies 'everyday gestures' and reduces the gap between non–musicians or blind people and music.
Type de document :
Article dans une revue
The International Journal of Arts and Technology, 2012
Liste complète des métadonnées

https://hal-mines-paristech.archives-ouvertes.fr/hal-01508619
Contributeur : Sotiris Manitsaris <>
Soumis le : vendredi 14 avril 2017 - 13:06:17
Dernière modification le : lundi 30 juillet 2018 - 12:02:02

Identifiants

  • HAL Id : hal-01508619, version 1

Collections

Citation

Sotiris Manitsaris, Apostolos Tsagaris, C. Dimitropoulos, Athanasios Manitsaris. Finger musical gesture recognition in 3D space without any tangible instrument for performing arts. The International Journal of Arts and Technology, 2012. 〈hal-01508619〉

Partager

Métriques

Consultations de la notice

115