Towards the design of a natural user interface for performing and learning musical gestures

Abstract : A large variety of musical instruments, either acoustical or digital, are based on a keyboard scheme. Keyboard instruments can produce sounds through acoustic means but they are increasingly used to control digital sound synthesis processes with nowadays music. Interestingly, with all the different possibilities of sonic outcomes, the input remains a musical gesture. In this paper we present the conceptualization of a Natural User Interface (NUI), named the Intangible Musical Instrument (IMI), aiming to support both learning of expert musical gestures and performing music as a unified user experience. The IMI is designed to recognize metaphors of pianistic gestures, focusing on subtle uses of fingers and upper-body. Based on a typology of musical gestures, a gesture vocabulary has been created, hierarchized from basic to complex. These piano-like gestures are finally recognized and transformed into sounds.
Type de document :
Article dans une revue
Liste complète des métadonnées
Contributeur : Fabien Moutarde <>
Soumis le : jeudi 14 janvier 2016 - 16:52:27
Dernière modification le : jeudi 7 février 2019 - 14:40:24
Document(s) archivé(s) le : samedi 16 avril 2016 - 10:58:18


Fichiers éditeurs autorisés sur une archive ouverte



Edgar Hemery, Sotiris Manitsaris, Fabien Moutarde, Christina Volioti, Athanasios Manitsaris. Towards the design of a natural user interface for performing and learning musical gestures. Procedia Manufacturing, Elsevier, 2015, 3, pp.6329-6336. ⟨10.1016/j.promfg.2015.07.952⟩. ⟨hal-01256374⟩



Consultations de la notice


Téléchargements de fichiers