Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Towards the design of a natural user interface for performing and learning musical gestures

Abstract : A large variety of musical instruments, either acoustical or digital, are based on a keyboard scheme. Keyboard instruments can produce sounds through acoustic means but they are increasingly used to control digital sound synthesis processes with nowadays music. Interestingly, with all the different possibilities of sonic outcomes, the input remains a musical gesture. In this paper we present the conceptualization of a Natural User Interface (NUI), named the Intangible Musical Instrument (IMI), aiming to support both learning of expert musical gestures and performing music as a unified user experience. The IMI is designed to recognize metaphors of pianistic gestures, focusing on subtle uses of fingers and upper-body. Based on a typology of musical gestures, a gesture vocabulary has been created, hierarchized from basic to complex. These piano-like gestures are finally recognized and transformed into sounds.
Document type :
Journal articles
Complete list of metadata
Contributor : Fabien Moutarde Connect in order to contact the contributor
Submitted on : Thursday, January 14, 2016 - 4:52:27 PM
Last modification on : Thursday, March 24, 2022 - 7:56:02 PM
Long-term archiving on: : Saturday, April 16, 2016 - 10:58:18 AM


Publisher files allowed on an open archive



Edgar Hemery, Sotiris Manitsaris, Fabien Moutarde, Christina Volioti, Athanasios Manitsaris. Towards the design of a natural user interface for performing and learning musical gestures. Procedia Manufacturing, Elsevier, 2015, 3, pp.6329-6336. ⟨10.1016/j.promfg.2015.07.952⟩. ⟨hal-01256374⟩



Record views


Files downloads