Skip to Main content Skip to Navigation
Journal articles

A Natural User Interface for Gestural Expression and Emotional Elicitation to access the Musical Intangible Cultural Heritage 

Abstract : This paper describes a prototype natural user interface, named the Intangible Musical Instrument, which aims to facilitate access to the knowledge of the performers that constitutes musical Intangible Cultural Heritage, using off-the-shelf motion capturing that is easily accessed by the public at large. This prototype is able to capture, model and recognize musical gestures (upper body including fingers) as well as to sonify them. The emotional status of the performer affects the sound parameters at the synthesis level. Intangible Musical Instrument is able to support both learning and performing/composing by providing to the user not only intuitive gesture control but also a unique user experience. In addition, the first evaluation of the Intangible Musical Instrument is presented, in which all the functionalities of the system are assessed. Overall, the results with respect to this evaluation were very promising.
Document type :
Journal articles
Complete list of metadata

Cited literature [43 references]  Display  Hide  Download

https://hal-mines-paristech.archives-ouvertes.fr/hal-01692849
Contributor : Sotiris Manitsaris Connect in order to contact the contributor
Submitted on : Thursday, January 25, 2018 - 2:50:09 PM
Last modification on : Tuesday, January 5, 2021 - 5:20:02 PM
Long-term archiving on: : Friday, May 25, 2018 - 2:59:01 AM

File

Volioti et al_JOCCH.pdf
Files produced by the author(s)

Identifiers

`

Citation

Christina Volioti, Sotiris Manitsaris, Edgar Hemery, Vasileios Charisis, Leontios Hadjileontiadis, et al.. A Natural User Interface for Gestural Expression and Emotional Elicitation to access the Musical Intangible Cultural Heritage . Journal on Computing and Cultural Heritage, Association for Computing Machinery, In press, ⟨10.1145/3127324⟩. ⟨hal-01692849⟩

Share

Metrics

Record views

508

Files downloads

896