Toward Augmented Familiarity of the Audience with Digital Musical Instruments

Olivier Capra (1, 2) , Florent Berthaut (3) , Laurent Grisoni (4)

1 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 MINT2 - Méthodes et outils pour l'Interaction à gestes
3 LaBRI - Laboratoire Bordelais de Recherche en Informatique
4 LIFL - Laboratoire d'Informatique Fondamentale de Lille

The diversity and complexity of Digital Musical Instruments often lead to a reduced appreciation of live performances by the audience. This can be linked to the lack of familiarity they have with the instruments. We propose to increase this familiarity thanks to a trans-disciplinary approach in which signals from both the musician and the audience are extracted, familiarity analyzed, and augmentations dynamically added to the instruments. We introduce a new decomposition of familiarity and the concept of correspondences between musical gestures and results. This paper is both a review of research that paves the way for the realization of a pipeline for augmented familiarity, and a call for future research on the identified challenges that remain before it can be implemented.

Keywords: augmentations; familiarity; correspondences; Causality; digital musical instrument; performance

Domains: Human-Computer Interaction [cs.HC]; Cognitive science

Olivier Capra, Florent Berthaut, Laurent Grisoni. Toward Augmented Familiarity of the Audience with Digital Musical Instruments. Music Technology with Swing, Springer, pp.558-573, 2018, 978-3-030-01691-3. ⟨hal-01954791⟩