Florent Berthaut

58
Documents

Présentation

My main research interest consists in exploring connections between
3D User Interfaces (3DUI) and Musical Interaction.

In one direction, 3DUIs open new possibilities for musical control,
in particular with complex musical structures,
for musical collaboration, and for augmented musical performances.

In the other direction, Musical Interfaces provide
a rich application domain for 3DUIs, with very specific constraints
which both open numerous research questions and provide
interesting opportunities for interaction and visualization techniques.

Publications

3
2
7
1
4
3
3
3
3
3
3
3
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
27
19
11
10
6
3
2
1

Publications

Image document

Behavioral Measures of Copresence in Co-located Mixed Reality

Pierrick Uro , Florent Berthaut , Thomas Pietrzak , Marcelo M. Wanderley
IEEE Transactions on Visualization and Computer Graphics, In press, pp.11. ⟨10.1109/TVCG.2025.3549135⟩
Article dans une revue hal-04936937 v2
Image document

Examining the Design Process for 3D Interactions in Performing Arts : A Spatial Augmented Reality Cyber-Opera Case Study

Cagan Arslan , Florent Berthaut
IEEE Transactions on Visualization and Computer Graphics, 2025, pp.1-10. ⟨10.1109/TVCG.2025.3549194⟩
Article dans une revue hal-04938727 v1
Image document

Levels of Detail in Visual Augmentations for the Novice and Expert Audiences

Olivier Capra , Florent Berthaut , Laurent Grisoni
Computer Music Journal, In press
Article dans une revue hal-03106626 v1
Image document

3D interaction techniques for musical expression

Florent Berthaut
Journal of New Music Research, In press, ⟨10.1080/09298215.2019.1706584⟩
Article dans une revue hal-02430634 v1
Image document

BOEUF: A Unified Framework for Modeling and Designing Digital Orchestras

Florent Berthaut , Luke Dahl
Lecture Notes in Computer Science, 2016, Music, Mind, and Embodiment, 9617, pp.153 - 166. ⟨10.1007/978-3-319-46282-0_10⟩
Article dans une revue hal-01380373 v1
Image document

Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances

Florent Berthaut , Martin Hachet
IEEE Computer Graphics and Applications, 2016, 36 (5), pp.82 - 87. ⟨10.1109/MCG.2016.96⟩
Article dans une revue hal-01374911 v1

Interaction musicale numérique. Recréer les signaux du contrôle et de la perception

Florent Berthaut , Myriam Desainte-Catherine
Traitement du Signal, 2015, 32 (4), pp.345-363. ⟨10.3166/ts.32.345-363⟩
Article dans une revue hal-01304262 v1
Image document

Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic Approach

Florent Berthaut , David Janin , Benjamin Martin
International Journal of Semantic Computing, 2012, 6 (4), pp.409-427. ⟨10.1142/S1793351X12400132⟩
Article dans une revue hal-00794196 v1
Image document

Interacting with 3D Reactive Widgets for Musical Performance

Florent Berthaut , Myriam Desainte-Catherine , Martin Hachet
Journal of New Music Research, 2011, 40 (3), pp.253-263
Article dans une revue hal-00633750 v1
Image document

GDPD / IVMI-BUILDER: A Libre Software Framework for Extended Reality Musical Instruments and Sonic Installations

Florent Berthaut
Proceedings of the 19th Linux Audio Conference, Jun 2025, Lyon, France
Communication dans un congrès hal-05095979 v1
Image document

MagneTip: Reintroducing a Physical Interaction Loop for 3D Musical Drawing in Extended Reality

Esther Gruy , Florent Berthaut
New Interfaces for Musical Expression, Sep 2024, Utrecht (Netherlands), France. ⟨10.5281/zenodo.13904763⟩
Communication dans un congrès hal-04649511 v1
Image document

Musical Drawing in 2D and 3D: Dimensions and Perspectives

Esther Gruy , Florent Berthaut
Audio Mostly, Sep 2024, Milan (Italie), France. pp.181-188, ⟨10.1145/3678299.3678317⟩
Communication dans un congrès hal-04709276 v1
Image document

Cross-modal interaction of stereoscopy, surface deformation and tactile feedback on the perception of texture roughness in an active touch condition

Detjon Brahimaj , Florent Berthaut , Frédéric Giraud , Betty Semail
IHM'23 - 34e Conférence Internationale Francophone sur l'Interaction Humain-Machine AFIHM, Ines di Loreto, Apr 2023, Troyes, France
Communication dans un congrès hal-04014962 v1
Image document

Vibrating shapes : Design and evolution of a spatial augmented reality interface for actuated instruments

Cagan Arslan , Florent Berthaut , Anthony Beuchey , Paul Cambourian , Arthur Paté
New Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.c28dd323⟩
Communication dans un congrès hal-03712843 v1
Image document

The Effect of Visualisation Level and Situational Visibility in Co-located Digital Musical Ensembles

Florent Berthaut , Luke Dahl
New Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.9d974714⟩
Communication dans un congrès hal-03704678 v1
Image document

Musical Exploration of Volumetric Textures in Mixed and Virtual Reality

Florent Berthaut
International Conference on New Interfaces for Musical Expression (NIME 2021), Jun 2021, Shangai, China. ⟨10.21428/92fbeb44.6607d04f⟩
Communication dans un congrès hal-03260466 v2
Image document

Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions

Fatma Ben Guefrech , Florent Berthaut , Patricia Plénacoste , Yvan Peter , Laurent Grisoni
IEEE Conference on Virtual Reality and 3D User Interfaces, Mar 2021, Lisbonne (Virtual ), Portugal. ⟨10.1109/VR50410.2021.00023⟩
Communication dans un congrès hal-03186282 v1
Image document

The Effect of Rhythm in Mid-air Gestures on the User Experience in Virtual Reality

Vincent Reynaert , Florent Berthaut , Yosra Rekik , Laurent Grisoni
18th IFIP Conference on Human-Computer Interaction (INTERACT), Aug 2021, Bari, Italy. pp.182-191, ⟨10.1007/978-3-030-85613-7_13⟩
Communication dans un congrès hal-03338088 v1
Image document

The Effect of Control-Display Ratio on User Experience in Immersive Virtual Musical Instruments

Vincent Reynaert , Florent Berthaut , Yosra Rekik , Laurent Grisoni
International Conference on New Interfaces for Musical Expression, Jun 2021, Shanghai, China
Communication dans un congrès hal-03265169 v1
Image document

Adapting & Openness: Dynamics of Collaboration Interfaces for Heterogeneous Digital Orchestras

Florent Berthaut , Luke Dahl
New Interfaces for Musical Expression, Jul 2020, Birmingham, United Kingdom
Communication dans un congrès hal-02561064 v1
Image document

Investigating the semantic perceptual space of synthetic textures on an ultrasonic based haptic tablet

Maxime Dariosecq , Patricia Plénacoste , Florent Berthaut , Anis Kaci , Frédéric Giraud
HUCAPP 2020, Feb 2020, Valletta, Malta
Communication dans un congrès hal-02434298 v1
Image document

A Taxonomy of Spectator Experience Augmentation Techniques

Olivier Capra , Florent Berthaut , Laurent Grisoni
NIME 2020 - The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom
Communication dans un congrès hal-02560931 v1
Image document

All You Need Is LOD : Levels of Detail in Visual Augmentations for the Audience

Olivier Capra , Florent Berthaut , Laurent Grisoni
The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom
Communication dans un congrès hal-02560794 v1
Image document

Have a SEAT on Stage : Restoring Trust with Spectator Experience Augmentation Techniques

Olivier Capra , Florent Berthaut , Laurent Grisoni
Designing Interactive Systems (DIS), Jul 2020, Eindhoven, Netherlands. ⟨10.1145/3357236.3395492⟩
Communication dans un congrès hal-02560916 v1
Image document

The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments

Cagan Arslan , Florent Berthaut , Jean Martinet , Ioan Marius Bilasco , Laurent Grisoni
NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States
Communication dans un congrès hal-01809210 v1
Image document

Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual Objects

Florent Berthaut , Cagan Arslan , Laurent Grisoni
International Conference on New Interfaces for Musical Expression, May 2017, Copenhagen, Denmark
Communication dans un congrès hal-01518579 v1
Image document

Toward Augmented Familiarity of the Audience with Digital Musical Instruments

Olivier Capra , Florent Berthaut , Laurent Grisoni
International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Portugal
Communication dans un congrès hal-01577953 v1
Image document

bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital Orchestras

Luke Dahl , Florent Berthaut , Antoine Nau , Patricia Plenacoste
CMMR 2017 - 13th International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Porto, Portugal
Communication dans un congrès hal-01577942 v1
Image document

Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable Friction

Farzan Kalantari , Florent Berthaut , Laurent Grisoni
International Symposium on Computer Music Multidisciplinary Research (CMMR 2017), Sep 2017, Porto, Portugal
Communication dans un congrès hal-01580750 v1
Image document

ControllAR: Appropriation of Visual Feedback on Control Surfaces

Florent Berthaut , Alex Jones
Interactive Spaces and Surfaces, ACM, Nov 2016, Niagara Falls, Canada. ⟨10.1145/2992154.2992170⟩
Communication dans un congrès hal-01356239 v1
Image document

Liveness Through the Lens of Agency and Causality

Florent Berthaut , David Coyle , James Moore , Hannah Limerick
International Conference on New Interfaces for Musical Expression, May 2015, Baton Rouge, United States
Communication dans un congrès hal-01170032 v1
Image document

Dynamir : Optical Manipulations using Dynamic Mirror Brushes

Florent Berthaut , Deepak Ranjan Sahoo , Jess Mcintosh , Diptesh Das , Sriram Subramanian
ACM International Conference on Interactive Tabletops and Surfaces,, Nov 2015, Madeira, Portugal
Communication dans un congrès hal-01222512 v1
Image document

BOEUF : a Unified Framework for Modeling and Designing Digital Orchestras

Florent Berthaut , Luke Dahl
International Symposium On Computer Music Multidisciplinary Research, Jun 2015, Plymouth, United Kingdom
Communication dans un congrès hal-01222396 v2
Image document

Reflets: Combining and Revealing Spaces for Musical Performances

Florent Berthaut , Diego Martinez Plasencia , Martin Hachet , Sriram Subramanian
New Interfaces for Musical Expression (NIME), May 2015, Baton Rouge, United States
Communication dans un congrès hal-01136857 v1

Through the Combining Glass

Diego Martinez , Florent Berthaut , Abhijit Karnik , Sriram Subramanian
ACM Symposium on User Interface Software and Technology, Oct 2014, Honolulu, United States
Communication dans un congrès hal-01222458 v1
Image document

Scenography of immersive virtual musical instruments

Florent Berthaut , Victor Zappi , Dario Mazzanti
VR Workshop: Sonic Interaction in Virtual Environments (SIVE), 2014 IEEE, Mar 2014, Minneapolis, United States. ⟨10.1109/SIVE.2014.7006285⟩
Communication dans un congrès hal-01222454 v1
Image document

Multi-scale design of interactive music systems : the libTuiles experiment

David Janin , Florent Berthaut , Myriam Desainte-Catherine
SMC 2013, 2013, Stockholm, Sweden. pp.123-129
Communication dans un congrès hal-00813313 v1
Image document

libTuile : un moteur d'exécution multi-échelle de processus musicaux hiérarchisés

Florent Berthaut , David Janin , Myriam Desainte-Catherine
Journées d'Informatique Musicale, May 2013, Saint-Denis, France. pp.45-50
Communication dans un congrès hal-00790792 v1
Image document

Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience

Florent Berthaut , Mark T. Marshall , Sriram Subramanian , Martin Hachet
New Interfaces for Musical Expression, May 2013, Daejeon, South Korea. 6 p
Communication dans un congrès hal-00807049 v3
Image document

The T-Calculus : towards a structured programing of (musical) time and space

David Janin , Florent Berthaut , Myriam Desainte-Catherine , Yann Orlarey , Sylvain Salvati
FARM 2013, 2013, Boston, United States. pp.23-34, ⟨10.1145/2505341.2505347⟩
Communication dans un congrès hal-00789189 v3
Image document

Beyond the Tunnels: Advanced 3D graphical modulation

Florent Berthaut
2012 IEEE Symposium on 3D User Interfaces (3DUI), Mar 2012, United States. pp.139-140
Communication dans un congrès hal-00793580 v1
Image document

Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic Approach

Florent Berthaut , David Janin , Benjamin Martin
ICSC, Sep 2012, Palermo, Italy. pp.202-209, ⟨10.1109/ICSC.2012.11⟩
Communication dans un congrès hal-00698963 v2
Image document

First Person Shooters as Collaborative Multiprocess Instruments

Florent Berthaut , Haruhiro Katayose , Hironori Wakama , Naoyuki Totani , Yuichi Sato
New Interfaces for Musical Expression, May 2011, Oslo, Norway. pp.44-47
Communication dans un congrès hal-00631782 v1
Image document

Drile: An Immersive Environment for hierarchical live-looping

Florent Berthaut , Myriam Desainte-Catherine , Martin Hachet
New Interface for Musical Expression, Jun 2010, Sydney, Australia. page 192
Communication dans un congrès hal-00530071 v1
Image document

Combining audiovisual mappings for 3D musical interaction

Florent Berthaut , Myriam Desainte-Catherine , Martin Hachet
International Computer Music Conference, Jun 2010, New york, United States. p 100
Communication dans un congrès hal-00530076 v1
Image document

Piivert: Percussion-based Interaction for Immersive Virtual EnviRonmenTs

Florent Berthaut , Martin Hachet , Myriam Desainte-Catherine
Symposium on 3D User Interfaces, Mar 2010, United States. p 15-18
Communication dans un congrès hal-00522637 v1
Image document

Interaction with the 3D reactive widgets for musical performance.

Florent Berthaut , Myriam Desainte-Catherine , Martin Hachet
Brazilian Symposium on Computer Music (SBCM09), Sep 2009, Recife, Brazil. pp.0
Communication dans un congrès hal-00413339 v1
Image document

Analyse de l'influence des systèmes de visualisation immersif sur l'assemblage virtuel de fragments en archéologie

Nicolas Mellado , Patrick Reuter , Florent Berthaut
4ème Journées de l'Association Française de Réalité Virtuelle, Dec 2009, Lyon, France. p83
Communication dans un congrès hal-00576884 v1
Image document

Opportunistic Music

Martin Hachet , Arash Kian , Florent Berthaut , Jean-Sébastien Franco , Myriam Desainte-Catherine
JVRC 2009 (EGVE - ICAT - EuroVR), Dec 2009, Lyon, France
Communication dans un congrès inria-00406390 v2
Image document

Widgets Réactifs 3D pour l’interaction musicale

Florent Berthaut , Myriam Desainte-Catherine , Martin Hachet
Journées d'informatique musicale, GMEA, Mar 2008, Albi, France. pp.87
Communication dans un congrès hal-00354898 v1

Interaction 3D pour la musique

Florent Berthaut , M. Desainte-Catherine , Martin Hachet
Actes des 2emes Journées de lAFRV, 2007, France. pp.75 -- 81
Communication dans un congrès hal-00307879 v1
Image document

Les Passages : Une métaphore pour la Collaboration Musicale en Réalité Virtuelle

Pierre-Marie Plans , Florent Berthaut
25ème conférence francophone sur l'Interaction Homme-Machine, IHM'13, Nov 2013, Bordeaux, France
Poster de conférence hal-00879603 v1