Florent Berthaut
Présentation
Mon activité scientifique se concentre autour des
interfaces 3D en réalité étendue, et de leur utilisation dans un
cadre culturel et plus spécifiquement d'expression musicale.
J'étudie notamment comment elles peuvent enrichir l'expérience des artistes
et du public en révélant dans l'espace physique des interactions existantes
ou potentielles.
Je m'intéresse ainsi par exemple aux augmentations visuelles en réalité mixte
pour améliorer la compréhension et appréciation par le public des
performances avec des instruments de musique numériques.
Une autre piste est l'ajout de contrôles virtuels superposés aux instruments
numériques physiques utilisant des surfaces de contrôle, des contrôleurs
gestuels ou même des instruments acoustiques actionnés, afin d'étudier les
nouvelles possibilités expressives ainsi que l'appropriation par les artistes.
Un dernier exemple est la conception d'interfaces en réalité augmentée
permettant d'explorer des contenus virtuels placés dans l'espace physique
autour ou à l'intérieur d'objets derrière une vitrine dans un contexte de
médiation ou de performance. Plus d'informations sur la page de mon équipe MINT @ CRIStAL ou sur ma page personnelle
Publications
Publications
|
|
Exploring the Use of Auditory Feedback as a Guide for 3D Drawing in Extended RealityInternational Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE 2025), Dec 2025, Karlskrona, Sweden |
|
|
Virtual Immersion in Underground Quarries: An Innovative Exploration of Historical and Cultural Heritage2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Mar 2025, Saint Malo, France. pp.35-38, ⟨10.1109/VRW66409.2025.00015⟩ |
|
|
Strategies for the Reconciliation of Artistic Intent and Technical Constraints in Mixed Reality PerformancesDIS 2025 - ACM Designing Interactive Systems Conference, ACM, Jul 2025, Funchal (Madeira Island), Portugal. ⟨10.1145/3715336.3735738⟩ |
|
|
Decoupling Physical and Virtual Spaces for New Collaboration Strategies in Co-Located Mixed Reality InstrumentsNIME 2025 - International Conference on New Interfaces for Musical Expression, Jun 2025, Canberra, Australia. ⟨10.5281/zenodo.15698822⟩ |
|
|
Toward Multimodal Asynchronous Collaboration in VR Artistic Creation with SPARKVRST 2025 - Virtual Reality Software and Technology, Nov 2025, Montréal, Canada. pp.1-10, ⟨10.1145/3756884.3765998⟩ |
|
|
GDPD / IVMI-BUILDER: A Libre Software Framework for Extended Reality Musical Instruments and Sonic InstallationsProceedings of the 19th Linux Audio Conference, Jun 2025, Lyon, France |
|
|
MagneTip: Reintroducing a Physical Interaction Loop for 3D Musical Drawing in Extended RealityNew Interfaces for Musical Expression, Sep 2024, Utrecht (Netherlands), France. ⟨10.5281/zenodo.13904763⟩ |
|
|
Musical Drawing in 2D and 3D: Dimensions and PerspectivesAudio Mostly, Sep 2024, Milan (Italie), France. pp.181-188, ⟨10.1145/3678299.3678317⟩ |
|
|
Cross-modal interaction of stereoscopy, surface deformation and tactile feedback on the perception of texture roughness in an active touch conditionIHM'23 - 34e Conférence Internationale Francophone sur l'Interaction Humain-Machine AFIHM, Ines di Loreto, Apr 2023, Troyes, France |
|
|
Vibrating shapes : Design and evolution of a spatial augmented reality interface for actuated instrumentsNew Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.c28dd323⟩ |
|
|
The Effect of Visualisation Level and Situational Visibility in Co-located Digital Musical EnsemblesNew Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.9d974714⟩ |
|
|
The Effect of Rhythm in Mid-air Gestures on the User Experience in Virtual Reality18th IFIP Conference on Human-Computer Interaction (INTERACT), Aug 2021, Bari, Italy. pp.182-191, ⟨10.1007/978-3-030-85613-7_13⟩ |
|
|
The Effect of Control-Display Ratio on User Experience in Immersive Virtual Musical InstrumentsInternational Conference on New Interfaces for Musical Expression, Jun 2021, Shanghai, China |
|
|
Revealable Volume Displays: 3D Exploration of Mixed-Reality Public ExhibitionsIEEE Conference on Virtual Reality and 3D User Interfaces, Mar 2021, Lisbonne (Virtual ), Portugal. ⟨10.1109/VR50410.2021.00023⟩ |
|
|
Musical Exploration of Volumetric Textures in Mixed and Virtual RealityInternational Conference on New Interfaces for Musical Expression (NIME 2021), Jun 2021, Shangai, China. ⟨10.21428/92fbeb44.6607d04f⟩ |
|
|
Investigating the semantic perceptual space of synthetic textures on an ultrasonic based haptic tabletHUCAPP 2020, Feb 2020, Valletta, Malta |
|
|
Adapting & Openness: Dynamics of Collaboration Interfaces for Heterogeneous Digital OrchestrasNew Interfaces for Musical Expression, Jul 2020, Birmingham, United Kingdom |
|
|
A Taxonomy of Spectator Experience Augmentation TechniquesNIME 2020 - The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom |
|
|
Have a SEAT on Stage : Restoring Trust with Spectator Experience Augmentation TechniquesDesigning Interactive Systems (DIS), Jul 2020, Eindhoven, Netherlands. ⟨10.1145/3357236.3395492⟩ |
|
|
All You Need Is LOD : Levels of Detail in Visual Augmentations for the AudienceThe 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom |
|
|
The Phone with the Flow: Combining Touch + Optical Flow in Mobile InstrumentsNIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States |
|
|
Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual ObjectsInternational Conference on New Interfaces for Musical Expression, May 2017, Copenhagen, Denmark |
|
|
Toward Augmented Familiarity of the Audience with Digital Musical InstrumentsInternational Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Portugal |
|
|
bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital OrchestrasCMMR 2017 - 13th International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Porto, Portugal |
|
|
Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable FrictionInternational Symposium on Computer Music Multidisciplinary Research (CMMR 2017), Sep 2017, Porto, Portugal |
|
|
ControllAR: Appropriation of Visual Feedback on Control SurfacesInteractive Spaces and Surfaces, ACM, Nov 2016, Niagara Falls, Canada. ⟨10.1145/2992154.2992170⟩ |
|
|
Liveness Through the Lens of Agency and CausalityInternational Conference on New Interfaces for Musical Expression, May 2015, Baton Rouge, United States |
|
|
Dynamir : Optical Manipulations using Dynamic Mirror BrushesACM International Conference on Interactive Tabletops and Surfaces,, Nov 2015, Madeira, Portugal |
|
|
BOEUF : a Unified Framework for Modeling and Designing Digital OrchestrasInternational Symposium On Computer Music Multidisciplinary Research, Jun 2015, Plymouth, United Kingdom |
|
|
Reflets: Combining and Revealing Spaces for Musical PerformancesNew Interfaces for Musical Expression (NIME), May 2015, Baton Rouge, United States |
Through the Combining GlassACM Symposium on User Interface Software and Technology, Oct 2014, Honolulu, United States |
|
|
|
Scenography of immersive virtual musical instrumentsVR Workshop: Sonic Interaction in Virtual Environments (SIVE), 2014 IEEE, Mar 2014, Minneapolis, United States. ⟨10.1109/SIVE.2014.7006285⟩ |
|
|
libTuile : un moteur d'exécution multi-échelle de processus musicaux hiérarchisésJournées d'Informatique Musicale, May 2013, Saint-Denis, France. pp.45-50 |
|
|
Rouages: Revealing the Mechanisms of Digital Musical Instruments to the AudienceNew Interfaces for Musical Expression, May 2013, Daejeon, South Korea. 6 p |
|
|
The T-Calculus : towards a structured programing of (musical) time and spaceFARM 2013, 2013, Boston, United States. pp.23-34, ⟨10.1145/2505341.2505347⟩ |
|
|
Multi-scale design of interactive music systems : the libTuiles experimentSMC 2013, 2013, Stockholm, Sweden. pp.123-129 |
|
|
Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic ApproachICSC, Sep 2012, Palermo, Italy. pp.202-209, ⟨10.1109/ICSC.2012.11⟩ |
|
|
Beyond the Tunnels: Advanced 3D graphical modulation2012 IEEE Symposium on 3D User Interfaces (3DUI), Mar 2012, United States. pp.139-140 |
|
|
First Person Shooters as Collaborative Multiprocess InstrumentsNew Interfaces for Musical Expression, May 2011, Oslo, Norway. pp.44-47 |
|
|
Drile: An Immersive Environment for hierarchical live-loopingNew Interface for Musical Expression, Jun 2010, Sydney, Australia. page 192 |
|
|
Combining audiovisual mappings for 3D musical interactionInternational Computer Music Conference, Jun 2010, New york, United States. p 100 |
|
|
Piivert: Percussion-based Interaction for Immersive Virtual EnviRonmenTsSymposium on 3D User Interfaces, Mar 2010, United States. p 15-18 |
|
|
Opportunistic MusicJVRC 2009 (EGVE - ICAT - EuroVR), Dec 2009, Lyon, France |
|
|
Analyse de l'influence des systèmes de visualisation immersif sur l'assemblage virtuel de fragments en archéologie4ème Journées de l'Association Française de Réalité Virtuelle, Dec 2009, Lyon, France. p83 |
|
|
Interaction with the 3D reactive widgets for musical performance.Brazilian Symposium on Computer Music (SBCM09), Sep 2009, Recife, Brazil. pp.0 |
|
|
Widgets Réactifs 3D pour l’interaction musicaleJournées d'informatique musicale, GMEA, Mar 2008, Albi, France. pp.87 |
Interaction 3D pour la musiqueActes des 2emes Journées de lAFRV, 2007, France. pp.75 -- 81 |
|
|
Les Passages : Une métaphore pour la Collaboration Musicale en Réalité Virtuelle25ème conférence francophone sur l'Interaction Homme-Machine, IHM'13, Nov 2013, Bordeaux, France |
|
|
From the Lab to the Stage: Practical Considerations on Designing Performances with Immersive Virtual Musical InstrumentsSonic Interactions In Virtual Environments, Springer VS, In press, 978-3-031-04020-7 |
|
|
Toward Augmented Familiarity of the Audience with Digital Musical InstrumentsMusic Technology with Swing, Springer, pp.558-573, 2018, 978-3-030-01691-3 |
AAGRIP - Music : Attributed Agency through Grip Force2023 |
|
|
Creating an Immersive Mixed Reality Theater: Reconciling Artistic Intent and Technical ConstraintsUniversité de Lille. 2023 |
|
|
Construction, manipulation et visualisation de processus sonores dans des environnements virtuels immersifs pour la performance musicaleInformatique [cs]. Université Sciences et Technologies - Bordeaux I, 2010. Français. ⟨NNT : ⟩ |
|
|
Revealing Interactions : Expression and Exploration in Mixed and Virtual RealityGraphics [cs.GR]. Université de Lille, 2023 |