Florent Berthaut
54
Documents
Presentation
My main research interest consists in exploring **connections** between
**3D User Interfaces** (3DUI) and **Musical Interaction**.
In one direction, 3DUIs open new possibilities for musical control,
in particular with complex musical structures,
for musical collaboration, and for augmented musical performances.
In the other direction, Musical Interfaces provide
a rich application domain for 3DUIs, with very specific constraints
which both open numerous research questions and provide
interesting opportunities for interaction and visualization techniques.
My main research interest consists in exploring **connections** between
**3D User Interfaces** (3DUI) and **Musical Interaction**.
In one direction, 3DUIs open new possibilities for musical control,
in particular with complex musical structures,
for musical collaboration, and for augmented musical performances.
In the other direction, Musical Interfaces provide
a rich application domain for 3DUIs, with very specific constraints
which both open numerous research questions and provide
interesting opportunities for interaction and visualization techniques.
Publications
- 3
- 7
- 1
- 4
- 3
- 3
- 3
- 3
- 3
- 3
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 2
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 1
- 23
- 19
- 10
- 7
- 6
- 3
- 1
|
|
MagneTip: Reintroducing a Physical Interaction Loop for 3D Musical Drawing in Extended RealityNew Interfaces for Musical Expression, Sep 2024, Utrecht (Netherland), Netherlands
Conference papers
hal-04649511v1
|
|
|
Musical Drawing in 2D and 3D: Dimensions and PerspectivesAudio Mostly 2024 - Explorations in Sonic Cultures (AM '24), Sep 2024, Milan, Italy. pp.181-188, ⟨10.1145/3678299.3678317⟩
Conference papers
hal-04709276v1
|
|
|
Cross-modal interaction of stereoscopy, surface deformation and tactile feedback on the perception of texture roughness in an active touch conditionIHM'23 - 34e Conférence Internationale Francophone sur l'Interaction Humain-Machine AFIHM, Ines di Loreto, Apr 2023, Troyes, France
Conference papers
hal-04014962v1
|
|
|
Vibrating shapes : Design and evolution of a spatial augmented reality interface for actuated instrumentsNew Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.c28dd323⟩
Conference papers
hal-03712843v1
|
|
|
The Effect of Visualisation Level and Situational Visibility in Co-located Digital Musical EnsemblesNew Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.9d974714⟩
Conference papers
hal-03704678v1
|
|
|
Revealable Volume Displays: 3D Exploration of Mixed-Reality Public ExhibitionsIEEE Conference on Virtual Reality and 3D User Interfaces, Mar 2021, Lisbonne (Virtual ), Portugal. ⟨10.1109/VR50410.2021.00023⟩
Conference papers
hal-03186282v1
|
|
|
Musical Exploration of Volumetric Textures in Mixed and Virtual RealityInternational Conference on New Interfaces for Musical Expression (NIME 2021), Jun 2021, Shangai, China. ⟨10.21428/92fbeb44.6607d04f⟩
Conference papers
hal-03260466v2
|
|
|
The Effect of Rhythm in Mid-air Gestures on the User Experience in Virtual Reality18th IFIP Conference on Human-Computer Interaction (INTERACT), Aug 2021, Bari, Italy. pp.182-191, ⟨10.1007/978-3-030-85613-7_13⟩
Conference papers
hal-03338088v1
|
|
|
The Effect of Control-Display Ratio on User Experience in Immersive Virtual Musical InstrumentsInternational Conference on New Interfaces for Musical Expression, Jun 2021, Shanghai, China
Conference papers
hal-03265169v1
|
|
|
Adapting & Openness: Dynamics of Collaboration Interfaces for Heterogeneous Digital OrchestrasNew Interfaces for Musical Expression, Jul 2020, Birmingham, United Kingdom
Conference papers
hal-02561064v1
|
|
|
Investigating the semantic perceptual space of synthetic textures on an ultrasonic based haptic tabletHUCAPP 2020, Feb 2020, Valletta, Malta
Conference papers
hal-02434298v1
|
|
|
All You Need Is LOD : Levels of Detail in Visual Augmentations for the AudienceThe 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom
Conference papers
hal-02560794v1
|
|
|
Have a SEAT on Stage : Restoring Trust with Spectator Experience Augmentation TechniquesDesigning Interactive Systems (DIS), Jul 2020, Eindhoven, Netherlands. ⟨10.1145/3357236.3395492⟩
Conference papers
hal-02560916v1
|
|
|
A Taxonomy of Spectator Experience Augmentation TechniquesNIME 2020 - The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom
Conference papers
hal-02560931v1
|
|
|
The Phone with the Flow: Combining Touch + Optical Flow in Mobile InstrumentsNIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States
Conference papers
hal-01809210v1
|
|
|
Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual ObjectsInternational Conference on New Interfaces for Musical Expression, May 2017, Copenhagen, Denmark
Conference papers
hal-01518579v1
|
|
|
Toward Augmented Familiarity of the Audience with Digital Musical InstrumentsInternational Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Portugal
Conference papers
hal-01577953v1
|
|
|
Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable FrictionInternational Symposium on Computer Music Multidisciplinary Research (CMMR 2017), Sep 2017, Porto, Portugal
Conference papers
hal-01580750v1
|
|
|
bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital OrchestrasCMMR 2017 - 13th International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Porto, Portugal
Conference papers
hal-01577942v1
|
|
|
ControllAR: Appropriation of Visual Feedback on Control SurfacesInteractive Spaces and Surfaces, ACM, Nov 2016, Niagara Falls, Canada. ⟨10.1145/2992154.2992170⟩
Conference papers
hal-01356239v1
|
|
|
Liveness Through the Lens of Agency and CausalityInternational Conference on New Interfaces for Musical Expression, May 2015, Baton Rouge, United States
Conference papers
hal-01170032v1
|
|
|
BOEUF : a Unified Framework for Modeling and Designing Digital OrchestrasInternational Symposium On Computer Music Multidisciplinary Research, Jun 2015, Plymouth, United Kingdom
Conference papers
hal-01222396v2
|
|
|
Reflets: Combining and Revealing Spaces for Musical PerformancesNew Interfaces for Musical Expression (NIME), May 2015, Baton Rouge, United States
Conference papers
hal-01136857v1
|
|
|
Dynamir : Optical Manipulations using Dynamic Mirror BrushesACM International Conference on Interactive Tabletops and Surfaces,, Nov 2015, Madeira, Portugal
Conference papers
hal-01222512v1
|
Through the Combining GlassACM Symposium on User Interface Software and Technology, Oct 2014, Honolulu, United States
Conference papers
hal-01222458v1
|
|
|
|
Scenography of immersive virtual musical instrumentsVR Workshop: Sonic Interaction in Virtual Environments (SIVE), 2014 IEEE, Mar 2014, Minneapolis, United States. ⟨10.1109/SIVE.2014.7006285⟩
Conference papers
hal-01222454v1
|
|
|
libTuile : un moteur d'exécution multi-échelle de processus musicaux hiérarchisésJournées d'Informatique Musicale, May 2013, Saint-Denis, France. pp.45-50
Conference papers
hal-00790792v1
|
|
|
Multi-scale design of interactive music systems : the libTuiles experimentSMC 2013, 2013, Stockholm, Sweden. pp.123-129
Conference papers
hal-00813313v1
|
|
|
Rouages: Revealing the Mechanisms of Digital Musical Instruments to the AudienceNew Interfaces for Musical Expression, May 2013, Daejeon, South Korea. 6 p
Conference papers
hal-00807049v3
|
|
|
The T-Calculus : towards a structured programing of (musical) time and spaceFARM 2013, 2013, Boston, United States. pp.23-34, ⟨10.1145/2505341.2505347⟩
Conference papers
hal-00789189v3
|
|
|
Beyond the Tunnels: Advanced 3D graphical modulation2012 IEEE Symposium on 3D User Interfaces (3DUI), Mar 2012, United States. pp.139-140
Conference papers
hal-00793580v1
|
|
|
Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic ApproachICSC, Sep 2012, Palermo, Italy. pp.202-209, ⟨10.1109/ICSC.2012.11⟩
Conference papers
hal-00698963v2
|
|
|
First Person Shooters as Collaborative Multiprocess InstrumentsNew Interfaces for Musical Expression, May 2011, Oslo, Norway. pp.44-47
Conference papers
hal-00631782v1
|
|
|
Drile: An Immersive Environment for hierarchical live-loopingNew Interface for Musical Expression, Jun 2010, Sydney, Australia. page 192
Conference papers
hal-00530071v1
|
|
|
Piivert: Percussion-based Interaction for Immersive Virtual EnviRonmenTsSymposium on 3D User Interfaces, Mar 2010, United States. p 15-18
Conference papers
hal-00522637v1
|
|
|
Combining audiovisual mappings for 3D musical interactionInternational Computer Music Conference, Jun 2010, New york, United States. p 100
Conference papers
hal-00530076v1
|
|
|
Interaction with the 3D reactive widgets for musical performance.Brazilian Symposium on Computer Music (SBCM09), Sep 2009, Recife, Brazil. pp.0
Conference papers
hal-00413339v1
|
|
|
Opportunistic MusicJVRC 2009 (EGVE - ICAT - EuroVR), Dec 2009, Lyon, France
Conference papers
inria-00406390v2
|
|
|
Analyse de l'influence des systèmes de visualisation immersif sur l'assemblage virtuel de fragments en archéologie4ème Journées de l'Association Française de Réalité Virtuelle, Dec 2009, Lyon, France. p83
Conference papers
hal-00576884v1
|
|
|
Widgets Réactifs 3D pour l’interaction musicaleJournées d'informatique musicale, GMEA, Mar 2008, Albi, France. pp.87
Conference papers
hal-00354898v1
|
Interaction 3D pour la musiqueActes des 2emes Journées de lAFRV, 2007, France. pp.75 -- 81
Conference papers
hal-00307879v1
|
|
|
Les Passages : Une métaphore pour la Collaboration Musicale en Réalité Virtuelle25ème conférence francophone sur l'Interaction Homme-Machine, IHM'13, Nov 2013, Bordeaux, France
Conference poster
hal-00879603v1
|
|
|
From the Lab to the Stage: Practical Considerations on Designing Performances with Immersive Virtual Musical InstrumentsSonic Interactions In Virtual Environments, Springer VS, inPress, 978-3-031-04020-7
Book sections
hal-03790049v1
|
|
|
Toward Augmented Familiarity of the Audience with Digital Musical InstrumentsMusic Technology with Swing, Springer, pp.558-573, 2018, 978-3-030-01691-3
Book sections
hal-01954791v1
|
AAGRIP - Music : Attributed Agency through Grip Force2023
Preprints, Working Papers, ...
hal-04235100v1
|
|
|
Construction, manipulation et visualisation de processus sonores dans des environnements virtuels immersifs pour la performance musicaleInformatique [cs]. Université Sciences et Technologies - Bordeaux I, 2010. Français. ⟨NNT : ⟩
Theses
tel-00573382v1
|
|
|
Revealing Interactions : Expression and Exploration in Mixed and Virtual RealityGraphics [cs.GR]. Université de Lille, 2023
Habilitation à diriger des recherches
tel-04425551v1
|