
Rémi Ronfard
Presentation
I am a Computer Science researcher with a rich experience in industry and academia in France and North America.
I graduated from Mines Paris Tech in 1986, where I also got my PhD in 1991. I have conducted research in a variety of domains, from geometric design to 3D animation and computer vision.
This includes work on non-manifold topology in CATIA (Dassault Systèmes, 1991), mesh LODs (IBM Research, 1992), digital cartoon storyboarding (INA, 1995), aesthetic surface design (IBM Research and Dassault Systèmes, 2000), video indexing (INA, 2000), action recognition and statistical analysis of image and film styles (INRIA 2002-2007). I was an expert in the international MPEG group from
1997 to 2000.
In 2007, I joined Xtranormal Technologies in Montreal, where I became R&D director for virtual cinematography. My team created the patented “magicam” system, which was used to produce two million user-generated animation movies.
I came back to INRIA in 2009 with a new research program devoted to “directing virtual worlds”. I helped to create the IMAGINE team in 2012, where I now lead the “narrative design” part of the project.
Towards this goal, I investigate computational models of visual storytelling and movie-making. This leads to inspiring collaborations with the national film school (ENS Louis Lumière), Célestins Theatre in Lyon, University of Geneva, Bernard Stiegler’s Institut de Recherche et d’Innovation, and with companies UBICAST, Thalès-Angénieux and Binocle 3D.
I have co-chaired international workshops on modeling people and human interaction (Beijing, 2005), 3-D cinematography (New York City, 2006; Banff, 2008; Providence, 2012), intelligent cinematography and editing
(Quebec, 2014; Zurich, 2015) and computational models of narratives (Atlanta, 2015).
I am currently serving as head of the “Geometry and Image” Department at Laboratoire Jean Kuntzmann, University of Grenoble.
Publications
Publications
|
Modern Dance Retargeting using Ribbons as Lines of ActionEUROGRAPHICS 2024 - 45th Annual Conference of the European Association for Computer Graphics, Apr 2024, Limassol, Cyprus. pp.1-4, ⟨10.2312/egs.20241019⟩
Conference papers
hal-04905809
v1
|
|
Feeling One's Way: In Search of a Symbiotic Vocabulary of the VirtualISEA 2023 - Internation Symposium on Electronic Art, May 2023, Paris, France. pp.1-9
Conference papers
hal-04410667
v1
|
|
Theater in the age of the metaverseSVSN 2023 - Spectacle vivant, scènes numériques, Festival d'Avignon, Jul 2023, Avignon, France
Conference papers
hal-04376157
v1
|
Electronic arts in the age of the metaverse: what kind of a positive symbiotic organization?ISEA 2024 - 28th International Symposium on Electronic Art, May 2023, Paris, France
Conference papers
hal-04412582
v1
|
|
|
The Hitchcock Experience - a Spatial Montage projectInternational Symposium on Electronic Art (ISEA), May 2023, Paris, France. pp.1-7
Conference papers
hal-04133336
v1
|
|
Visualizing Isadora Duncan’s movements qualitiesC&C 2022 - 14th ACM conference on Creativity & Cognition, Jun 2022, Venice, Italy. pp.196-207, ⟨10.1145/3527927.3532805⟩
Conference papers
hal-03778399
v1
|
|
(Re-)Framing Virtual RealityWICED 2022 - 10th Workshop on Intelligent Cinematography and Editing, Apr 2022, Reims, France. pp.1-8, ⟨10.2312/wiced.20221051⟩
Conference papers
hal-03654922
v1
|
|
The Prose Storyboard Language: A Tool for Annotating and Directing MoviesWICED 2022 - 10th Workshop on Intelligent Cinematography and Editing, Apr 2022, Reims, France. pp.1-16
Conference papers
hal-03654906
v1
|
|
Montage as a narrative vector for virtual reality experiencesVirtual Reality International Conference (VRIC), Laval Virtual., S. Richir, Apr 2022, Laval, France
Conference papers
hal-03654937
v1
|
|
Blocking notation: a tool for annotating and directing theaterJournées d’Informatique Théâtrale, ENSATT, Oct 2022, Lyon, France
Conference papers
hal-04130264
v1
|
|
Elastic Rods for Fluid Dance Movements ModelingAFIG 2021, 2021, Sophia Antipolis, France
Conference papers
hal-04136667
v1
|
Blocking notation. Un outil pour l’annotation de la mise en scène2021 - Convegno internazionale “Marivaux et les scènes européennes", Nov 2021, Florence, Italie
Conference papers
hal-03531039
v1
|
|
|
Etude des répétitions 2.0 : KINOAI, logiciel webJIT 2020 - Journées d’Informatique Théâtrale, Performance Lab, Univ. Grenoble Alpes, Feb 2020, Grenoble, France. pp.1-3
Conference papers
hal-03419976
v1
|
|
Pourquoi l'informatique théâtrale ?JIT 2020 - Journées d’Informatique Théâtrale, Performance Lab, Univ. Grenoble Alpes, Feb 2020, Grenoble, France. pp.1-4
Conference papers
hal-03419986
v1
|
|
Réalité augmentée sur scèneJIT 2020 - Journées d’Informatique Théâtrale, Performance Lab, Univ. Grenoble Alpes, Feb 2020, Grenoble, France. pp.1-3
Conference papers
hal-03419974
v1
|
|
Recognition of Laban Effort Qualities from Hand MotionMOCO'20 - 7th International Conference on Movement and Computing, Jul 2020, Jersey City/ Virtual, United States. pp.1-8, ⟨10.1145/3401956.3404227⟩
Conference papers
hal-02899999
v1
|
|
Recognizing Manipulation Actions from State-TransformationsEPIC@CVPR 2019 - Fourth International Workshop on Egocentric Perception Interaction and Computing, Jun 2019, Long Beach, United States. pp.1-4
Conference papers
hal-02197549
v1
|
|
Approximate Reconstruction of 3D Scenes From Bas-ReliefsGCH 2019 - EUROGRAPHICS Workshop on Graphics and Cultural Heritage, Nov 2019, Sarajevo, Bosnia and Herzegovina. pp.109-118, ⟨10.2312/gch20191356⟩
Conference papers
hal-02313660
v1
|
|
Spatial Motion Doodles: Sketching Animation in VR Using Hand Gestures and Laban Motion AnalysisMIG 2019 - ACM SIGGRAPH Conference on Motion, Interaction and Games, Oct 2019, Newcastle upon Tyne, United Kingdom. ⟨10.1145/3359566.3360061⟩
Conference papers
hal-02303803
v1
|
|
Text-to-Movie Authoring of Anatomy LessonsAIME 2019 - 17th conference on artificial intelligence in medicine, Jun 2019, Poznan, Poland. pp.304-308, ⟨10.1007/978-3-030-21642-9_39⟩
Conference papers
hal-02143822
v1
|
|
Recognition and Localization of Food in Cooking VideosJoint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management (CEA-MADiMa 2018), Jul 2018, Stockholm, Sweden. pp.21-24, ⟨10.1145/3230519.3230590⟩
Conference papers
hal-01815512
v3
|
|
Répétitions en cours : la fabrique de la fabrique des monstresAttention, machine ! Pratiques artistiques et recyclages médiatiques, Feb 2018, Grenoble, France
Conference papers
hal-03501250
v1
|
|
Automatic Generation of Geological Stories from a Single SketchExpressive ’18 - The Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Aug 2018, Victoria, Canada. pp.17-19, ⟨10.1145/3229147.3229161⟩
Conference papers
hal-01817923
v1
|
|
Making Movies from Make-Believe GamesWICED 2017 - 6th Workshop on Intelligent Cinematography and Editing (WICED 2017), Apr 2017, Lyon, France. ⟨10.2312/wiced.20171074⟩
Conference papers
hal-01518981
v2
|
|
Five Challenges for Intelligent Cinematography and EditingEurographics Workshop on Intelligent Cinematography and Editing, Eurographics Association, Apr 2017, Lyon, France. ⟨10.2312/wiced.20171069⟩
Conference papers
hal-01515027
v1
|
|
Figurines, a multimodal framework for tangible storytellingWOCCI 2017 - 6th Workshop on Child Computer Interaction at ICMI 2017 - 19th ACM International Conference on Multi-modal Interaction, Nov 2017, Glasgow, United Kingdom. pp.52-57, ⟨10.21437/WOCCI.2017-9⟩
Conference papers
hal-01595775
v2
|
|
A system for creating virtual reality content from make-believe gamesIEEE Virtual Reality 2017, Mar 2017, Los Angeles, United States. pp.207-208, ⟨10.1109/VR.2017.7892249⟩
Conference papers
hal-01578326
v1
|
|
Implementing Hitchcock - the Role of Focalization and ViewpointEurographics Workshop on Intelligent Cinematography and Editing, Eurographics Association, Apr 2017, Lyon, France. ⟨10.2312/wiced.20171065⟩
Conference papers
hal-01515023
v1
|
|
The Stereoscopic ZoomComputation Cameras and Displays, Jul 2017, Honolulu, United States. pp.1295-1304, ⟨10.1109/CVPRW.2017.170⟩
Conference papers
hal-01572470
v1
|
|
Characterization of Audiovisual Dramatic AttitudesInterspeech 2016 - 17th Annual Conference of the International Speech Communication Association, Sep 2016, San Francisco, United States. pp.585-589, ⟨10.21437/Interspeech.2016-75⟩
Conference papers
hal-01337077
v1
|
|
A Computational Framework for Vertical Video Editing4th Workshop on Intelligent Camera Control, Cinematography and Editing, Eurographics, May 2015, Zurich, Switzerland. pp.31-37, ⟨10.2312/wiced.20151075⟩
Conference papers
hal-01160591
v1
|
|
Comparing film-editingEurographics Workshop on Intelligent Cinematography and Editing, WICED '15 , May 2015, Zurich, Switzerland. pp.5-12, ⟨10.2312/wiced.20151072⟩
Conference papers
hal-01160593
v2
|
|
Adding dynamics to sketch-based character animationsSketch-Based Interfaces and Modeling (SBIM) 2015, Jun 2015, Istanbul, Turkey. pp.27-34
Conference papers
hal-01154847
v1
|
Computer Generation of Filmic Discourse from a Cognitive/Affective PerspectiveEurographics Workshop on Intelligent Cinematography and Editing, May 2015, Zurich, Switzerland
Conference papers
hal-01160592
v1
|
|
|
Curtains Up! Lights, Camera, Action! Documenting the Creation of Theater and Opera Productions with Linked Data and Web TechnologiesInternational Conference on Web Engineering ICWE 2015, International Society for the Web Engineering, Jun 2015, Amsterdam, Netherlands. pp.10
Conference papers
hal-01159826
v1
|
|
Continuity Editing for 3D AnimationAAAI Conference on Artificial Intelligence, Jan 2015, Austin, TX, United States. pp.753-761
Conference papers
hal-01088561
v2
|
|
Audiovisual Generation of Social Attitudes from Neutral StimuliFAAVSP 2015 - 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing, Sep 2015, Vienne, Austria. pp.34-39
Conference papers
hal-01178056
v1
|
|
Camera-on-rails: Automated Computation of Constrained Camera PathsACM SIGGRAPH Conference on Motion in Games, Nov 2015, Paris, France. pp.151-157, ⟨10.1145/2822013.2822025⟩
Conference papers
hal-01220119
v1
|
|
Capturing and Indexing Rehearsals: The Design and Usage of a Digital Archive of Performing ArtsDigital Heritage, Sep 2015, Grenade, Spain. pp.533-540, ⟨10.1109/DigitalHeritage.2015.7419570⟩
Conference papers
hal-01178053
v1
|
|
How Do We Evaluate the Quality of Computational Editing Systems?AAAI Workshop on Intelligent Cinematography And Editing, Jul 2014, Québec, Canada. pp.35-39
Conference papers
hal-00994106
v1
|
How generative digital media is reshaping narrativeInternational Conference on Narrative, Mar 2014, Cambridge, United States
Conference papers
hal-00983261
v1
|
|
|
Beyond Basic Emotions: Expressive Virtual Actors with Social AttitudesMIG 2014 - 7th International ACM SIGGRAPH Conference on Motion in Games 2014 (MIG 2014), Nov 2014, Los Angeles, United States. pp.39-47, ⟨10.1145/2668084.2668084⟩
Conference papers
hal-01064989
v1
|
|
Narrative-Driven Camera Control for Cinematic Replay of Computer GamesMIG'14 - 7th International Conference on Motion in Games , Nov 2014, Los Angeles, United States. pp. 109-117 ⟨10.1145/2668064.2668104⟩
Conference papers
hal-01067016
v1
|
Stereoscopic Previz in the Blender Game EngineBlender Conference, Blender Foundation, Oct 2014, Amsterdam, Netherlands
Conference papers
hal-01086760
v1
|
|
|
Dynamic Stereoscopic PrevizInternational Conference on 3D Imaging, Professeur Jacques G. Verly, Dec 2014, Liège, Belgium. ⟨10.1109/IC3D.2014.7032600⟩
Conference papers
hal-01083848
v1
|
|
Where story and media meet: computer generation of narrative discourse5th Workshop on Computational Models of Narrative, Jul 2014, Quebec City, Canada. pp.164-176
Conference papers
hal-01005381
v1
|
|
Multi-Clip Video Editing from a Single ViewpointCVMP 2014 - European Conference on Visual Media Production, Nov 2014, London, United Kingdom. pp.Article No. 9 ⟨10.1145/2668904.2668936⟩
Conference papers
hal-01067093
v1
|
|
Audio-Visual Speaker Conversion using Prosody FeaturesAVSP 2013 - 12th International Conference on Auditory-Visual Speech Processing, Aug 2013, Annecy, France. pp.11-16
Conference papers
hal-00842928
v1
|
|
The Prose Storyboard Language: A Tool for Annotating and Directing Movies2nd Workshop on Intelligent Cinematography and Editing part of Foundations of Digital Games - FDG 2013, Society for the Advancement of the Science of Digital Games, May 2013, Chania, Crete, Greece
Conference papers
hal-00814216
v1
|
|
Captation vidéo et analyse génétique du théâtre : l'informatique au service de la recherche théâtrale.International Federation for Theatre Research, International Federation for Theatre Research, Jul 2013, Barcelone, Spain
Conference papers
hal-00841579
v1
|
|
Detecting and Naming Actors in Movies using Generative Appearance ModelsCVPR 2013 - International Conference on Computer Vision and Pattern Recognition, IEEE, Jun 2013, Portland, Oregon, United States. pp.3706-3713, ⟨10.1109/CVPR.2013.475⟩
Conference papers
hal-00814197
v1
|
|
Steering Behaviors for Autonomous CamerasMIG 2013 - ACM SIGGRAPH conference on Motion in Games, Nov 2013, Dublin, Ireland. pp.93-102, ⟨10.1145/2522628.2522899⟩
Conference papers
hal-00862713
v1
|
|
A Review of Film Editing Techniques for Digital GamesWorkshop on Intelligent Cinematography and Editing, May 2012, Raleigh, United States
Conference papers
hal-00694444
v1
|
|
La simulation du travail théâtral et sa " notation " informatiqueLa notation du travail théâtral : du manuscrit au numérique, Monique Martinez and Sophie Proust and Matthieu Pouget, Apr 2012, Toulouse, France
Conference papers
hal-00768897
v1
|
|
Notation et reconnaissance des actions scéniques par ordinateurLa notation du travail théâtral : du manuscrit au numérique, Monique Martinez, Sophie Proust, Matthieu Pouget, Apr 2012, Toulouse, France
Conference papers
hal-00768893
v1
|
|
Generating 3D Scenes in the style of Keith HaringGenerative Arts, Dec 2012, Lucca, Italy. pp.297-307
Conference papers
hal-00767471
v1
|
|
Film Editing for Third Person Games and MachinimaWorkshop on Intelligent Cinematography and Editing, May 2012, Raleigh, United States
Conference papers
hal-00694455
v1
|
|
Automated Camera Planner for Film Editing Using Key ShotsSCA 2011 - ACM Siggraph / Eurographics Symposium on Computer Animation, ACM SIGGRAPH / Eurographics, Aug 2011, Vancouver, Canada
Conference papers
hal-00646404
v1
|
|
Computational Model of Film Editing for Interactive StorytellingICIDS 2011 - International Conference on Interactive Digital Storytelling, Nov 2011, Vancouver, Canada. pp.305-308, ⟨10.1007/978-3-642-25289-1_35⟩
Conference papers
hal-00646405
v1
|
|
Action Recognition from Arbitrary Views using 3D ExemplarsICCV 2007 - 11th IEEE International Conference on Computer Vision, Oct 2007, Rio de Janeiro, Brazil. pp.1-7, ⟨10.1109/ICCV.2007.4408849⟩
Conference papers
inria-00544741
v1
|
|
Articulated-Body Tracking Through Anisotropic Edge DetectionWorkshop on Dynamical Vision, May 2006, Graz, Austria. pp.86-99, ⟨10.1007/978-3-540-70932-9_7⟩
Conference papers
inria-00544742
v1
|
|
Automatic Discovery of Action Taxonomies from Multiple ViewsIEEE Conference on Computer Vision and Pattern Recognition (CVPR '06), Jun 2006, New York, United States. pp.1639--1645, ⟨10.1109/CVPR.2006.65⟩
Conference papers
inria-00590216
v1
|
|
Multiple Camera Calibration using Robust Perspective Factorization3D Data Processing, Visualization and Transmission, 2006, Chapel Hill, United States. pp.504 -511
Conference papers
inria-00545155
v1
|
|
Tracking with the Kinematics of Extremal ContoursAsian Conference on Computer Vision, 2006, Hyderabad, India. pp.664-673, ⟨10.1007/11612032_67⟩
Conference papers
inria-00262291
v1
|
|
Motion History Volumes for Free Viewpoint Action RecognitionWorkshop on modeling People and Human Interaction (PHI'05), Oct 2005, Beijing, China
Conference papers
inria-00590197
v1
|
Reading Movies An Integrated DVD Player for Browsing Movies And Their ScriptsACM Multimedia, ACM, 2004, New York City, United States
Conference papers
inria-00545143
v1
|
|
|
Detail-preserving variational surface design with multiresolution constraintsShape Modeling Applications, 2004, Genova, Italy. pp.119 - 128, ⟨10.1109/SMI.2004.1314499⟩
Conference papers
inria-00544740
v1
|
|
A framework for aligning and indexing movies with their scriptProceedings of IEEE International Conference on Multimedia and Expo (ICME), Jul 2003, Baltimore, MD, United States
Conference papers
inria-00423417
v1
|
|
Learning to parse pictures of peopleEuropean Conference on Computer Vision, 2002, Copenhague, Denmark. pp.700--714
Conference papers
inria-00545109
v1
|
Variational Surface Design with Multiresolution ConstraintsSIAM Conference on Geometric Design and Computing, Nov 2001, Sacramento, United States
Conference papers
inria-00590150
v1
|
|
|
Clavis - a temporal reasoning system for classification of audiovisual sequencesRecherche d'Informations Assistée par Ordinateur (RIAO '00), Apr 2000, Paris, France. pp.1400--1415
Conference papers
inria-00590130
v1
|
|
A Language for Audiovisual Template Specification and Recognition6th International Conference on Principles and Practice of Constraint Programming (CP '00), Sep 2000, Singapore, Singapore. pp.128--142, ⟨10.1007/3-540-45349-0_11⟩
Conference papers
inria-00590131
v1
|
|
From Video Shot Clustering to Sequence SegmentationInternational Conference on Pattern Recognition, IEEE, 2000, Barcelone, Spain. pp.254-257, ⟨10.1109/ICPR.2000.902907⟩
Conference papers
inria-00545119
v1
|
|
Conceptual indexing of television images based on face and caption sizes and locations4th International Conference on Advances in Visual Information Systems (VISUAL '00), Nov 2000, Lyon, France. pp.349--359, ⟨10.1007/3-540-40053-2_31⟩
Conference papers
inria-00590141
v1
|
Audiovisual-based hypermedia authoring - using structured representations for efficient access to av documents.Hypertext, ACM, 1999, Darmstadt, Germany. pp.169-178, ⟨10.1145/294469.294620⟩
Conference papers
inria-00545189
v1
|
|
|
Scene Segmentation and Image Feature Extraction for Video Indexing and Retrieval3d International Conference on Visual Information Systems (VISUAL'99), Jun 1999, Amsterdam, Netherlands. pp.245--253, ⟨10.1007/3-540-48762-X_31⟩
Conference papers
inria-00590110
v1
|
|
Using Description Logics for Indexing Audiovisual DocumentsInternational Workshop on Description Logics (DL '98), Jun 1998, Trento, Italy
Conference papers
inria-00590092
v2
|
Proceedings of Eurographics Workshop on Intelligent Cinematography and Editing (WICED 2017)2017
Books
hal-01837223
v1
|
|
|
Image and Geometry Processing for 3-D CinematographyHerbert Edelsbrunner and Leif Kobbelt and Konrad Polthier. Springer, 5, pp.305, 2010, Geometry and Computing, 978-3642123917. ⟨10.1007/978-3-642-12392-4⟩
Books
inria-00544644
v1
|
|
La simulation du travail théâtral et sa " notation " informatiqueMonique Martinez; Sophie Proust. La notation du travail théâtral : du manuscrit au numérique., Lansman, 2016
Book sections
hal-01389848
v1
|
|
Notation et reconnaissance des actions scéniques par ordinateurMonique Martinez; Sophie Proust. La notation du travail théâtral : du manuscrit au numérique., Lansman, 2016
Book sections
hal-01389847
v1
|
Image and Geometry Processing for 3-D Cinematography: An IntroductionRemi Ronfard and Gabriel Taubin. Image and Geometry Processing for 3-D Cinematography, 5, Springer, pp.1-8, 2010, Geometry and Computing, 978-3-642-12391-7. ⟨10.1007/978-3-642-12392-4_1⟩
Book sections
istex
inria-00548693
v1
|
|
MPEG, une norme pour la compression, la structuration et la description du sonJean-Pierre BRIOT and François PACHET. Informatique musicale : du signal au signe musical, Hermes, pp.403--422, 2004, Informatique et Systemes d'Information, 978-2-7462-0825-4
Book sections
inria-00590174
v1
|
|
|
Logiques de descriptions pour l'analyse structurelle de filmManuel Zacklad and Gilles Kassel and Didier Bourigault and Jean Charlet. Ingénierie des Connaissances : evolutions récentes et nouveaux défis, Eyrolles, Paris, pp.423--440, 2000
Book sections
inria-00590112
v1
|
|
Analyse automatique de film - Des séquences d'images aux séquences d'actions.Interface homme-machine [cs.HC]. Université de Grenoble, 2009
Habilitation à diriger des recherches
tel-00450230
v1
|