Edouard Oyallon

Publications

Pré-publication, Document de travail (5)

Unbiased Approximate Vector-Jacobian Products for Efficient Backpropagation Killian Bakong,Laurent Massoulié,Edouard Oyallon,Kevin Scaman 2026 Pré-publication, Document de travail hal-05512493v1
Vectorizing string entries for data processing on tables: when are larger language models better? Léo Grinsztajn,Myung Jun Kim,Edouard Oyallon,Gaël Varoquaux 2023 Pré-publication, Document de travail hal-04345931v1
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning Eugene Belilovsky,Louis Leconte,Lucas Caccia,Michael Eickenberg,Edouard Oyallon 2021 Pré-publication, Document de travail hal-03247753v1
Interferometric Graph Transform for Community Labeling Nathan Grinsztajn,Louis Leconte,Philippe Preux,Edouard Oyallon 2021 Pré-publication, Document de travail hal-03247781v1
Nonlinear Acceleration of Deep Neural Networks Damien Scieur,Edouard Oyallon,Alexandre D 'Aspremont,Francis Bach 2018 Pré-publication, Document de travail hal-01799269v1

Communication dans un congrès (20)

PETRA: Parallel End-to-end Training with Reversible Architectures Stéphane Rivaud,Louis Fournier,Thomas Pumir,Eugene Belilovsky,Michael Eickenberget al. The Thirteenth International Conference on Learning Representations, Apr 2025, Singapour, Singapore Communication dans un congrès hal-04594647v2
DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic prediction Rudy Morel,Jiequn Han,Edouard Oyallon International Conference on Machine Learning, Jul 2025, Vancouver, Canada Communication dans un congrès hal-05083819v1
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training Adel Nabli,Louis Fournier,Pierre Erbacher,Louis Serrano,Eugene Belilovskyet al. The Thirty-ninth Annual Conference on Neural Information Processing Systems, Dec 2025, San diego (Californie), United States Communication dans un congrès hal-04592562v3
$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning Adel Nabli,Eugene Belilovsky,Edouard Oyallon Thirty-seventh Conference on Neural Information Processing Systems, Dec 2023, New Orleans, United States Communication dans un congrès hal-04124318v2
Can Forward Gradient Match Backpropagation? Louis Fournier,Stéphane Rivaud,Eugene Belilovsky,Michael Eickenberg,Edouard Oyallon Fortieth International Conference on Machine Learning, Jul 2023, Honolulu (Hawaii), USA, United States Communication dans un congrès hal-04119829v1
Preventing Dimensional Collapse in Contrastive Local Learning with Subsampling Louis Fournier,Adeetya Patel,Michael Eickenberg,Edouard Oyallon,Eugene Belilovsky ICML 2023 Workshop on Localized Learning (LLW), Jul 2023, Honolulu (Hawaii), USA, United States Communication dans un congrès hal-04156218v1
DADAO: Decoupled Accelerated Decentralized Asynchronous Optimization Adel Nabli,Edouard Oyallon International Conference on Machine Learning, Jul 2023, Honolulu, United States Communication dans un congrès hal-03737694v3
Why do tree-based models still outperform deep learning on typical tabular data? Léo Grinsztajn,Edouard Oyallon,Gaël Varoquaux 36th Conference on Neural Information Processing Systems (NeurIPS 2022) Track on Datasets and Benchmarks, Nov 2022, New Orleans, United States Communication dans un congrès hal-03723551v3
On Non-Linear operators for Geometric Deep Learning Grégoire Sergeant-Perthuis,Jakob Maier,Joan Bruna,Edouard Oyallon Conference on Neural Information Processing Systems (Neurips), Dec 2022, New Orleans, United States. ⟨10.48550/arXiv.2207.03485⟩ Communication dans un congrès hal-03711864v2
The Unreasonable Effectiveness of Patches in Deep Convolutional Kernels Methods Louis Thiry,Michael Arbel,Eugene Belilovsky,Edouard Oyallon International Conference on Learning Representation (ICLR 2021), 2021, Vienna (online), Austria Communication dans un congrès hal-03114389v1
Low-Rank Projections of GCNs Laplacian Nathan Grinsztajn,Philippe Preux,Edouard Oyallon ICLR 2021 Workshop GTRL, May 2021, Online, France Communication dans un congrès hal-03248056v1
Deep Reinforcement Learning for L3 Slice Localization in Sarcopenia Assessment Othmane Laousy,Guillaume Chassagnon,Edouard Oyallon,Nikos Paragios,Marie-Pierre Revelet al. Machine Learning in Medical Imaging @MICCAI, Sep 2021, Strasbourg, France. pp.317-326, ⟨10.1007/978-3-030-87589-3_33⟩ Communication dans un congrès hal-03532954v1
Decoupled Greedy Learning of CNNs Eugene Belilovsky,Michael Eickenberg,Edouard Oyallon International Conference on Machine Learning, Jul 2020, Vienna (virtual), Austria. pp.5368-5377 Communication dans un congrès hal-02945327v1
Interferometric Graph Transform: a Deep Unsupervised Graph Representation Edouard Oyallon 37th International Conference on Machine Learning (ICML 2020), Jul 2020, Online, Austria Communication dans un congrès hal-02862516v1
On Lazy Training in Differentiable Programming Lenaic Chizat,Edouard Oyallon,Francis Bach NeurIPS 2019 - 33rd Conference on Neural Information Processing Systems, Dec 2019, Vancouver, Canada. pp.2937-2947 Communication dans un congrès hal-01945578v6
Greedy Layerwise Learning Can Scale to ImageNet Eugene Belilovsky,Michael Eickenberg,Edouard Oyallon ICML 2019 - 36th International Conference on Machine Learning, Jun 2019, Long Beach, CA, United States Communication dans un congrès hal-02119398v1
i-RevNet: Deep Invertible Networks Jörn-Henrik Jacobsen,Arnold Smeulders,Edouard Oyallon ICLR 2018 - International Conference on Learning Representations, Apr 2018, Vancouver, Canada Communication dans un congrès hal-01712808v1
Nonlinear Acceleration of CNNs Damien Scieur,Edouard Oyallon,Alexandre d'Aspremont,Francis Bach ICLR Workshop track, Apr 2018, Vancouver, Canada Communication dans un congrès hal-01805251v3
Compressing the Input for CNNs with the First-Order Scattering Transform Edouard Oyallon,Eugene Belilovsky,Sergey Zagoruyko,Michal Valko ECCV 2018 - European Conference on Computer Vision, Sep 2018, Munich, Germany Communication dans un congrès hal-01850921v1
Scaling the Scattering Transform: Deep Hybrid Networks Edouard Oyallon,Eugene Belilovsky,Sergey Zagoruyko International Conference on Computer Vision (ICCV), Oct 2017, Venice, Italy Communication dans un congrès hal-01495734v2

Article dans une revue (6)

Decentralized Asynchronous Optimization with DADAO allows Decoupling and Acceleration Adel Nabli,Edouard Oyallon Journal of Machine Learning Research, 2025, 26 (207), pp.1-48 Article dans une revue hal-05270499v2
Guiding The Last Layer in Federated Learning with Pre-Trained Models Gwen Legate,Nicolas Bernier,Lucas Caccia,Edouard Oyallon,Eugene Belilovsky Neurips, In press Article dans une revue hal-04262471v1
Gradient Masked Averaging for Federated Learning Irene Tenison,Sai Aravind Sreeramadas,Vaikkunth Mugunthan,Edouard Oyallon,Eugene Belilovskyet al. Transactions on Machine Learning Research Journal, 2022 Article dans une revue hal-04262447v1
Kymatio: Scattering Transforms in Python Mathieu Andreux,Tomás Angles,Georgios Exarchakis,Roberto Leonarduzzi,Gaspar Rochetteet al. Journal of Machine Learning Research, 2020, 21 (60), pp.1-6 Article dans une revue hal-02945354v1
Scattering Networks for Hybrid Representation Learning Edouard Oyallon,Sergey Zagoruyko,Gabriel Huang,Nikos Komodakis,Simon Lacoste-Julienet al. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, pp.11. ⟨10.1109/TPAMI.2018.2855738⟩ Article dans une revue hal-01837587v1
An Analysis of the SURF Method Edouard Oyallon,Julien Rabin Image Processing On Line, 2015, 5, pp.176 - 218. ⟨10.5201/ipol.2015.69⟩ Article dans une revue hal-01657161v1

HDR (1)

Contributions to Local, Asynchronous and Decentralized Learning, and to Geometric Deep Learning Edouard Oyallon Artificial Intelligence [cs.AI]. Sorbonne Université, 2023 HDR tel-04334118v1

Thèse (1)

Analyzing and introducing structures in deep convolutional neural networks Edouard Oyallon Computer Vision and Pattern Recognition [cs.CV]. Université Paris sciences et lettres, 2017. English. ⟨NNT : 2017PSLEE060⟩ Thèse tel-03917151v2