Mehdi Khamassi

Documents

Publications

	Rat anterior cingulate neurons responsive to rule or strategy changes are modulated by the hippocampal theta rhythm and sharp‐wave ripples Mehdi Khamassi , Adrien Peyrache , Karim Benchenane , D. A. Hopkins , N. Lebas European Journal of Neuroscience, 2024, pp.1-28. ⟨10.1111/ejn.16496⟩ Journal articles hal-04673955v1
	A new paradigm to study social and physical affordances as model-based reinforcement learning Augustin Chartouny , Keivan Amini , Mehdi Khamassi , Benoît Girard Cognitive Robotics, 2024, 4, pp.142-155. ⟨10.1016/j.cogr.2024.08.001⟩ Journal articles hal-04678813v1
	Does the enactive approach provide the framework for a new definition of learning? Olivier Gapenne , Mehdi Khamassi Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2024, Perspective(s) enactive(s) en sciences de l'éducation et de la formation, 80 (1), pp.21-58 Journal articles hal-04670326v1
	Strong and weak alignment of large language models with human values Mehdi Khamassi , Marceau Nahon , Raja Chatila Scientific Reports, 2024, 14, pp.19399. ⟨10.1038/s41598-024-70031-3⟩ Journal articles hal-04670604v1
	Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour François Cinotti , Etienne Coutureau , Mehdi Khamassi , Alain R Marchand , Benoît Girard European Journal of Neuroscience, 2024, ⟨10.1111/ejn.16449⟩ Journal articles hal-04630200v1
	[∼Re] Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress Augustin Chartouny , Jean-Pierre Nadal , Mehdi Khamassi The ReScience journal, 2024, 73, ⟨10.5281/zenodo.13627804⟩ Journal articles hal-04683838v1
	Increased cortical plasticity leads to memory interference and enhanced hippocampal-cortical interactions Irene Navarro Lobato , Adrian Aleman-Zapata , Anumita Samanta , Milan Bogers , Shekhar Narayanan eLife, 2023, ⟨10.7554/eLife.84911⟩ Journal articles hal-04112434v1
	Reducing computational cost during robot navigation and human-robot interaction with a human-inspired reinforcement learning architecture Rémi Dromnelle , Erwan Renaudo , Mohamed Chetouani , Petros Maragos , Raja Chatila International Journal of Social Robotics, 2023, 15, pp.1297-1323. ⟨10.1007/s12369-022-00942-6⟩ Journal articles hal-03829879v1
	Illusion of knowledge in statistics among clinicians: evaluating the alignment between objective accuracy and subjective confidence, an online survey Camille Lakhlifi , François-Xavier Lejeune , Marion Rouault , Mehdi Khamassi , Benjamin Rohaut Cognitive Research: Principles and Implications, 2023, 8, ⟨10.1186/s41235-023-00474-1⟩ Journal articles hal-04076913v1
	Zero-shot model-free learning of periodic movements for a bio-inspired soft-robotic arm Paris Oikonomou , Athanasios Dometios , Mehdi Khamassi , Costas Tzafestas Frontiers in Robotics and AI, 2023, 10, pp.1256763. ⟨10.3389/frobt.2023.1256763⟩ Journal articles hal-04249680v1
	Editorial: Neurorobotics explores the human senses Mehdi Khamassi , Marco Mirolli , Christian Wallraven Frontiers in Neurorobotics, 2023, 17, ⟨10.3389/fnbot.2023.1214871⟩ Journal articles hal-04102103v1
	[Re] A general model of hippocampal and dorsal striatal learning and decision making Thomas Misiek , Mehdi Khamassi ReScience C, 2022, 8 (1), pp.#4. ⟨10.5281/zenodo.6573684⟩ Journal articles hal-03676469v1
	Model-Based and Model-Free Replay Mechanisms for Reinforcement Learning in Neurorobotics Elisa Massi , Jeanne Barthélemy , Juliane Mailly , Rémi Dromnelle , Julien Canitrot Frontiers in Neurorobotics, 2022, 16, pp.864380. ⟨10.3389/fnbot.2022.864380⟩ Journal articles hal-03703727v1
	Reward-mediated, model-free reinforcement-learning mechanisms in Pavlovian and instrumental tasks are related Neema Moin Afshar , François Cinotti , David A. Martin , Mehdi Khamassi , Donna J Calu Journal of Neuroscience, 2022, 43 (3), pp.458-471. ⟨10.1523/JNEUROSCI.1113-22.2022⟩ Journal articles hal-03800432v1
	Computational Model of the Transition from Novice to Expert Interaction Techniques Gilles Bailly , Mehdi Khamassi , Benoît Girard ACM Transactions on Computer-Human Interaction, 2022, ⟨10.1145/3505557⟩ Journal articles hal-03537963v1
	Editorial: Computational Models of Affordance for Robotics Erwan Renaudo , Philipp Zech , Raja Chatila , Mehdi Khamassi Frontiers in Neurorobotics, 2022, 16, pp.1045355. ⟨10.3389/fnbot.2022.1045355⟩ Journal articles hal-03782365v1
	Liberté & Cognition. Une autre voie est possible Cyril Monier , Mehdi Khamassi Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2021, pp.7-32 Journal articles hal-03656536v1
	Social prediction modulates activity of macaque superior temporal cortex Lea Roumazeilles , Matthias Schurz , Mathilde Lojkiewiez , Lennart Verhagen , Urs Schüffelgen Science Advances , 2021, 7 (38) Journal articles hal-03346442v1
	The magical orbitofrontal cortex. Geoffrey Schoenbaum , Mehdi Khamassi , Mathias Pessiglione , Jay A Gottfried , Elisabeth A Murray Behavioral Neuroscience, 2021, 135 (2), pp.108 - 108. ⟨10.1037/bne0000470⟩ Journal articles hal-03251587v1
	Inscription corporelle des dynamiques cognitives et leur impact sur la liberté de l’humain en société Mehdi Khamassi , Jean Lorenceau Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2021, 75, pp.33-72 Journal articles hal-03656562v1
	The rodent lateral orbitofrontal cortex as an arbitrator selecting between model-based and model-free learning systems Marios C Panayi , Mehdi Khamassi , Simon Killcross Behavioral Neuroscience, 2021, 135 (2), pp.226-244. ⟨10.1037/bne0000454⟩ Journal articles hal-03107588v2
	Modeling awake hippocampal reactivations with model-based bidirectional search Mehdi Khamassi , Benoît Girard Biological Cybernetics (Modeling), 2020, 114 (2), pp.231-248. ⟨10.1007/s00422-020-00817-x⟩ Journal articles hal-02504897v1
	Special Issue on Behavior Adaptation, Interaction, and Artificial Perception for Assistive Robotics Mariacarla Staffa , Silvia Rossi , Adriana Tapus , Mehdi Khamassi International Journal of Social Robotics, 2020, 12, pp.613 - 616. ⟨10.1007/s12369-020-00655-8⟩ Journal articles hal-02864719v1
	The Object Space Task reveals increased expression of cumulative memory in a mouse model of Kleefstra syndrome Evelien H.S. Schut , Irene Navarro Lobato , Alejandra Alonso , Steven Smits , Mehdi Khamassi Neurobiology of Learning and Memory, 2020, 173, pp.107265. ⟨10.1016/j.nlm.2020.107265⟩ Journal articles hal-02941978v1
	Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys Marco K Wittmann , Elsa Fouragnan , Davide Folloni , Miriam C Klein-Flügge , Bolton K H Chau Nature Communications, 2020, 11 (1), ⟨10.1038/s41467-020-17343-w⟩ Journal articles hal-03098645v1
	A Novel Reinforcement-Based Paradigm for Children to Teach the Humanoid Kaspar Robot Abolfazl Zaraki , Mehdi Khamassi , Luke J Wood , Gabriella Lakatos , Costas S Tzafestas International Journal of Social Robotics, 2020, 12 (3), pp.709-720. ⟨10.1007/s12369-019-00607-x⟩ Journal articles hal-02408941v1
	The object space task shows cumulative memory expression in both mice and rats Lisa Genzel , Evelien Schut , Tim Schröder , Ronny Eichler , Mehdi Khamassi PLoS Biology, 2019, 17 (6), pp.e3000322. ⟨10.1371/journal.pbio.3000322⟩ Journal articles hal-02323650v1
	Éthique et sciences cognitives Mehdi Khamassi , Raja Chatila , Alain Mille Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2019, 2019/1 (70), pp.7-39 Journal articles hal-02324092v1
	Dopamine blockade impairs the exploration-exploitation trade-off in rats François Cinotti , Virginie Fresno , Nassim Aklil , Etienne Coutureau , Benoît Girard Scientific Reports, 2019, 9 (1), ⟨10.1038/s41598-019-43245-z⟩ Journal articles hal-02121649v1
	Impacts of inter-trial interval duration on a computational model of sign-tracking vs. goal-tracking behaviour François Cinotti , Alain Marchand , Matthew R Roesch , Benoît Girard , Mehdi Khamassi Psychopharmacology, 2019 Journal articles hal-02270920v1
	Manipulating the revision of reward value during the intertrial interval increases sign tracking and dopamine release Brian R Lee , Ronny N Gentry , Gregory B Bissonette , Rae J Herman , John Mallon PLoS Biology, 2018, 16 (9), pp.e2004015. ⟨10.1371/journal.pbio.2004015⟩ Journal articles hal-02324085v1
	Robot Fast Adaptation to Changes in Human Engagement During Simulated Dynamic Social Interaction With Active Exploration in Parameterized Reinforcement Learning Mehdi Khamassi , George Velentzas , Theodore Tsitsimis , Costas Tzafestas IEEE Transactions on Cognitive and Developmental Systems, 2018, 10 (4), pp.881-893. ⟨10.1109/TCDS.2018.2843122⟩ Journal articles hal-02324064v1
	Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task Guillaume Viejo , Benoît Girard , Emmanuel Procyk , Mehdi Khamassi Behavioural Brain Research, 2018, 355, pp.76-89. ⟨10.1016/j.bbr.2017.09.030⟩ Journal articles hal-01624253v1
	Adaptive reinforcement learning with active state-specific exploration for engagement maximization during simulated child-robot interaction George Velentzas , Theodore Tsitsimis , Iñaki Rañó , Costas Tzafestas , Mehdi Khamassi Paladyn: Journal of Behavioral Robotics, 2018, 9 (1), pp.235-253. ⟨10.1515/pjbr-2018-0016⟩ Journal articles hal-02324073v1
	Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences Sophie Bavard , Maël Lebreton , Mehdi Khamassi , Giorgio Coricelli , Stefano Palminteri Nature Communications, 2018, 9, pp.4503. ⟨10.1038/s41467-018-06781-2⟩ Journal articles hal-01927184v1
	Sequential Action Selection and Active Sensing for Budgeted Localization in Robot Navigation Nassim Aklil , Benoît Girard , Ludovic Denoyer , Mehdi Khamassi International Journal of Semantic Computing, 2018, 12 (01), pp.109-127. ⟨10.1142/S1793351X18400068⟩ Journal articles hal-02324047v1
	Toward Self-Aware Robots Raja Chatila , Erwan Renaudo , Mihai Andries , Omar Ricardo Chavez-Garcia , Pierre Luce-Vayrac Frontiers in Robotics and AI, 2018, 5, pp.88. ⟨10.3389/frobt.2018.00088⟩ Journal articles hal-01856931v1
	Hippocampal replays under the scrutiny of reinforcement learning models Romain Cazé , Mehdi Khamassi , Lise Aubin , Benoît Girard Journal of Neurophysiology, 2018, ⟨10.1152/jn.00145.2018⟩ Journal articles hal-02323528v1
	Interactions of spatial strategies producing generalization gradient and blocking: A computational approach Laurent Dollé , Ricardo Chavarriaga , Agnès Guillot , Mehdi Khamassi PLoS Computational Biology, 2018, 14 (4), pp.e1006092. ⟨10.1371/journal.pcbi.1006092⟩ Journal articles hal-02324053v1
	Sustainable computational science: the ReScience initiative Nicolas P. Rougier , Konrad Hinsen , Frédéric Alexandre , Thomas Arildsen , Lorena Barba PeerJ Computer Science, 2017, 3, pp.e142. ⟨10.7717/peerj-cs.142⟩ Journal articles hal-01592078v1
	Nouvelles approches en Robotique Cognitive Mehdi Khamassi , Stéphane Doncieux Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2016, 2016/1 (65), pp.7-25. ⟨10.3406/intel.2016.1788⟩ Journal articles hal-01375651v1
	Coopération de systèmes d’apprentissage par renforcement multiples. Benoît Girard , Mehdi Khamassi Techniques de l'Ingénieur, 2016, pp.S7793 Journal articles hal-01524743v1
	[Re] Speed/accuracy trade-off between the habitual and the goal-directed processes Guillaume Viejo , Benoît Girard , Mehdi Khamassi The ReScience journal, 2016, 2 (1), ⟨10.5281/zenodo.45852⟩ Journal articles hal-01524285v1
	La conscience d'une machine Raja Chatila , Mehdi Khamassi Interstices, 2016 Journal articles hal-01352801v1
	Integration of Action, Joint Action and Learning in Robot Cognitive Architectures Mehdi Khamassi , Benoît Girard , Aurélie Clodic , Sandra Devin , Erwan Renaudo Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2016, 2016/1 (65), pp.169-203. ⟨10.3406/intel.2016.1794⟩ Journal articles hal-01375666v1
	Respective Advantages and Disadvantages of Model-based and Model-free Reinforcement Learning in a Robotics Neuro-inspired Cognitive Architecture Erwan Renaudo , Benoît Girard , Raja Chatila , Mehdi Khamassi Procedia Computer Science, 2015, 71, pp.178-184. ⟨10.1016/j.procs.2015.12.194⟩ Journal articles hal-01250157v1
	Contextual modulation of value signals in reward and punishment learning Stefano Palminteri , Mehdi Khamassi , Mateus Joffily , Giorgio Coricelli Nature Communications, 2015, pp.article 8096. ⟨10.1038/ncomms9096⟩ Journal articles halshs-01236045v1
	Behavioral Regulation and the Modulation of Information Coding in the Lateral Prefrontal and Cingulate Cortex Mehdi Khamassi , René Quilodran , Pierre Enel , Peter Dominey , Emmanuel Procyk Cerebral Cortex, 2015, 25 (9), pp.3197-3218. ⟨10.1093/cercor/bhu114⟩ Journal articles hal-01219972v1
	Experimental predictions drawn from a computational model of sign-trackers and goal-trackers Florian Lesaint , Olivier Sigaud , Jeremy J. Clark , Shelly B. Flagel , Mehdi Khamassi Journal of Physiology - Paris, 2015, 109 (1-3), pp.78-86. ⟨10.1016/j.jphysparis.2014.06.001⟩ Journal articles hal-01219979v1
	Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning Guillaume Viejo , Mehdi Khamassi , Andrea Brovelli , Benoît Girard Frontiers in Behavioral Neuroscience, 2015, 9, pp.225. ⟨10.3389/fnbeh.2015.00225⟩ Journal articles hal-01215419v1
	Intelligence artificielle: l'apport des paradigmes incarnés Pierre de Loor , Alain Mille , Mehdi Khamassi Intellectica - La revue de l’Association pour la Recherche sur les sciences de la Cognition (ARCo), 2015, Sciences de la cognition: réflexions prospectives, 2 (64), pp.27-52. ⟨10.3406/intel.2015.1011⟩ Journal articles hal-01250421v1
	Accounting for Negative Automaintenance in Pigeons: A Dual Learning Systems Approach and Factored Representations Florian Lesaint , Olivier Sigaud , Mehdi Khamassi PLoS ONE, 2014, ⟨10.1371/journal.pone.0111050⟩ Journal articles hal-01219998v1
	Modelling Individual Differences in the Form of Pavlovian Conditioned Approach Responses: A Dual Learning Systems Approach with Factored Representation Florian Lesaint , Olivier Sigaud , Shelly B. Flagel , Terry E. Robinson , Mehdi Khamassi PLoS Computational Biology, 2014, 10 (2), pp.e1003466. ⟨10.1371/journal.pcbi.1003466⟩ Journal articles hal-00947727v1
	Modeling the Learning of Biomechanics and Visual Planning for Decision-Making of Motor Actions. Ignasi Cos , Mehdi Khamassi , Benoît Girard Journal of Physiology - Paris, 2013, 107 (5), pp.399-408. ⟨10.1016/j.jphysparis.2013.07.004⟩ Journal articles hal-01000837v1
	Optic Flow Stimuli Update Anterodorsal Thalamus Head Direction Neuronal Activity in Rats Angelo Arleo , Cyril Dejean , Pierre Allegraud , Mehdi Khamassi , Michaël Zugaro Journal of Neuroscience, 2013, 33 (42), pp.16790-16795. ⟨10.1523/JNEUROSCI.2698-13.2013⟩ Journal articles hal-02137209v1
	Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies Mehdi Khamassi , Mark D. Humphries Frontiers in Behavioral Neuroscience, 2012, ⟨10.3389/fnbeh.2012.00079⟩ Journal articles hal-01219958v1
	Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia Mark D. Humphries , Mehdi Khamassi , Kevin Gurney Frontiers in Neuroscience, 2012, 6 (9), pp.1-14. ⟨10.3389/fnins.2012.00009⟩ Journal articles hal-00688928v1
	A biologically inspired meta-control navigation system for the Psikharpax rat robot. Ken Caluwaerts , Mariacarla Staffa , Steve N'Guyen , Christophe Grand , Laurent Dollé Bioinspiration and Biomimetics, 2012, 7 (2), pp.025009. ⟨10.1088/1748-3182/7/2/025009⟩ Journal articles hal-01000945v1
	Robot cognitive control with a neurophysiologically inspired reinforcement learning model Mehdi Khamassi , Stéphane Lallée , Pierre Enel , Emmanuel Procyk , Peter Dominey Frontiers in Neurorobotics, 2011, 5 (1), pp.1-13. ⟨10.3389/fnbot.2011.00001⟩ Journal articles hal-00688931v1
	Principal component analysis of ensemble recordings reveals cell assemblies at high temporal resolution. Adrien Peyrache , Karim Benchenane , Mehdi Khamassi , Sidney I Wiener , Francesco P. Battaglia Journal of Computational Neuroscience, 2010, 29 (1-2), pp.309-25. ⟨10.1007/s10827-009-0154-6⟩ Journal articles hal-00551873v1
	Coherent theta oscillations and reorganization of spike timing in the hippocampal- prefrontal network upon learning Karim Benchenane , Adrien Peyrache , Mehdi Khamassi , Patrick L. Tierney , Yves Gioanni Neuron, 2010, 6 (6), pp.921-936. ⟨10.1016/j.neuron.2010.05.013⟩ Journal articles hal-00554482v1
	Sequential Reinstatement of Neocortical Activity during Slow Oscillations Depends on Cells' Global Activity. Adrien Peyrache , Karim Benchenane , Mehdi Khamassi , Sidney I Wiener , Francesco P. Battaglia Frontiers in Systems Neuroscience, 2010, 3, pp.18. ⟨10.3389/neuro.06.018.2009⟩ Journal articles hal-00551877v1
	Sequential reinstatement of neocortical activity during slow oscillations depends on cells’ global activity Adrien Peyrache , Karim Benchenane , Mehdi Khamassi , Sidney I Wiener , Francesco P Battaglia Frontiers in Systems Neuroscience, 2010, 3, ⟨10.3389/neuro.06.018.2009⟩ Journal articles hal-02364210v1
	Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Adrien Peyrache , Mehdi Khamassi , Karim Benchenane , Sidney I. Wiener , Francesco P. Battaglia Nature Neuroscience, 2009, 12 (7), pp.919-26. ⟨10.1038/nn.2337⟩ Journal articles hal-00551868v1
	Anticipatory reward signals in ventral striatal neurons of behaving rats. Mehdi Khamassi , Antonius B Mulder , Eiichi Tabuchi , Vincent Douchamps , Sidney I Wiener European Journal of Neuroscience, 2008, 28 (9), pp.1849-66. ⟨10.1111/j.1460-9568.2008.06480.x⟩ Journal articles hal-00618294v1
	The Psikharpax project: Towards building an artificial rat Jean-Arcady Meyer , Agnès Guillot , Benoît Girard , Mehdi Khamassi , Patrick Pirim Robotics and Autonomous Systems, 2005, 50 (4), pp.211-223. ⟨10.1016/j.robot.2004.09.018⟩ Journal articles hal-00016391v1
	Actor-critic models of reinforcement learning in the basal ganglia: From natural to artificial rats Mehdi Khamassi , Loïc Lachèze , Benoît Girard , Alain Berthoz , Agnès Guillot Adaptive Behavior, 2005, 13 (2), pp.131-148. ⟨10.1177/105971230501300205⟩ Journal articles hal-00016390v2
	Rat anterodorsal thalamic head direction neurons depend upon dynamic visual signals to select anchoring landmark cues. Michaël B Zugaro , Angelo Arleo , Cyril Déjean , Eric Burguière , Mehdi Khamassi European Journal of Neuroscience, 2004, 20 (2), pp.530-6. ⟨10.1111/j.1460-9568.2004.03512.x⟩ Journal articles hal-00618299v1

	Initiation à la modélisation computationnelle Anne Collins , Mehdi Khamassi Khamassi, M. (Ed.) Neurosciences cognitives, 2021 Book sections hal-03411274v1
	Décision et action Alizée Lopez-Persem , Mehdi Khamassi Khamassi, M. (Ed.) Neurosciences cognitives, 2021 Book sections hal-03411266v1
	When Artificial Intelligence and Computational Neuroscience meet Frédéric Alexandre , Peter Ford Dominey , Philippe Gaussier , Benoît Girard , Mehdi Khamassi Springer. A guided tour of artificial intelligence research, Interfaces and applications of artificial intelligence, 3, 2020, Interfaces and Applications of Artificial Intelligence, 978-3-030-06170-8 Book sections hal-01735123v1
	Apprentissage de la démarche scientifique et de l'esprit critique : un enseignement de Sorbonne Université pour les étudiants d'aujourd'hui, citoyens de demain Mehdi Khamassi , Frédéric Decremps Bertezene, S. and Vallat, D. (Eds.) Guider la raison qui nous guide : Agir et penser en complexité, 2019 Book sections hal-02324100v1
	L'action Mehdi Khamassi , Elisabeth Pacherie Collins, T., Andler, D. and Tallon-Baudry, C. La cognition : du neurone à la société, Gallimard, 2018 Book sections hal-02324111v2
	Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters Mehdi Khamassi , Pierre Enel , Peter Ford Dominey , Emmanuel Procyk Progress in Brain Research. Decision Making Neural and Behavioural Approaches, 2013, ⟨10.1016/B978-0-444-62604-2.00022-8⟩ Book sections hal-01628829v1
	Meta-learning, cognitive control, and physiological interactions between medial and lateral prefrontal cortex Mehdi Khamassi , Charles R E Wilson , Marie Rothé , René Quilodran , Peter F Dominey Mars, R., Sallet, J., Rushworth, M. and Yeung, N. (Eds.), Neural Bases of Motivational and Cognitive Control, MIT Press, 2011 Book sections hal-03415847v1
	Spatial decisions and neuronal activity in hippocampal projection zones in prefrontal cortex and striatum F P Battaglia , A Peyrache , Mehdi Khamassi , S I Wiener SJY Mizumori (ed.) Hippocampal Place Fields: Relevance to Learning and Memory, 2008 Book sections hal-03415844v1

	Complementary roles of the rat prefrontal cortex and striatum in reward-based learning and shifting navigation strategies Mehdi Khamassi Cognitive Sciences. Université Pierre et Marie Curie - Paris VI, 2007. English. ⟨NNT : ⟩ Theses tel-00688927v1

	Coordination of parallel learning processes in animals and robots Mehdi Khamassi Neurons and Cognition [q-bio.NC]. Université Pierre et Marie Curie (UPMC) - Paris 6, 2014 Habilitation à diriger des recherches tel-01074544v1

Mehdi Khamassi

Publications

Rat anterior cingulate neurons responsive to rule or strategy changes are modulated by the hippocampal theta rhythm and sharp‐wave ripples

A new paradigm to study social and physical affordances as model-based reinforcement learning

Does the enactive approach provide the framework for a new definition of learning?

Strong and weak alignment of large language models with human values

Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour

[∼Re] Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress

Increased cortical plasticity leads to memory interference and enhanced hippocampal-cortical interactions

Reducing computational cost during robot navigation and human-robot interaction with a human-inspired reinforcement learning architecture

Illusion of knowledge in statistics among clinicians: evaluating the alignment between objective accuracy and subjective confidence, an online survey

Zero-shot model-free learning of periodic movements for a bio-inspired soft-robotic arm

Editorial: Neurorobotics explores the human senses

[Re] A general model of hippocampal and dorsal striatal learning and decision making

Model-Based and Model-Free Replay Mechanisms for Reinforcement Learning in Neurorobotics

Reward-mediated, model-free reinforcement-learning mechanisms in Pavlovian and instrumental tasks are related

Computational Model of the Transition from Novice to Expert Interaction Techniques

Editorial: Computational Models of Affordance for Robotics

Liberté & Cognition. Une autre voie est possible

Social prediction modulates activity of macaque superior temporal cortex

The magical orbitofrontal cortex.

Inscription corporelle des dynamiques cognitives et leur impact sur la liberté de l’humain en société

The rodent lateral orbitofrontal cortex as an arbitrator selecting between model-based and model-free learning systems

Modeling awake hippocampal reactivations with model-based bidirectional search

Special Issue on Behavior Adaptation, Interaction, and Artificial Perception for Assistive Robotics

The Object Space Task reveals increased expression of cumulative memory in a mouse model of Kleefstra syndrome

Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys

A Novel Reinforcement-Based Paradigm for Children to Teach the Humanoid Kaspar Robot

The object space task shows cumulative memory expression in both mice and rats

Éthique et sciences cognitives

Dopamine blockade impairs the exploration-exploitation trade-off in rats

Impacts of inter-trial interval duration on a computational model of sign-tracking vs. goal-tracking behaviour

Manipulating the revision of reward value during the intertrial interval increases sign tracking and dopamine release

Robot Fast Adaptation to Changes in Human Engagement During Simulated Dynamic Social Interaction With Active Exploration in Parameterized Reinforcement Learning

Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task

Adaptive reinforcement learning with active state-specific exploration for engagement maximization during simulated child-robot interaction

Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences

Sequential Action Selection and Active Sensing for Budgeted Localization in Robot Navigation

Toward Self-Aware Robots

Hippocampal replays under the scrutiny of reinforcement learning models

Interactions of spatial strategies producing generalization gradient and blocking: A computational approach

Sustainable computational science: the ReScience initiative

Nouvelles approches en Robotique Cognitive

Coopération de systèmes d’apprentissage par renforcement multiples.

[Re] Speed/accuracy trade-off between the habitual and the goal-directed processes

La conscience d'une machine

Integration of Action, Joint Action and Learning in Robot Cognitive Architectures

Respective Advantages and Disadvantages of Model-based and Model-free Reinforcement Learning in a Robotics Neuro-inspired Cognitive Architecture

Contextual modulation of value signals in reward and punishment learning

Behavioral Regulation and the Modulation of Information Coding in the Lateral Prefrontal and Cingulate Cortex

Experimental predictions drawn from a computational model of sign-trackers and goal-trackers

Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning

Intelligence artificielle: l'apport des paradigmes incarnés

Accounting for Negative Automaintenance in Pigeons: A Dual Learning Systems Approach and Factored Representations

Modelling Individual Differences in the Form of Pavlovian Conditioned Approach Responses: A Dual Learning Systems Approach with Factored Representation

Modeling the Learning of Biomechanics and Visual Planning for Decision-Making of Motor Actions.

Optic Flow Stimuli Update Anterodorsal Thalamus Head Direction Neuronal Activity in Rats

Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies

Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia

A biologically inspired meta-control navigation system for the Psikharpax rat robot.

Robot cognitive control with a neurophysiologically inspired reinforcement learning model

Principal component analysis of ensemble recordings reveals cell assemblies at high temporal resolution.

Coherent theta oscillations and reorganization of spike timing in the hippocampal- prefrontal network upon learning

Sequential Reinstatement of Neocortical Activity during Slow Oscillations Depends on Cells' Global Activity.

Sequential reinstatement of neocortical activity during slow oscillations depends on cells’ global activity

Replay of rule-learning related neural patterns in the prefrontal cortex during sleep.

Anticipatory reward signals in ventral striatal neurons of behaving rats.

The Psikharpax project: Towards building an artificial rat

Actor-critic models of reinforcement learning in the basal ganglia: From natural to artificial rats

Rat anterodorsal thalamic head direction neurons depend upon dynamic visual signals to select anchoring landmark cues.

Initiation à la modélisation computationnelle

Décision et action

When Artificial Intelligence and Computational Neuroscience meet

Apprentissage de la démarche scientifique et de l'esprit critique : un enseignement de Sorbonne Université pour les étudiants d'aujourd'hui, citoyens de demain

L'action

Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters

Meta-learning, cognitive control, and physiological interactions between medial and lateral prefrontal cortex

Spatial decisions and neuronal activity in hippocampal projection zones in prefrontal cortex and striatum

Complementary roles of the rat prefrontal cortex and striatum in reward-based learning and shifting navigation strategies

Coordination of parallel learning processes in animals and robots