Home Research Teaching Projects Publications
research metrics at Google Scholar

Journals

Intrinsically motivated oculomotor exploration guided by uncertainty reduction and conditioned reinforcement in non-human primates, Nabil Daddaoua, Manuel Lopes and Jacqueline Gottlieb. Nature Scientific Reports, 6:20202, 2016. (web, pdf)

Multi-Armed Bandits for Intelligent Tutoring Systems, Manuel Lopes, Benjamin Clement, Didier Roy, Pierre-Yves Oudeyer. Journal of Educational Data Mining (JEDM), Vol 7, No 2, 2015. (pdf)

Exploiting task constraints for self-calibrated brain-machine interface control using error-related potentials, I. Iturrate, J. Grizou, J. Omedes, P.-Y. Oudeyer, M. Lopes and L. Montesano. PLOS One, 2015. (web, pdf)

Active Learning for Autonomous Intelligent Agents: Exploration, Curiosity, and Interaction, Manuel Lopes and Luis Montesano. arXiv:1403.1497 [cs.AI], 2014. (pdf)

Information-seeking, curiosity, and attention: computational and neural mechanisms, Jacqueline Gottlieb, Pierre-Yves Oudeyer, Manuel Lopes and Adrien Baranes. Trends in Cognitive Sciences , 2013. (web, pdf)

Active learning of visual descriptors for grasping using non-parametric smoothed beta distributions,Luis Montesano and Manuel Lopes. Robotics and Autonomous Systems, 60(3), 452-462, 2012.(pdf)

The iCub humanoid robot: An open-systems platform for research in cognitive development,Giorgio Metta, Lorenzo Natale, Francesco Nori, Giulio Sandini, David Vernon, Luciano Fadiga, Claes von Hofsten, Kerstin Rosander, Manuel Lopes, Jose Santos-Victor, Alexandre Bernardino, Luis Montesano. Neural Networks, 2010. (pdf)

Active Learning and Intrinsically Motivated Exploration in Robots: Advances and Challenges (Guest Editorial),Manuel Lopes and Pierre-Yves Oudeyer. IEEE Transactions on Autonomous Mental Development, 2(2), June, 2010. (pdf)

A Computational Model of Social-Learning Mechanisms, Manuel Lopes, Francisco S. Melo, Ben Kenward and Jose Santos-Victor. Adaptive Behaviour, 467(17), 2009. (pdf)

Learning Object Affordances: From Sensory Motor Maps to Imitation, Luis Montesano, Manuel Lopes, Alexandre Bernardino,and Jose Santos-Victor. IEEE Transactions on Robotics, 24(1), 2008. (pdf)

A Developmental Roadmap for Learning by Imitation in Robots, Manuel Lopes and Jose Santos-Victor. IEEE Transactions in Systems Man and Cybernetic - Part B: Cybernetics, 37(2), 2007. (DOI:10.1109/TSMCB.2006.886949, web, pdf)

Visual Learning by Imitation with Motor Representations, Manuel Lopes and Jose Santos-Victor. IEEE Transactions on Systems, Man and Cybernetics - Part B: Cybernetics, 35, 2005. (pdf)


Book Chapters

Multi-class Generalized Binary Search for Active Inverse Reinforcement Learning, Francisco Melo and Manuel Lopes. arXiv:1301.5488 [cs.LG], 2013. (pdf)

Abstraction Levels for Robotic Imitation: Overview and Computational Approaches, Manuel Lopes, Luis Montesano, Francisco Melo and Jose Santos-Victor. in Olivier Sigaud & Jan Peters editors, From motor to interaction learning in robots, Studies in Computational Intelligence, Springer Berlin / Heidelberg, Volume 264, pp. 313 -- 355, 2010. (pdf)

A Computational Model of Object Affordances. Luis Montesano, Manuel Lopes, Francisco Melo, Alexandre Bernardino and Jose Santos-Victor, Advances in Cognitive Systems, 2009. (pdf)

Conferences

Relational Activity Processes for Modeling Concurrent Cooperation, Marc Toussaint, Thibaut Munzer, Yoan Mollard, Li Yang Wu and Manuel Lopes. IEEE - International Conference on Robotics and Automation (ICRA), Stockholm, Sweden, 2016. (pdf)

A Comparison of Automatic Teaching Strategies for Heterogeneous Student Populations, Benjamin Clement, Pierre-Yves Oudeyer and Manuel Lopes. Educational Data Mining (EDM) Raleigh, NC, USA, 2016. (pdf)

Inverse Reinforcement Learning in Relational Domains, Thibaut Munzer, Bilal Piot, Mathieu Geist, Olivier Pietquin and Manuel Lopes. International Joint Conference on Artificial Intelligence (IJCAI'15), Buenos Aires, Argentina, 2015. (pdf)

Facilitating Intention Prediction for Humans by Optimizing Robot Motions, Freek Stulp, Jonathan Grizou, Baptiste Busch and Manuel Lopes. IEEE/RSJ Intelligent Robotic Systems (IROS), Hamburg, Germany, 2015. (pdf)

Robot Programming from Demonstration, Feedback and Transfer, Yoan Mollard, Thibaut Munzer, Andrea Baisero, Marc Toussaint and Manuel Lopes. IEEE/RSJ Intelligent Robotic Systems (IROS), Hamburg, Germany, 2015. (pdf)

Temporal Segmentation of Pair-Wise Interaction Phases in Sequential Manipulation Demonstrations, Andrea Baisero, Yoan Mollard, Manuel Lopes, Marc Toussaint and Ingo Lutkebohle. IEEE/RSJ Intelligent Robotic Systems (IROS), Hamburg, Germany, 2015. (DOI: 10.1109/IROS.2015.7353415, web, pdf)

Online Optimization of Teaching Sequences with Multi-Armed Bandits, Benjamin Clement, Didier Roy, Pierre-Yves Oudeyer and Manuel Lopes. 7th International Conference on Educational Data Mining, London, United Kingdom, 2014. (pdf)

Interactive Learning from Unlabeled Instructions, Jonathan Grizou, Inaki Iturrate, Luis Montesano, Pierre-Yves Oudeyer and Manuel Lopes. UAI-30th Conference on Uncertainty in Artificial Intelligence, Quebec, Canada, 2014. (pdf)

Calibration-Free BCI Based Control, Jonathan Grizou, Inaki Iturrate, Luis Montesano, Pierre-Yves Oudeyer and Manuel Lopes. AAAI, Montreal, Canada, 2014. (pdf)

Machine Learning for Interactive Systems: Challenges and Future Trends, Olivier Pietquin and Manuel Lopes. Workshop Affect, Compagnon Artificiel, Interaction, Rouen, France, 2014. (pdf)

Robot Learning Simultaneously a Task and How to Interpret Human Instructions, Jonathan Grizou, Manuel Lopes and Pierre-Yves Oudeyer. ICDL-Epirob, Osaka, Japan, 2013. (pdf)

Learning Multiple Behaviors from Unlabeled Demonstrations in a Latent Controller Space, Javier Almingol, Luis Montesano and Manuel Lopes. International Conference on Machine Learning (ICML), Atlanta, USA, 2013. (pdf)

Active Learning for Teaching a Robot Grounded Relational Symbols, Johannes Kulick, Marc Toussaint, Tobias Lang and Manuel Lopes. International Joint Conference on Artificial Intelligence (IJCAI), Beijing, China, 2013. (pdf)

Learning Exploration Strategies in Model-Based Reinforcement Learning, Todd Hester, Manuel Lopes and Peter Stone. International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Saint Paul, Minnesota, USA, 2013. (pdf)

Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress, Manuel Lopes, Tobias Lang, Marc Toussaint and Pierre-Yves Oudeyer. Neural Information Processing Systems (NIPS), Tahoe, USA, 2012. (pdf)

The Strategic Student Approach for Life-Long Exploration and Learning, Manuel Lopes and Pierre-Yves Oudeyer. IEEE - International Conference on Development and Learning (ICDL), 2012. (pdf)

Algorithmic and Human Teaching of Sequential Decision Tasks, Maya Cakmak and Manuel Lopes. AAAI Conference on Artificial Intelligence (AAAI), Toronto, Canada, 2012. (pdf)

Simultaneous Acquisition of Task and Feedback Models, Manuel Lopes, Thomas Cederborg and Pierre-Yves Oudeyer. IEEE - International Conference on Development and Learning (ICDL), Germany, 2011. (pdf)

Robot Self-Initiative and Personalization by Learning through Repeated Interactions, Martin Mason and Manuel Lopes. 6th ACM/IEEE International Conference on Human-Robot (HRI’11), Lausanne, Switzerland, 2011. (web,pdf)

Learning from Demonstration using MDP Induced Metrics, Francisco Melo and Manuel Lopes. European Conference on Machine Learning (ECML/PKDD), Barcelona, Spain, 2010. (pdf)

Analysis of inverse reinforcement learning with perturbed demonstrations, Francisco Melo, Manuel Lopes and Ricardo Ferreira. European Conference on Artificial Intelligence (ECAI), Lisbon, Portugal, 2010. (pdf)

Body Schema Acquisition through Active Learning, Ruben Martinez-Cantin, Manuel Lopes and Luis Montesano.IEEE - International Conference on Robotics and Automation (ICRA), Anchorage, Alaska, USA, 2010. (pdf)

Active Learning for Reward Estimation in Inverse Reinforcement Learning,Manuel Lopes, Francisco Melo and Luis Montesano. European Conference on Machine Learning (ECML/PKDD), Bled, Slovenia, 2009. (pdf)

From Pixels to Objects: Enabling a spatial model for humanoid social robots, Dario Figueira, Manuel Lopes, Rodrigo Ventura, Jonas Ruesch. IEEE International Conference on Robotics and Automation (ICRA), Kobe, Japan, 2009. (pdf)

Biomimetic Eye-Neck Coordination, Manuel Lopes, Alexandre Bernardino, Jose Santos-Victor, Claes von Hofsten and Kerstin Rosander. IEEE - International Conference on Development and Learning (ICDL), Shanghai, China, 2009. (pdf)

Learning grasping affordances from local visual descriptors,Luis Montesano and Manuel Lopes. IEEE - International Conference on Development and Learning (ICDL), Shanghai, China, 2009. (pdf)(full version)

Fitted natural actor-critic: A new algorithm for continuous state-action MDPs, Francisco S. Melo and Manuel Lopes.European Conference on Machine Learning (ECML/PKDD), Antwerp, Belgium, 2008. (pdf)

Multimodal Saliency-Based Bottom-Up Attention: A Framework for the Humanoid Robot iCub, Jonas Ruesch, Manuel Lopes, Alexandre Bernardino, Jonas Hornstein, Jose Santos-Victor, Rolf Pfeifer. IEEE - International Conference on Robotics and Automation (ICRA), Pasadena, California, USA, 2008. (pdf)

A Learning Framework for Generic Sensory-Motor Maps, Manuel Lopes and Bruno Damas. IEEE Intelligent Robotic Systems (IROS), San Diego, USA, 2007. (DOI: 10.1109/IROS.2007.4399566, web,pdf)

Affordance-based imitation learning in robots, Manuel Lopes, Francisco S. Melo and Luis Montesano. IEEE Intelligent Robotic Systems (IROS), San Diego, USA, 2007. (pdf)

Modeling Object Affordances using Bayesian networks, Luis Montesano, Manuel Lopes, Alexandre Bernardino, Jose Santos-Victor. IEEE Intelligent Robotic Systems (IROS), San Diego, USA, 2007. (pdf

Convergence of independent adaptive learners, Francisco S. Melo, Manuel Lopes. In Progress in Artificial Intelligence: 13th Portuguese Conference on Artificial Intelligence (EPIA), Lecture Notes in Artificial Intelligence, vol. 4874, pp. 555-567, Springer-Verlag, (also available as ISR technical report RT-603-07), 2007. (pdf)

Affordances, development and imitation, Luis Montesano Manuel Lopes Alexandre Bernardino Jose Santos-Victor. IEEE - International Conference on Development and Learning (ICDL), London, UK, July, 2007. (pdf)

Unified framework for imitation-like behaviors, Francisco Melo, Manuel Lopes, Jose Santos-Victor and Maria Isabel Ribeiro. AISB - 4th International Symposium on Imitation in Animals and Artifacts, Newcastle, United Kingdom, April, 2007. (pdf)

Sound localization for humanoid robots - building audio-motor maps based on the HRTF, Jonas Hornstein, Manuel Lopes, Jose Santos-Victor and Francisco Lacerda. IEEE Intelligent Robotic Systems (IROS), Beijing, China, 2006. (pdf)

Learning of Sensory-Motor Maps in Redundant Robots, Manuel Lopes and Jose Santos-Victor. IEEE Intelligent Robotic Systems (IROS), Beijing, China, 2006. (pdf)

Jacobian Learning Methods for Tasks Sequencing in Visual Servoing, Nicolas Mansard, Manuel Lopes, Jose Santos-Victor and Francois Chaummette. IEEE Intelligent Robotic Systems (IROS), Beijing, China, 2006. (DOI: 10.1109/IROS.2006.281958, web, pdf)

Design of the Robot-Cub (iCub) Head, Ricardo Beira, Manuel Lopes, Miguel Praca, Jose Santos-Victor, Alexandre Bernardino, Giorgio Metta, Francesco Becchi and Roque Saltaren. IEEE - International Conference on Robotics and Automation (ICRA), Florida, USA, 2006. (pdf)

A Developmental Roadmap for Task Learning by Imitation in Humanoid Robots, Manuel Lopes and Alexandre Bernardino and Jose Santos-Victor. AISB - Third International Symposium on Imitation in Animals and Artefacts, Hatfield, England, 2005. (full version)

An Anthropomorphic Robot Torso for Imitation: Design and Experiments, Manuel Lopes and Ricardo Beira and Miguel Praca and Jose Santos-Victor. International Conference on Intelligent Robots Systems (IROS), Sendai, Japan, 2004. (pdf)

Motor Representations for Hand Gesture Recognition and Imitation, Manuel Lopes and Jose Santos-Victor. IROS Workshop on Robot Programming by Demonstration, Las Vegas, USA, 2003. (full version)

Visual Transformations in Gesture Imitation, Manuel Lopes and Jose Santos-Victor. IEEE - International Conference on Robotics and Automation (ICRA), Taipei, Taiwan, 2003. (pdf)

Thesis

A developmental Roadmap for Learning by Imitation in Robots, Manuel Lopes, PhD Thesis, Instituto Superior Tecnico, Portugal, 2006. (pdf)


Invited Talks

Online Optimization for Intelligent Tutoring Systems (plenary talk), Manuel Lopes. TICE, Beziers, France, 2014.

Active Learning in Human-Robot Interaction, Manuel Lopes. Robotics: Science and Systems : Workshop on Learning Plans with Context From Human Signals, Berkeley, USA, 2014.

Learning Tasks and Representations from Human-Machine Interactions, Manuel Lopes. ICRA Workshop on Active Visual Learning and Hierarchical Visual Representations for General-Purpose Robot Vision, Hong-Kong, 2014.

Semi-Autonomous 3rd-Hand Robot, Manuel Lopes. ICRA Workshop on Autonomous Grasping and Manipulation: An Open Challenge, Hong-Kong, 2014.

Autonomous Exploration Through Curiosity and Social Guidance, Manuel Lopes. GECCO Workshop: Evo-Devo-Robo: Evolutionary Robotics and Developmental Robotics, Philadelphia, USA, 2012.

Interactive Learning in Social Robots, Manuel Lopes. German-French Workshop Perspectives on Cognitive Interaction and Technology, Bielefeld, Germany, 2012.

Social Learning with Inverse Reinforcement Learning, Manuel Lopes. ICML workshop on New Developments in Imitation Learning, USA, 2011.

Active Exploration in Social Learning, Manuel Lopes. Dagstuhl Seminar: Exploration and Curiosity in Robot Learning and Inference, Dagstuhl, Germany, 2011.

Active Learning for Imitation, Manuel Lopes.Robotics: Science and Systems (R:SS) Workshop: Towards Closing the Loop: Active Learning for Robotics, Zaragoza, Spain, 2010.

Learning and Development, Manuel Lopes.IROS Workshop: Robotics Challenges for Machine Learning II, Nice, France, 2008.

A computational model of Social learning behaviours. Manuel Lopes, IROS Workshop: From motor to interaction learning in robots, Nice, France, 2008.

Workshops

Collaboration in Ad Hoc Teamwork: Ambiguous Tasks, Roles, and Communication, Jonathan Grizou, Samuel Barrett, Peter Stone and Manuel Lopes. AAMAS Workshop: Adaptive Learning Agents (ALA) Singapore, 2016. (pdf)

Semi-Autonomous 3rd-Hand Robot, Manuel Lopes, Jan Peters, Justus Piater, Marc Toussaint, Andrea Baisero, Baptiste Busch, Ozgur Erkent, Olivier Kroemer, Rudolf Lioutikov, Guilherme Maeda, Yoan Mollard, Thibaut Munzer and Dadhichi Shukla. Workshop on Cognitive Robotics in Future Manufacturing Scenarios, European Robotics Forum, Vienna, Austria, 2015. (pdf)

Zero-calibration BMIs for sequential tasks using error-related potentials, Jonathan Grizou, Inaki Iturrate, Luis Montesano, Manuel Lopes and Pierre-Yves Oudeyer. IROS Workshop on Neuroscience and RoboticsTokyo, Japan, 2013. (pdf)

Interactive Task Estimation From Unlabelled Teaching Signals, Jonathan Grizou, Inaki Iturrate, Luis Montesano, Manuel Lopes and Pierre-Yves Oudeyer. International Workshop on Human-Machine Systems, Cyborgs and Enhancing Devices Manchester, UK, 2013. (pdf)

Simultaneous Acquisition of Task and Feedback Models, Manuel Lopes, Thomas Cederborg and Pierre-Yves Oudeyer. IJCAI 2011 Workshop on Agents Learning Interactively from Human Teachers (ALIHT), Barcelona, Spain, 2011. (see ICDL11 paper for the extended version pdf)

Robot Self-Initiative and Personalization by Learning through Repeated Interactions, Martin Mason and Manuel Lopes. Robotics: Science and Systems (R:SS) Workshop: Learning for Human-Robot Interaction Modeling, Zaragoza , Spain, 2010.

Robotic Open-Architecture Technology for cognition, Understanding, and Behaviours, G. Metta, L. Natale, F. Nori, U. Pattacini, G. Sandini, D. Vernon, J. Santos-Victor, A. Bernardino, M. Lopes and L. Montesano. CogSys, Zurick, Switzerland, 2010. (pdf)

Active Learning for Reward Estimation in Inverse Reinforcement Learning, Manuel Lopes, Francisco Melo and Luis Montesano.Robotics: Science and Systems (R:SS) Workshop: Bridging the gap between high-level discrete representations and low-level continuous behaviors, Seattle, USA, 2009

Active learning for constrained regression using kernel beta regression models, Luis Montesano and Manuel Lopes.Robotics: Science and Systems (R:SS)/PASCAL2 Workshop Regression in Robotics - Approaches and Applications, Seattle, USA, 2009 (PASCAL Poster Competition, runner-up prize)

Active body schema learning, Ruben Martinez-Cantin, Manuel Lopes and Luis Montesano. Robotics: Science and Systems (R:SS)/PASCAL2 Workshop Regression in Robotics - Approaches and Applications, Seattle, USA, 2009

Machine Learning for Developmental Robotics, Manuel Lopes, Luis Montesano and Francisco Melo.NIPS Workshop: Robotics Challenges for Machine Learning, Vancouver, Canada, 2007. (poster pdf)

A Developmental Roadmap for Learning by Imitation in Robots, Manuel Lopes and Jose Santos-Victor. Cogsys, 2006. (abstract pdf, poster pdf)

A Developmental Roadmap for Learning by Imitation in Robots, Manuel Lopes and Jose Santos-Victor. Brain Development,2005. (abstract pdf, poster pdf)

Others

Real-time Framework for Gesture Imitation in Humanoid Robots. Ricardo Marranita, Manuel Lopes, Alexandre Bernardino and Jose Santos-Victor. Festival Nacional de Robotica, Portugal, 2006.

Sistema de Instrumentacao Virtual para Caracterizacao de uma Valvula Industrial, Sergio Barbosa and Manuel Lopes. Jornadas Politecnicas de Engenharia, Coimbra, Portugal, 2003.

ISocRob 2001 Team Description, Pedro Lima, Luis Custodio, Bruno Damas, Manuel Lopes, Carlos Marques and Luis Toscano. Instituto de Sistemas e Robotica, 2001.

Reinforcement Learning of Robotic Tasks
. Manuel Lopes. 2000. (in portuguese)