Francois Helenon
ABSTRACT
This paper introduces a cognitive architecture, implemented in python3, designed with industrial collaborative robotics specifications in mind, to engage in a mixed-initiative teacher/learner setting called interactive task learning: a human can teach the robot, with natural and multimodal communication means, how to perform a task. The architecture has been built around explainable, modular representations (relational graphs and behavior trees) to ease the upgradability of the system and AI modules to adapt to realistic and complex settings. A first prototype based on speech and gesture communication means is proposed and has been validated on an industrial system to learn an unknown task. A link to a video of this validation is attached in the article.
- Sandeep Ahluwalia. 2004. Hierarchical State Machines. In The Firmware Handbook. DOI:https://doi.org/10.1016/B978-075067606-9/50012-6Google Scholar
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, 2019. FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP. In Proceedings of the 2019 Conference of the North, Association for Computational Linguistics, Stroudsburg, PA, USA, 54–59. DOI:https://doi.org/10.18653/v1/N19-4010Google ScholarCross Ref
- John R. Anderson, Daniel Bothell, Michael D. Byrne, Scott Douglass, Christian Lebiere, 2004. An integrated theory of the mind. Psychological Review. DOI:https://doi.org/10.1037/0033-295X.111.4.1036Google Scholar
- Michael Beetz, Daniel Bessler, Andrei Haidu, Mihai Pomarlan, Asil Kaan Bozcuoglu, 2018. Know Rob 2.0 - A 2nd Generation Knowledge Processing Framework for Cognition-Enabled Robotic Agents. In Proceedings - IEEE International Conference on Robotics and Automation. DOI:https://doi.org/10.1109/ICRA.2018.8460964Google ScholarCross Ref
- Michael Beetz, Lorenz Mösenlechner, and Moritz Tenorth. 2010. CRAM - A Cognitive Robot Abstract Machine for everyday manipulation in human environments. In IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings. DOI:https://doi.org/10.1109/IROS.2010.5650146Google ScholarCross Ref
- Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. (December 2018). Retrieved September 10, 2019 from http://arxiv.org/abs/1812.08008Google Scholar
- Joyce Y. Chai, Qiaozi Gao, Lanbo She, Shaohua Yang, Sari Saba-Sadiya, 2018. Language to action: Towards interactive task learning with physical agents. In IJCAI International Joint Conference on Artificial Intelligence. DOI:https://doi.org/10.24963/ijcai.2018/1 Google ScholarDigital Library
- Michele Colledanchise. 2018. Behavior Trees in Robotics and Al. DOI:https://doi.org/10.1201/9780429489105 Google ScholarDigital Library
- Michael a Covington, Donald Nute, and André Vellino. 1995. Prolog programming in depth. Knowl. Creat. Diffus. Util. (1995). Google ScholarDigital Library
- Kutluhan Erol, James Hendler, and Dana S. Nau. 1994. HTN planning: Complexity and expressivity. In Proceedings of the National Conference on Artificial Intelligence. Google ScholarDigital Library
- Kevin French, Shiyu Wu, Tianyang Pan, Zheming Zhou, and Odest Chadwicke Jenkins. 2019. Learning behavior trees from demonstration. In Proceedings - IEEE International Conference on Robotics and Automation, Institute of Electrical and Electronics Engineers Inc., 7791–7797. DOI:https://doi.org/10.1109/ICRA.2019.8794104Google ScholarCross Ref
- Kelleher R Guerin, Colin Lea, Chris Paxton, and Gregory D Hager. A Framework for End-User Instruction of a Robot Assistant for Manufacturing.Google Scholar
- Francois Helenon, Laurent Bimont, Eric Nyiri, Stephane Thiery, and Olivier Gibaru. 2020. Learning prohibited and authorised grasping locations from a few demonstrations. In29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020. DOI:https://doi.org/10.1109/RO-MAN47096.2020.9223486Google ScholarCross Ref
- Francois Felix Ingrand, Raja Chatila, Rachid Alami, and Frederic Robert. 1996. PRS: a high level supervision and control language for autonomous mobile robots. In Proceedings - IEEE International Conference on Robotics and Automation. DOI:https://doi.org/10.1109/robot.1996.503571Google ScholarCross Ref
- Iuliia Kotseruba and John K. Tsotsos. 2020. 40 years of cognitive architectures: core cognitive abilities and practical applications. Artif. Intell. Rev.53, 1 (July 2020), 17–94. DOI:https://doi.org/10.1007/s10462-018-9646-yGoogle ScholarCross Ref
- Unmesh Kurup and Christian Lebiere. 2012. What can cognitive architectures do for robotics? Biol. Inspired Cogn. Archit.2, (October 2012), 88–99. DOI:https://doi.org/10.1016/j.bica.2012.07.004Google Scholar
- John E. Laird, Kevin Gluck, John Anderson, Kenneth D. Forbus, Odest Chadwicke Jenkins, 2017. Interactive Task Learning. IEEE Intell. Syst.32, 4 (2017), 6–21. DOI:https://doi.org/10.1109/MIS.2017.3121552Google ScholarDigital Library
- Christian Lebiere. 2019. Act-R. In Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society. DOI:https://doi.org/10.4324/9781315782379-4Google Scholar
- R.L. Lewis. 2001. Cognitive Theory: SOAR. In International Encyclopedia of the Social & Behavioral Sciences. DOI:https://doi.org/10.1016/b0-08-043076-7/01583-7Google Scholar
- Natalia Lyubova. 2013. Developmental approach of perception for a humanoid robot. (2013), 170. Retrieved from https://tel.archives-ouvertes.fr/tel-00925067v1Google Scholar
- Pooja Makula, Anurag Mishra, Akshay Kumar, Krit Karan, and V. K. Mittal. 2016. Multimodal smart robotic assistant. In Proceedings of 2015 International Conference on Signal Processing, Computing and Control, ISPCC 2015, Institute of Electrical and Electronics Engineers Inc., 18–23. DOI:https://doi.org/10.1109/ISPCC.2015.7374991Google Scholar
- Gines Hidalgo Martinez, Yaadhav Raaj, Haroon Idrees, Donglai Xiang, Hanbyul Joo, 2019. Single-network whole-body pose estimation. In Proceedings of the IEEE International Conference on Computer Vision. DOI:https://doi.org/10.1109/ICCV.2019.00708Google ScholarCross Ref
- Shiwali Mohan. 2015. From Verbs to Tasks: An Integrated Account of Learning Tasks from Situated Interactive Instruction. ProQuest Diss. Theses (2015).Google Scholar
- Anahita Mohseni-Kabir, Sonia Chernova, and Charles Rich. 2014. Collaborative learning of hierarchical task networks from demonstration and instruction. In AAAI Fall Symposium - Technical Report.Google Scholar
- Anahita Mohseni-Kabir, Changshuo Li, Victoria Wu, Daniel Miller, Benjamin Hylak, 2019. Simultaneous learning of hierarchy and primitives for complex robot tasks. Auton. Robots (2019). DOI:https://doi.org/10.1007/s10514-018-9749-y Google ScholarDigital Library
- Clement Moulin-Frier, Tobias Fischer, Maxime Petit, Gregoire Pointeau, Jordi Ysard Puigbo, 2018. DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge about the World and the Self. IEEE Trans. Cogn. Dev. Syst. (2018). DOI:https://doi.org/10.1109/TCDS.2017.2754143Google Scholar
- Chris Paxton, Andrew Hundt, Felix Jonathan, Kelleher Guerin, and Gregory D. Hager. 2017. CoSTAR: Instructing collaborative robots with behavior trees and vision. In Proceedings - IEEE International Conference on Robotics and Automation. DOI:https://doi.org/10.1109/ICRA.2017.7989070Google Scholar
- Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, 2009. ROS: an open-source Robot Operating System. In ICRA workshop on open source software.Google Scholar
- Ronald A. Rensink. 2000. Seeing, sensing, and scrutinizing. In Vision Research. DOI:https://doi.org/10.1016/S0042-6989(00)00003-1Google Scholar
- Charles Rich, Candace L. Sidner, and Neal Lesh. 2001. COLLAGEN: Applying collaborative discourse theory to human-computer interaction. AI Mag. (2001). Google ScholarDigital Library
- Francesco Rovida, Bjarne Grossmann, and Volker Kruger. 2017. Extended behavior trees for quick definition of flexible robotic tasks. In IEEE International Conference on Intelligent Robots and Systems. DOI:https://doi.org/10.1109/IROS.2017.8206598Google ScholarCross Ref
- Paul E. Rybski, Kevin Yoon, Jeremy Stolarz, and Manuela M. Veloso. 2007. Interactive robot task training through dialog and demonstration. In HRI 2007 - Proceedings of the 2007 ACM/IEEE Conference on Human-Robot Interaction - Robot as Team Member. DOI:https://doi.org/10.1145/1228716.1228724 Google ScholarDigital Library
- Moritz Tenorth and Michael Beetz. 2013. KnowRob: A knowledge processing infrastructure for cognition-enabled robots. Int. J. Rob. Res. (2013). DOI:https://doi.org/10.1177/0278364913481635 Google ScholarDigital Library
Index Terms
- Cognitive architecture for intuitive and interactive task learning in industrial collaborative robotics
Index terms have been assigned to the content through auto-classification.
Recommendations
Cognitive Learning Methodologies for Brain-Inspired Cognitive Robotics
Cognitive robots are brain-inspired robots that are capable of inference, perception, and learning mimicking the cognitive mechanisms of the brain. Cognitive learning theories and methodologies for knowledge and behavior acquisition are centric in ...
Embodied Cognitive Robotics and the learning of sensorimotor schemes
Embodied Cognitive Robotics focuses its attention on the design of artificial agents capable of performing cognitive tasks autonomously. A central issue in this consists in studying process by which agents learn through interaction with their ...
Learning Task Grouping using Supervised Task Space Partitioning in Lifelong Multitask Learning
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementLifelong multitask learning is a multitask learning framework in which a learning agent faces the tasks that need to be learnt in an online manner. Lifelong multitask learning framework may be applied to a variety of applications such as image ...
Comments