skip to main content
10.1145/3125739.3125756acmconferencesArticle/Chapter ViewAbstractPublication PageshaiConference Proceedingsconference-collections
research-article

The Impact of Personalisation on Human-Robot Interaction in Learning Scenarios

Authors Info & Claims
Published:27 October 2017Publication History

ABSTRACT

Advancements in Human-Robot Interaction involve robots being more responsive and adaptive to the human user they are interacting with. For example, robots model a personalised dialogue with humans, adapting the conversation to accommodate the user's preferences in order to allow natural interactions. This study investigates the impact of such personalised interaction capabilities of a human companion robot on its social acceptance, perceived intelligence and likeability in a human-robot interaction scenario. In order to measure this impact, the study makes use of an object learning scenario where the user teaches different objects to the robot using natural language. An interaction module is built on top of the learning scenario which engages the user in a personalised conversation before teaching the robot to recognise different objects. The two systems, i.e. with and without the interaction module, are compared with respect to how different users rate the robot on its intelligence and sociability. Although the system equipped with personalised interaction capabilities is rated lower on social acceptance, it is perceived as more intelligent and likeable by the users.

References

  1. Timo Ahonen, Abdenour Hadid, and Matti Pietikäinen. 2004. Face Recognition with Local Binary Patterns. In European Conference on Computer Vision (ECCV) (LNCS), Vol. 3021. Springer, Berlin, Heidelberg, Prague, Czech Republic, 469--481. Google ScholarGoogle ScholarCross RefCross Ref
  2. I. Elaine Allen and Christopher A. Seaman. 2007. Likert Scales and Data Analyses. Quality Progress 40, 7 (2007), 64--65.Google ScholarGoogle Scholar
  3. Pablo Barros, German I. Parisi, Cornelius Weber, and Stefan Wermter. 2017. Emotion-Modulated Attention Improves Expression Recognition:A Deep Learning Model. Neurocomputing 253 (2017), 104--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Pablo Barros and Stefan Wermter. 2016. Developing Crossmodal Expression Recognition Based on a Deep Neural Model. Adaptive Behavior 24, 5 (2016), 373--396. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Christoph Bartneck, Dana Kuli´c, Elizabeth Croft, and Susana Zoghbi. 2008. Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots. International Journal of Social Robotics 1, 1 (2008), 71--81. Google ScholarGoogle ScholarCross RefCross Ref
  6. Peter N. Belhumeur, Joao P. Hespanha, and David J. Kriegman. 1997. Eigenfaces Vs. Fisherfaces:Recognition Using Class Specific Linear Projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7 (1997), 711--720. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jean-David Boucher, Ugo Pattacini, Amelie Lelong, Gerard Bailly, Frederic Elisei, Sascha Fagel, Peter F. Dominey, and Jocelyne Ventre-Dominey. 2012. I Reach Faster When I See You Look:Gaze Effects in Human--Human and Human--Robot Face-to-Face Cooperation. Frontiers in Neurorobotics 6, 3 (2012). Google ScholarGoogle ScholarCross RefCross Ref
  8. Cynthia Lynn Breazeal. 2000. Sociable Machines:Expressive Social Exchange Between Humans and Robots. Dissertation. Massachusetts Institute of Technology.Google ScholarGoogle Scholar
  9. Rodney A. Brooks, Cynthia Breazeal, Matthew Marjanovi´c, Brian Scassellati, and Matthew M. Williamson. 1999. The Cog Project:Building a Humanoid Robot. In Computation for Metaphors, Analogy, and Agents. Number 1562 in LNCS. Springer Berlin Heidelberg, 52--87.Google ScholarGoogle Scholar
  10. James Dean Brown. 2011. Likert Items and Scales of Measurement? Shiken:JALT Testing & Evaluation SIG Newsletter 15, 1 (2011), 10--14.Google ScholarGoogle Scholar
  11. Allison Bruce, Illah Nourbakhsh, and Reid Simmons. 2002. The Role of Expressiveness and Attention in Human-Robot Interaction. In IEEE International Conference on Robotics and Automation (ICRA), Vol. 4. IEEE, Washington, DC, USA, 4138--4142. Google ScholarGoogle ScholarCross RefCross Ref
  12. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research 12, Aug (2011), 2493--2537.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. James Curran. 2017. Hotelling:Hotelling's T∧2 Test and Variants. (2017). https://cran.r-project.org/web/packages/Hotelling/index.htmlGoogle ScholarGoogle Scholar
  14. Kerstin Dautenhahn. 1995. Getting to know each other -- Artificial social intelligence for autonomous robots. Robotics and Autonomous Systems 16, 2 (1995), 333 -- 356. Moving the Frontiers between Robotics and Biology. Google ScholarGoogle ScholarCross RefCross Ref
  15. Sander Dieleman and Benjamin Schrauwen. 2014. End-to-End Learning for Music Audio. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, Florence, Italy, 6964--6968. Google ScholarGoogle ScholarCross RefCross Ref
  16. Bruce Frederiksen. 2008. Applying expert system technology to code reuse with Pyke. PyCon:Chicago (2008).Google ScholarGoogle Scholar
  17. Manuel Giuliani, Ronald P.A. Petrick, Mary Ellen Foster, Andre Gaschler, Amy Isard, Maria Pateraki, and Markos Sigalas. 2013. Comparing Task-Based and Socially Intelligent Behaviour in a Robot Bartender. In ACM on International Conference on Multimodal Interaction (ICMI '13). ACM, Sydney, Australia, 263--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Xavier Hinaut, Johannes Twiefel, Marcelo Borghetti Soares, Pablo Barros, Luiza Mici, and Stefan Wermter. 2015. Humanoidly speaking--Learning about the world and language with a humanoid friendly robot. International Joint Conference on Artificial Intelligence Video competition (2015).Google ScholarGoogle Scholar
  19. Ulf Jakobsson. 2004. Statistical Presentation and Analysis of Ordinal Data in Nursing Research. Scandinavian Journal of Caring Sciences 18, 4 (2004), 437--440. Google ScholarGoogle ScholarCross RefCross Ref
  20. Susan Jamieson. 2004. Likert Scales:How to (Ab)Use Them. Medical Education 38, 12 (2004), 1217--1218. Google ScholarGoogle ScholarCross RefCross Ref
  21. Frédéric Kaplan. 2004. Who is afraid of the Humanoid? Investigating cultural differences in the acceptance of robots. International Journal of Humanoid Robotics 01, 03 (2004), 465--480. Google ScholarGoogle ScholarCross RefCross Ref
  22. Matthias Kerzel, Erik Strahl, Sven Magg, Nicolás Navarro-Guerrero, Stefan Heinrich, and Stefan Wermter. 2017. NICO -- Neuro-Inspired COmpanion:A Developmental Humanoid Robot Platform for Multimodal Interaction. In IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, Lisbon, Portugal. In Press.Google ScholarGoogle Scholar
  23. Rachel Kirby, Jodi Forlizzi, and Reid Simmons. 2010. Affective social robots. Robotics and Autonomous Systems 58, 3 (2010), 322 -- 332. Towards Autonomous Robotic Systems 2009:Intelligent, Autonomous Robotics in the UK.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Min Kyung Lee, Jodi Forlizzi, Sara Kiesler, Paul Rybski, John Antanitis, and Sarun Savetsila. 2012. Personalization in HRI:A field experiment. In 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 319--326.Google ScholarGoogle Scholar
  25. Rensis Likert. 1932. A Technique for the Measurement of Attitudes. Archives of Psychology 22 (1932), 55.Google ScholarGoogle Scholar
  26. Wenyong Lin. 2015. An Improved GMM-Based Clustering Algorithm for Efficient Speaker Identification. In International Conference on Computer Science and Network Technology (ICCSNT), Vol. 1. IEEE, Harbin, China, 1490--1493.Google ScholarGoogle Scholar
  27. Edward Loper and Steven Bird. 2002. NLTK:The Natural Language Toolkit. In Proceedings of the ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics - Volume 1 (ETMTNLP '02). Association for Computational Linguistics, Stroudsburg, PA, USA, 63--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Patrick Lucey, Jeffrey F. Cohn, Takeo Kanade, Jason Saragih, Zara Ambadar, and Iain Matthews. 2010. The Extended Cohn-Kanade Dataset (CK+):A Complete Dataset for Action Unit and Emotion-Specified Expression. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops. IEEE, San Francisco, CA USA, 94--101.Google ScholarGoogle ScholarCross RefCross Ref
  29. Yanick Lukic, Carlo Vogt, Oliver Dürr, and Thilo Stadelmann. 2016. Speaker Identification and Clustering Using Convolutional Neural Networks. In IEEE International Workshop on Machine Learning for Signal Processing (MLSP). IEEE, Salerno, Italy, 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  30. Seiichi Nakagawa, Longbiao Wang, and Shinji Ohtsuka. 2012. Speaker Identification and Verification by Combining MFCC and Phase Information. IEEE Transactions on Audio, Speech, and Language Processing 20, 4 (2012), 1085--1095. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Hwei Geok Ng, Paul Anton, Marc Brügger, Nikhil Churamani, Erik Fließwasser, Thomas Hummel, Julius Mayer, Waleed Mustafa, Thi Linh Chi Nguyen, Quan Nguyen, Marcus Soll, Sebastian Springenberg, Sascha Griffiths, Stefan Heinrich, Nicolás Navarro-Guerrero, Erik Strahl, Johannes Twiefel, Cornelius Weber, and Stefan Wermter. 2017. Hey Robot, Why Don't You Talk to Me?. In IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, Lisbon, Portugal. In Press.Google ScholarGoogle ScholarCross RefCross Ref
  32. Kathrin Pollmann. 2014. Does the Human-Like Behavior of a Robot Evoke Action Co-Representation in a Human Co-Actor? MSc Thesis. Technische Universiteit Eindhoven, Eindhoven, The Netherlands.Google ScholarGoogle Scholar
  33. Ehud Reiter and Robert Dale. 1997. Building Applied Natural Language Generation Systems. Natural Language Engineering 3, 1 (1997), 57--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Joe Saunders, Dag Sverre Syrdal, Kheng Lee Koay, Nathan Burke, and Kerstin Dautenhahn. 2016. 'Teach Me - Show Me' End-User Personalization of a Smart Home and Companion Robot. IEEE Transactions on Human-Machine Systems 46, 1 (Feb 2016), 27--40. Google ScholarGoogle ScholarCross RefCross Ref
  35. Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. FaceNet:A Unified Embedding for Face Recognition and Clustering. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Boston, MA, USA, 815--823.Google ScholarGoogle Scholar
  36. Seija Sirkia, Jari Miettinen, Klaus Nordhausen, Hannu Oja, and Sara Taskinen. 2013. SpatialNP:Multivariate Nonparametric Methods Based on Spatial Signs and Ranks. (2013). https://cran.r-project.org/web/packages/SpatialNP/index.htmlGoogle ScholarGoogle Scholar
  37. Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 Shared Task:Language-Independent Named Entity Recognition. In Conference on Natural Language Learning at HLT-NAACL (CONLL '03), Vol. 4. Association for Computational Linguistics, Edmonton, Alberta, Canada, 142--147.Google ScholarGoogle Scholar
  38. Johannes Twiefel, Timo Baumann, Stefan Heinrich, and Stefan Wermter. 2014. Improving Domain-Independent Cloud-Based Speech Recognition with Domain-Dependent Phonetic Post-Processing. In AAAI Conference on Artificial Intelligence, Vol. Twenty-Eighth. AAAI Press, Québec City, Québec, Canada, 1529--1535.Google ScholarGoogle Scholar
  39. Johannes Twiefel, Xavier Hinaut, Marcelo Borghetti, Erik Strahl, and Stefan Wermter. 2016. Using Natural Language Feedback in a Neuro-Inspired Integrated Multimodal Robotic Architecture. In IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, New York, NY, USA, 52--57. Google ScholarGoogle ScholarCross RefCross Ref
  40. Kees van Deemter, Mariët Theune, and Emiel Krahmer. 2005. Real Versus Template-Based Natural Language Generation:A False Opposition? Computational Linguistics 31, 1 (2005), 15--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Viswanath Venkatesh, Michael G. Morris, Gordon B. Davis, and Fred D. Davis. 2003. User Acceptance of Information Technology:Toward a Unified View. MIS Quarterly 27, 3 (2003), 425--478.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Paul Viola and Michael Jones. 2001. Rapid Object Detection Using a Boosted Cascade of Simple Features. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 1. IEEE, Kauai, Hawaii, USA, 511--518. Google ScholarGoogle ScholarCross RefCross Ref
  43. Dorothy Watson. 1992. Correcting for Acquiescent Response Bias in the Absence of a Balanced Scale:An Application to Class Consciousness. Sociological Methods & Research 21, 1 (1992), 52--88. Google ScholarGoogle ScholarCross RefCross Ref
  44. Xiaojia Zhao and DeLiang Wang. 2013. Analyzing Noise Robustness of MFCC and GFCC Features in Speaker Identification. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, Vancouver, BC, Canada, 7204--7208. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. The Impact of Personalisation on Human-Robot Interaction in Learning Scenarios

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader