research-article

Do you remember that shop?: computational model of spatial memory for shopping companion robots

Authors:

Takahiro Matsumoto,

Takayuki Kanda,

Norihiro HagitaAuthors Info & Claims

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

Pages 447 - 454

https://doi.org/10.1145/2157689.2157836

Published: 05 March 2012 Publication History

Abstract

We aim to develop a shopping companion robot that can share experience with users. In this study, we focused on the shared memory acquired when a robot walks together with a user. We developed a computational model of memory recall of visited locations in a shopping mall. The model was developed with data collection from 30 participants. We found that shop size, color intensity of facade, relative visibility, and time elapsed are the influencing features for recall. The model was used in a scenario of a shopping companion robot. The robot, Robovie, autonomously follows a user while inferring the user's memory recall of shops in the visited route. When the user asks the location of other shops, Robovie replied with destination description, referring to the known locations inferred with the model of the user's memory recall. With this scenario, we verified the effectiveness of the developed computational model of memory recall. The evaluation experiment revealed that the model outputs shops that the participants are likely to recall, and makes the directions given easier to understand.

Supplementary Material

JPG File (hri136.jpg)

Download
20.50 KB

MP4 File (hri136.mp4)

Download
23.54 MB

References

[1]

Berlin, M., Gray, J., Thomaz, A. L. and Breazeal, C., 2006, Perspective Taking: An Organizing Principle for Learning in Human-Robot Interaction, National Conf. on Artificial Intelligence (AAAI2006), pp. 1444--1450.

Digital Library

[2]

Besl, P. and McKay, N., 1992, A method for Registration of 3-D Shapes, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, pp. 239--256.

Digital Library

[3]

Bickmore, T. W., Caruso, L., Clough-Gorr, K. and Heeren, T., 2005, 'It's just like you talk to a friend' relational agents for older adults, Interacting with Computers, vol. 17, pp. 711--735.

Digital Library

[4]

D. Fox, W. B., and S. Thrun, 1999, Markov localization for mobile robots in dynamic environments, Journal of Artificial Intelligence Research, vol. 11, pp. 391--427.

[5]

Daniel, M.-P., Tom, A., Manghi, E. and Denis, M., 2003, Testing the Value of Route Directions Through Navigational Performance, Spatial Cognition & Computation, vol. 3, pp. 269--289.

[6]

Dethlefs, N., Wu, Y., Kazerani, A. and Winter, S., 2011, Generation of Adaptive Route Descriptions in Urban Environments Spatial Cognition & Computation: An Interdisciplinary Journal vol. 11, pp. 153--177.

[7]

Draper, N. R. and Smith, H. Applied Regression Analysis, Wiley-Interscience, Hoboken, New Jersey, pp. 307--312, 1998.

[8]

Fox, D., Burgard, W. and Thrun, S., 1997, The Dynamic Window Approach to Collision Avoidance, IEEE Robotics & Automation Magazine, vol. 4, pp. 23--33.

Digital Library

[9]

Friedman, W. J., 1993, Memory for the time of past events, Psychological bulletin, vol. 113, pp. 44--66.

[10]

Garling, T. and Evans, G. W., 1991, Environment, Cognition, and Action: An Integrated Approach, New York : Oxford University Press.

[11]

Gockley, R., Bruce, A., Forlizzi, J., Michalowski, M., Mundell, A., Rosenthal, S., Sellner, B., Simmons, R., Snipes, K., Schultz, A. C. and Wang, J., 2005, Designing Robots for Long-Term Social Interaction, IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS2005), pp. 1338--1343.

[12]

Gross, H.-M., Boehme, H., Schroeter, C., Mueller, S., Koenig, A., Einhorn, E., Martin, C., Merten, M. and Bley, A., 2009, TOOMAS: Interactive Shopping Guide Robots in Everyday Use - Final Implementation and Experiences from Long-term Field Trials, IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS2009), pp. 2005--2012.

Digital Library

[13]

Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H. and Hagita, N., 2010, A Communication Robot in a Shopping Mall, IEEE Transactions on Robotics, vol. 26, pp. 897--913.

Digital Library

[14]

Kiesler, S., 2005, Fostering Common Ground in Human-Robot Interaction, IEEE Int. Workshop on Robot and Human Interactive Communication (RO-MAN2005), pp. 729--734.

[15]

Koriat, A., Goldsmith, M. and Pansky, A., 2000, Toward a psychology of memory accuracy, Annual Review of Psychology, vol. 51, pp. 481--537.

[16]

Mackworth, J. F., 1962, The visual image and the memory trace, Canadian Journal of Psychology, vol. 16, pp. 55--59.

[17]

Morales, Y., Satake, S., Kanda, T. and Hagita, N., 2011, Modeling Environments from a Route Perspective, 6th ACM/IEEE International Conference on Human Robot Interaction,

Digital Library

[18]

Nothegger, C., Winter, S. and Raubal, M., 2004, Selection of Salient Features for Route Directions, Spatial Cognition & Computation, vol. 4, pp. 113--136.

[19]

Okuno, Y., Kanda, T., Imai, M., Ishiguro, H. and Hagita, N., 2009, Providing Route Directions: Design of Robot's Utterance, Gesture, and Timing, ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI2009), pp. 53--60.

Digital Library

[20]

Rosenthal, S., Biswas, J. and Veloso, M., 2010, An effective personal mobile robot agent through symbiotic human-robot interaction, International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), pp. 915--922.

Digital Library

[21]

Scassellati, B., 2002, Theory of Mind for a Humanoid Robot, Autonomous Robots, vol. 12, pp. 13--24.

Digital Library

[22]

Schroder, C. J., Mackaness, W. A. and Gittings, B. M., 2011, Giving the 'Right' Route Directions: The Requirements for Pedestrian Navigation Systems, Transaction in GIS, vol. 15, pp. 419--438.

[23]

Sidner, C. L., Lee, C. and Lesh, N., 2003, Engagement By Looking: Behaviors for Robots When Collaborating with People, ed.

[24]

Thrun, S., Burgard, W. and Fox, D., 2005, Probabilistic Robotics (Intelligent Robotics and Autonomous Agents), The MIT Press.

Digital Library

[25]

Torrey, C., Powers, A., Marge, M., Fussell, S. R. and Kiesler, S., 2006, Effects of Adaptive Robot Dialogue on Information Exchange and Social Relations, ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI2006), pp. 126--133.

Digital Library

[26]

Trafton, J. G., Cassimatis, N. L., Bugajska, M. D., Brock, D. P., Mintz, F. E. and Schultz, A. C., 2005, Enabling Effective Human--Robot Interaction Using Perspective-Taking in Robots, IEEE Trans. on Systems, Man, and Cybernetics. Part A: Systems and Humans, vol. 35, pp. 460--470.

Digital Library

[27]

Turner, A. and Penn, A., 2007, Evolving Direct Perception Models of Human Behavior in Building Systems?, Pedestrian and Evacuation Dynamics 2005, pp. 411--422.

[28]

Tversky, B., 1993, Cognitive maps, cognitive collages, and spatial mental models, Spatial Information Theory A Theoretical Basis for GIS, pp. 14--24.

Cited By

Tuyen NOkazaki SCeliktutan O(2023)A Study on Customer’s Perception of Robot Nonverbal Communication Skills in a Service Environment2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309634(301-306)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309634
Yamazaki AKrummheuer AImai MSakamoto DWeiss AHiatt LShiomi M(2022)Interdisciplinary Explorations of Processes of Mutual Understanding in Interaction with Assistive Shopping RobotsProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3524008(1293-1295)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3524008
Ligthart MNeerincx MHindriks KSakamoto DWeiss AHiatt LShiomi M(2022)Memory-Based Personalization for Fostering a Long-Term Child-Robot RelationshipProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523775(80-89)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523775
Show More Cited By

Index Terms

Do you remember that shop?: computational model of spatial memory for shopping companion robots
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

A communication robot in a shopping mall

This paper reports our development of a communication robot for use in a shopping mall to provide shopping information, offer route guidance, and build rapport. In the development, the major difficulties included sensing human behaviors, conversation in ...
Human-Centered Robot Navigation—Towards a Harmoniously Human–Robot Coexisting Environment

This paper proposes a navigation algorithm that considers the states of humans and robots in order to achieve harmonious coexistence between them. A robot navigation in the presence of humans and other robots is rarely considered in the field of ...
A Stochastic Map Building Method for Mobile Robot using 2-D Laser Range Finder

This paper presents a stochastic map building method for mobile robot using a 2-D laser range finder. Unlike other methods that are based on a set of geometric primitives, the presented method builds a map with a set of obstacle regions. In building a map ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

March 2012

518 pages

ISBN:9781450310635

DOI:10.1145/2157689

General Chairs:
Holly Yanco
University of Massachusetts Lowell, USA
,
Aaron Steinfeld
Carnegie Mellon University, USA
,
Program Chairs:
Vanessa Evers
University of Amsterdam, The Netherlands
,
Odest Chadwicke Jenkins
Brown University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI'12

Sponsor:

HRI'12: International Conference on Human-Robot Interaction

March 5 - 8, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
392
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)6

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tuyen NOkazaki SCeliktutan O(2023)A Study on Customer’s Perception of Robot Nonverbal Communication Skills in a Service Environment2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309634(301-306)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309634
Yamazaki AKrummheuer AImai MSakamoto DWeiss AHiatt LShiomi M(2022)Interdisciplinary Explorations of Processes of Mutual Understanding in Interaction with Assistive Shopping RobotsProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3524008(1293-1295)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3524008
Ligthart MNeerincx MHindriks KSakamoto DWeiss AHiatt LShiomi M(2022)Memory-Based Personalization for Fostering a Long-Term Child-Robot RelationshipProceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3523760.3523775(80-89)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.5555/3523760.3523775
Ligthart MNeerincx MHindriks K(2022)Memory-Based Personalization for Fostering a Long-Term Child-Robot Relationship2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889446(80-89)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889446
Yamazaki AKrummheuer AImai M(2022)Interdisciplinary Explorations of Processes of Mutual Understanding in Interaction with Assistive Shopping Robots2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889352(1293-1295)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889352
Mahdi HAkgun SSaleh SDautenhahn K(2022)A survey on the design and evolution of social robots — Past, present and futureRobotics and Autonomous Systems10.1016/j.robot.2022.104193156:COnline publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1016/j.robot.2022.104193
Irfan BCéspedes NCasas JSenft EGutiérrez LRincon-Roncancio MCifuentes CBelpaeme TMúnera M(2022)Personalised socially assistive robot for cardiac rehabilitation: Critical reflections on long-term interactions in the real worldUser Modeling and User-Adapted Interaction10.1007/s11257-022-09323-033:2(497-544)Online publication date: 19-Jul-2022
https://doi.org/10.1007/s11257-022-09323-0
Leite IPereira ALehman JBlikstein PAbrahamson D(2017)Persistent Memory in Repeated Child-Robot ConversationsProceedings of the 2017 Conference on Interaction Design and Children10.1145/3078072.3079728(238-247)Online publication date: 27-Jun-2017
https://dl.acm.org/doi/10.1145/3078072.3079728
Iwamura YShiomi MKanda TIshiguro HHagita N(2013)Chat and Appearance Effects for Robots which Assist Elderly's ShoppingJournal of the Robotics Society of Japan10.7210/jrsj.31.6031:1(60-70)Online publication date: 2013
https://doi.org/10.7210/jrsj.31.60
Kitade TSatake SKanda TImai MKuzuoka HEvers VImai MForlizzi J(2013)Understanding suitable locations for waitingProceedings of the 8th ACM/IEEE international conference on Human-robot interaction10.5555/2447556.2447566(57-64)Online publication date: 3-Mar-2013
https://dl.acm.org/doi/10.5555/2447556.2447566
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten