research-article

How to Overcome the Difficulties in Programming and Debugging Mobile Social Robots?

Authors:

Yuya kaneshige,

Takayuki Kanda,

Michita ImaiAuthors Info & Claims

HRI '21: Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

Pages 361 - 369

https://doi.org/10.1145/3434073.3444674

Published: 08 March 2021 Publication History

Abstract

We studied the programming and debugging processes of an autonomous mobile social robot with a focus on the programmers. This process is time-consuming in a populated environment where a mobile social robot is designed to interact with real pedestrians. From our observations, we identified two types of time-wasting behaviors among programmers: cherry-picking and a shortage of coverage in their testing. We developed a new tool, a test generator framework, to help avoid these testing time-wasters. This framework generates new testing scenarios to be used in a simulator by blending a user-prepared test with pre-stored pedestrian patterns. Finally, we conducted a user study to verify the effects of our test generator. The results showed that our test generator significantly reduced the programming and debugging time needed for autonomous mobile social robots.

References

[1]

S. Sabanovic, M. P. Michalowski and R. Simmons, Robots in the Wild: Observing Human-Robot Social Interaction Outside the Lab, 9th IEEE International Workshop on Advanced Motion Control, pp. 596--601, 2006.

[2]

J. Sung, H. I. Christensen and R. E. Grinter, Robots in the Wild: Understanding Long-Term Use, 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI2009), pp. 45--52, 2009.

Digital Library

[3]

R. Ros, et al., Child-Robot Interaction in the Wild: Advice to the Aspiring Experimenter, Proceedings of the 13th International Conference on Multimodal Interfaces, pp. 335--342, 2011.

Digital Library

[4]

I. Leite, R. Henriques, C. Martinho and A. Paiva, Sensors in the Wild: Exploring Electrodermal Activity in Child-Robot Interaction, Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction, pp. 41--48, 2013.

[5]

W. Burgard, A. B. Cremers, D. Fox, D. Hahnel, G. Lakemeyer, D. Schulz, W. Steiner, and S. Thrun, ?The interactive museum tour-guide robot," in Proc. Nat. Conf. Artif. Intell., 1998, pp. 11--18.

[6]

S. Thrun, M. Bennewitz, W. Burgard, A. B. Cremers, F. Dellaert, D. Fox, D. H¨ahnel, C. Rosenberg, N. Roy, J. Schulte, and D. Schulz, "Minerva: A second-generation museum tour-guide robot," in Proc. IEEE Int. Conf. Robot. Autom., 1999, pp. 1999--2005.

[7]

R. Siegwart, K. O. Arras, S. Bouabdallah, D. Burnier, G. Froidevaux, X. Greppin, B. Jensen, A. Lorotte, L. Mayor, M. Meisser, R. Philippsen, R. Piguet, G. Ramel, G. Terrien, and N. Tomatis, "Robox at expo.02: A large scale installation of personal robots," Robot. Autom. Syst., vol. 42, no. 3, pp. 203--222, 2003.

[8]

Chao SHI, et al. A robot that distributes flyers to pedestrians in a shopping mall. International Journal of Social Robotics, 2018, 10.4: 421--437.

[9]

S. Nidhra1 and J. Dondeti, "Black box and white box testing techniques -- A literature Review, International Journal of Embedded Systems and Applications (IJESA), Vol.2, No.2, pp. 29--50, 2012

[10]

T. Ostrand. "White-Box Testing." Encyclopedia of Software Engineering. Ed. J. J. Marciniak (Eds.), Wiley-Interscience, 2002

[11]

T. Ostrand. "Black-Box Testing." Encyclopedia of Software Engineering. Ed. J. J. Marciniak (Eds.), Wiley-Interscience, 2002

[12]

M. Woo, S. K. Cha, S. Gottlieb, and D. Brumley, Scheduling black-box mutational fuzzing, In Proc. of the 20th ACM Conference on Computer and Communications Security (CCS), 2013.

Digital Library

[13]

R. Hamlet. "Random testing." Encyclopedia of Software Engineering. Ed. J. J. Marciniak (Eds.), Wiley-Interscience, 2002

[14]

P. Godefroid, M. Y. Levin, and D. A. Molnar, Automated Whitebox Fuzz Testing, NDSS, Vol. 8, pp. 151--166, 2008

[15]

F. Duchene, S. Rawat, J. L. Richier, J. L., and R. Groz, KameleonFuzz: evolutionary fuzzing for black-box XSS detection, In Proc. of the 4th ACM conference on Data and application security and privacy, pp. 37--48, 2014

Digital Library

[16]

J. Kramer and M. Scheutz, Development Environments for Autonomous Mobile Robots: A Survey, Autonomous Robots, vol. 22, pp. 101--132, 2007.

Digital Library

[17]

M. Quigley, et al., Ros: An Open-Source Robot Operating System, ICRA Workshop on Open Source Software, p. 5, 2009.

[18]

E. Pot, J. Monceaux, R. Gelin and B. Maisonnier, Choregraphe: A Graphical Tool for Humanoid Robot Programming, The 18th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2009), pp. 46--51, 2009.

[19]

C. Datta, C. Jayawardena, I. H. Kuo and B. A. MacDonald, Robostudio: A Visual Programming Environment for Rapid Authoring and Customization of Complex Services on a Personal Service Robot, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2012), pp. 2352--2357, 2012.

[20]

D. F. Glas, T. Kanda and H. Ishiguro, Human-Robot Interaction Design Using Interaction Composer: Eight Years of Lessons Learned, The Eleventh ACM/IEEE International Conference on Human Robot Interation, pp. 303--310, 2016.

Digital Library

[21]

N. Koenig and A. Howard, Design and Use Paradigms for Gazebo, an Open-Source Multi-Robot Simulator, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), pp. 2149--2154, 2004.

[22]

G. Echeverria and N. Lassabe and A. Degroote and S. Lemaignan, "Modular OpenRobots Simulation Engine: MORSE," Proc. of the IEEE ICRA, 2011

[23]

M. Lewis, J. Wang and S. Hughes, Usarsim: Simulation for the Study of Human-Robot Interaction, Journal of Cognitive Engineering and Decision Making, vol. 1, pp. 98--120, 2007.

[24]

A. Cooper, The inmates are running the asylum: Why high-tech products drive us crazy and how to restore the sanity (Vol. 2). Indianapolis: Sams, 2004

[25]

Carl. BROWN, App Accomplished: Strategies for App Development Success. Pearson Education, 2014.

[26]

HERZIG, Kim, et al. The art of testing less without sacrificing quality, IEEE/ACM 37th IEEE International Conference on Software Engineering. pp. 483--493.

[27]

M. Shiomi, F. Zanlungo, K. Hayashi and T. Kanda, A Framework with a Pedestrian Simulator for Deploying Robots into a Real Environment, Simlation, Modeling, and Programming for Autonomous Robots (SIMPAR2012), 2012.

Digital Library

[28]

F. Zanlungo, T. Ikeda, and T. Kanda, Social force model with explicit collision prediction, Europhysics Letters, 93, 68005, 2011.

[29]

G. Kotonya, and I. Sommerville, Requirements Engineering: Processes and Techniques. John Wiley and Sons, 1998

Digital Library

[30]

T. S. Da Silva, M. Silveira, and F. Maurer, User Experience Design and Agile Development: From Theory to Practice, Journal of Software Engineering and Applications, 2012, 5(10), pp. 743--751

[31]

Kent Beck, Test Driven Development: By Example. Addison-Wesley Professional, 2002

Digital Library

Cited By

Edirisinghe SSatake SBrscic DLiu YKanda TGrollman DBroadbent EJu WSoh HWilliams T(2024)Field Trial of an Autonomous Shopworker Robot that Aims to Provide Friendly Encouragement and Exert Social PressureProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3635007(194-202)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3635007
Kassem KPavlova GSchlund SMichahelles F(2023)Build-A-Bot: Developing A Software Platform For A Modular Mobile RobotProceedings of the 13th International Conference on the Internet of Things10.1145/3627050.3627054(74-81)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3627050.3627054
Johansen SDonovan JRittenbruch MCastellano GRiek LCakmak MLeite I(2023)Illustrating Robot MovementsProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576956(231-242)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576956
Show More Cited By

Index Terms

How to Overcome the Difficulties in Programming and Debugging Mobile Social Robots?
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics

Recommendations

Convergence debugging
AADEBUG'05: Proceedings of the sixth international symposium on Automated analysis-driven debugging

This paper proposes a new practical automatic debugging method, called Convergence Debugging, which isolates a set of test cases that converge on the internal root cause of a failure. This method involves evaluating the debugging effectiveness of a set ...
On the Integration of Test Adequacy, Test Case Prioritization, and Statistical Fault Localization
QSIC '10: Proceedings of the 2010 10th International Conference on Quality Software

Testing and debugging account for at least 30% of the project effort. Scientific advancements in individual activities or their integration may bring significant impacts to the practice of software development. Fault localization is the foremost ...
Testing and debugging functional reactive programming

Many types of interactive applications, including video games, raise particular challenges when it comes to testing and debugging. Reasons include de-facto lack of reproducibility and difficulties of automatically generating suitable test data. This ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '21: Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

March 2021

425 pages

ISBN:9781450382892

DOI:10.1145/3434073

General Chairs:
Cindy Bethel
Mississippi State University, USA
,
Ana Paiva
INESC-ID, IST, University of Lisbon, Portugal & Radcliffe Institute for Advanced Study, Harvard University, USA
,
Program Chairs:
Elizabeth Broadbent
University of Auckland, New Zealand
,
David Feil-Seifer
University of Nevada Reno, USA
,
Daniel Szafir
University of Colorado Boulder, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

HRI '21

Sponsor:

HRI '21: ACM/IEEE International Conference on Human-Robot Interaction

March 8 - 11, 2021

CO, Boulder, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
357
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)6

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Edirisinghe SSatake SBrscic DLiu YKanda TGrollman DBroadbent EJu WSoh HWilliams T(2024)Field Trial of an Autonomous Shopworker Robot that Aims to Provide Friendly Encouragement and Exert Social PressureProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3635007(194-202)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3635007
Kassem KPavlova GSchlund SMichahelles F(2023)Build-A-Bot: Developing A Software Platform For A Modular Mobile RobotProceedings of the 13th International Conference on the Internet of Things10.1145/3627050.3627054(74-81)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3627050.3627054
Johansen SDonovan JRittenbruch MCastellano GRiek LCakmak MLeite I(2023)Illustrating Robot MovementsProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576956(231-242)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576956
Idrees ISingh SXu KGlas D(2023)A Framework for Realistic Simulation of Daily Human Activity2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309457(30-37)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309457
Seaborn KBarbareschi GChandra S(2023)Not Only WEIRD but “Uncanny”? A Systematic Review of Diversity in Human–Robot Interaction ResearchInternational Journal of Social Robotics10.1007/s12369-023-00968-415:11(1841-1870)Online publication date: 8-Mar-2023
https://doi.org/10.1007/s12369-023-00968-4
Tsoi NXiang AYu PSohn SSchwartz GRamesh SHussein MGupta AKapadia MVazquez M(2022)SEAN 2.0: Formalizing and Generating Social Situations for Robot NavigationIEEE Robotics and Automation Letters10.1109/LRA.2022.31967837:4(11047-11054)Online publication date: Oct-2022
https://doi.org/10.1109/LRA.2022.3196783
Lee HCheon ELim CFischer K(2022)Configuring Humans: What Roles Humans Play in HRI Research2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI)10.1109/HRI53351.2022.9889496(478-492)Online publication date: 7-Mar-2022
https://doi.org/10.1109/HRI53351.2022.9889496

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten