short-paper

Teaching Robots to Act and Converse in Physical Spaces: Participatory Design Fictions with Museum Guides

Authors:

Heloisa Candello,

Mauro Pichiliani,

Mairieli Wessel,

Claudio Pinhanez,

Michael MullerAuthors Info & Claims

HttF '19: Proceedings of the Halfway to the Future Symposium 2019

Article No.: 15, Pages 1 - 4

https://doi.org/10.1145/3363384.3363399

Published: 19 November 2019 Publication History

Abstract

This paper reflects on the expectations of museum guides regarding companion AI-powered robots in a science museum space. We employed Design Fiction as a technique to explore machine teaching of future technologies in public spaces. The fiction is illustrated by an open-ended “imaginary abstract” which showcases the dilemma of buying AI robots to work as floor guides in a science museum. Forty-seven museum guides participated in a study in which they were asked to write the end of a fictional story. Participants described their impressions and implications of teaching robots who would do their jobs. This design fiction activity is expected to help grounding the debate on machine teaching paradigms, values, and social dilemmas which new technologies bring to physical spaces.

References

[1]

Jennifer Attride-Stirling. 2001. Thematic networks: an analytic tool for qualitative research. Qualitative research 1, 3 (2001), 385–405.

[2]

Mark Blythe. 2014. Research Through Design Fiction: Narrative in Real and Imaginary Abstracts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). ACM, New York, NY, USA, 703–712. https://doi.org/10.1145/2556288.2557098

Digital Library

[3]

Barry Brown, Julian Bleecker, Marco D’Adamo, Pedro Ferreira, Joakim Formo, Mareike Glöss, Maria Holm, Kristina Höök, Eva-Carin Banka Johnson, Emil Kaburuan, Anna Karlsson, Elsa Vaara, Jarmo Laaksolahti, Airi Lampinen, Lucian Leahu, Vincent Lewandowski, Donald McMillan, Anders Mellbratt, Johanna Mercurio, Cristian Norlin, Nicolas Nova, Stefania Pizza, Asreen Rostami, Mårten Sundquist, Konrad Tollmar, Vasiliki Tsaknaki, Jinyi Wang, Charles Windlin, and Mikael Ydholm. 2016. The IKEA Catalogue: Design Fiction in Academic and Industrial Collaborations. In Proceedings of the 19th International Conference on Supporting Group Work(GROUP ’16). ACM, New York, NY, USA, 335–344. https://doi.org/10.1145/2957276.2957298

Digital Library

[4]

Angelo Cafaro, Hannes Högni Vilhjálmsson, and Timothy Bickmore. 2016. First Impressions in Human–Agent Virtual Encounters. ACM Transactions on Computer-Human Interaction (TOCHI) 23, 4(2016), 24.

Digital Library

[5]

Heloisa Candello, Mauro Pichiliani, Claudio Pinhanez, and Paulo Cavalin. 2019. Teaching Chatbots to Show Science: A Study with Museum Guides. In Proceedings of Human-Centered Machine Learning Perspectives Workshop.

[6]

Heloisa Candello, Claudio Pinhanez, Mauro Pichiliani, Paulo Cavalin, Flavio Figueiredo, Marisa Vasconcelos, and Haylla Do Carmo. 2019. The Effect of Audiences on the User Experience with Conversational Interfaces in Physical Spaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–13. https://doi.org/10.1145/3290605.3300320

Digital Library

[7]

EunJeong Cheon and Norman Makoto Su. 2018. Futuristic Autobiographies: Weaving Participant Narratives to Elicit Values Around Robots. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’18). ACM, New York, NY, USA, 388–397. https://doi.org/10.1145/3171221.3171244

Digital Library

[8]

Luigina Ciolfi. 2012. Place-centred interaction design: situated participation and co-creation in places of heritage. In Proceedings of the Museum and design principles. Fondazione di Venezia.

[9]

Luigina Ciolfi and Eleanor Lockley. 2019. Exploring flash fiction for the collaborative interpretation of qualitative data. In Proceedings of 17th European Conference on Computer-Supported Cooperative Work. European Society for Socially Embedded Technologies (EUSSET).

[10]

Luigina Ciolfi and Daniela Petrelli. 2015. Walking and Designing with Cultural Heritage Volunteers. Interactions 23, 1 (Dec. 2015), 46–51. https://doi.org/10.1145/2848979

Digital Library

[11]

Heather Draper, Tom Sorell, Sandra Bedaf, Dag Sverre Syrdal, Carolina Gutierrez-Ruiz, Alexandre Duclos, and Farshid Amirabdollahian. 2014. Ethical dimensions of human-robot interactions in the care of older people: Insights from 21 focus groups convened in the UK, France and the Netherlands. In International Conference on Social Robotics. Springer, 135–145.

[12]

Enrique Encinas and Mark Blythe. 2016. The solution printer: magic realist design fiction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 387–396.

Digital Library

[13]

Batya Friedman, Peter H Kahn, and Alan Borning. 2008. Value sensitive design and information systems. The handbook of information and computer ethics (2008), 69–101.

[14]

Shang Guo, Jonathan Lenchner, Jonathan Connell, Mishal Dholakia, and Hidemasa Muta. 2017. Conversational Bootstrapping and Other Tricks of a Concierge Robot. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction - HRI ’17. ACM Press, New York, New York, USA, 73–81. https://doi.org/10.1145/2909824.3020232

Digital Library

[15]

Ellie Harmon, Chris Bopp, and Amy Voida. 2017. The Design Fictions of Philanthropic IT: Stuck Between an Imperfect Present and an Impossible Future. 7015–7028. https://doi.org/10.1145/3025453.3025650

Digital Library

[16]

Tasneem Kaochar, Raquel Torres Peralta, Clayton T Morrison, Ian R Fasel, Thomas J Walsh, and Paul R Cohen. 2011. Towards understanding how humans teach robots. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 347–352.

[17]

Todd Kulesza, Simone Stumpf, Margaret Burnett, Sherry Yang, Irwin Kwan, and Weng Keen Wong. 2013. Too much, too little, or just right? Ways explanations impact end users’ mental models. In Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC. https://doi.org/10.1109/VLHCC.2013.6645235

[18]

Joseph Lindley, Paul Coulton, and Emmett L Brown. 2016. Peer Review and Design Fiction: “Honestly, they’re not just made up.”. CHI Extended Abstracts (Alt. CHI). ACM(2016).

[19]

Martin Lindvall, Jesper Molin, and Jonas Löwgren. 2018. From machine learning to machine teaching: the importance of UX. Interactions 25, 6 (2018), 52–57.

Digital Library

[20]

Conor Linehan, Ben J Kirman, Stuart Reeves, Mark A Blythe, Joshua G Tanenbaum, Audrey Desjardins, and Ron Wakkary. 2014. Alternate endings: using fiction to explore design futures. In CHI’14 Extended Abstracts on Human Factors in Computing Systems. ACM, 45–48.

[21]

Ewa Luger and Abigail Sellen. 2016. “Like Having a Really Bad PA”: The Gulf between User Expectation and Experience of Conversational Agents. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI ’16 (2016). https://doi.org/10.1145/2858036.2858288

Digital Library

[22]

Ellen Lupton. 2017. Design is storytelling.

[23]

Laura A. Maye, Fiona E. McDermott, Luigina Ciolfi, and Gabriela Avram. 2014. Interactive Exhibitions Design: What Can We Learn from Cultural Heritage Professionals?. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational(NordiCHI ’14). ACM, New York, NY, USA, 598–607. https://doi.org/10.1145/2639189.2639259

Digital Library

[24]

Michael Muller and Thomas Erickson. 2018. In the Data Kitchen: A Review (a Design Fiction on Data Science). In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). ACM, New York, NY, USA, Article alt14, 10 pages. https://doi.org/10.1145/3170427.3188407

Digital Library

[25]

Michael Muller and Q Vera Liao. 2017. Exploring AI Ethics and Values through Participatory Design Fictions. Human Computer Interaction Consortium(2017). https://www.slideshare.net/traincroft/hcic-muller-and-liao-participatory-design-fictions-77345391

[26]

Patrice Y Simard, Saleema Amershi, David M Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, 2017. Machine teaching: A new paradigm for building machine learning systems. arXiv preprint arXiv:1707.06742(2017).

[27]

Patrice Y. Simard, Saleema Amershi, David Maxwell Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, and John Robert Wernsing. 2017. Machine Teaching: A New Paradigm for Building Machine Learning Systems. CoRR abs/1707.06742(2017).

[28]

Simone Stumpf, Vidya Rajaram, Lida Li, Margaret M. Burnett, Thomas G. Dietterich, Erin Sullivan, Russell Drummond, and Jonathan L. Herlocker. 2007. Toward harnessing user feedback for machine learning. In IUI.

[29]

Lucy Suchman. 2007. Human-machine reconfigurations: Plans and situated actions. Cambridge University Press.

Digital Library

[30]

Andrea Lockerd Thomaz and Cynthia Breazeal. 2008. Teachable robots: Understanding human teaching behavior to build more effective robot learners. Artif. Intell. 172(2008), 716–737.

Digital Library

Cited By

Abbasov IDu I(2023)Design concept of the exhibition space of the Henan State Museum (China)Культура и искусство10.7256/2454-0625.2023.6.38496(56-76)Online publication date: Jun-2023
https://doi.org/10.7256/2454-0625.2023.6.38496
Economidou E(2023)Engaging the General Public in Speculation on Human-Building Interaction Futures at a Pop-up Event: A Design Fiction ApproachProceedings of the 26th International Academic Mindtrek Conference10.1145/3616961.3616966(154-168)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1145/3616961.3616966
Fang XNg DLeung JChu S(2023)A systematic review of artificial intelligence technologies used for story writingEducation and Information Technologies10.1007/s10639-023-11741-528:11(14361-14397)Online publication date: 5-Apr-2023
https://dl.acm.org/doi/10.1007/s10639-023-11741-5
Show More Cited By

Index Terms

Teaching Robots to Act and Converse in Physical Spaces: Participatory Design Fictions with Museum Guides

Index terms have been assigned to the content through auto-classification.

Recommendations

Participatory design at the museum: inquiring into children's everyday engagement in cultural heritage
OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

We address the challenge of creating intersections between children's everyday engagement and museum exhibitions. Specifically, we propose an approach to participatory design inquiry where children's everyday engagement is taken as the point of ...
The Museum is Dreaming: Re-Imagining the Museum through Feminist Values and Data Practices in Design Fiction
Mindtrek '23: Proceedings of the 26th International Academic Mindtrek Conference

Museums and galleries are in a constant process to generate and maintain meaningful, long-lasting relationships with visitors. With the exponential increase of accessible and novel technologies, they are now understood as key mediators of this practice—...
Nature Fictions: Designing for a Sustainable Future through Nature Relations
DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference

This paper presents nature fictions, a co-design approach that seeks to highlight relations between people and nonhuman stakeholders in the process of imagining sustainable futures. The work was situated in gardens, to explore nature relations in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

HttF '19: Proceedings of the Halfway to the Future Symposium 2019

November 2019

260 pages

ISBN:9781450372039

DOI:10.1145/3363384

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

HTTF 2019

HTTF 2019: Halfway to the Future

November 19 - 20, 2019

Nottingham, United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
292
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Abbasov IDu I(2023)Design concept of the exhibition space of the Henan State Museum (China)Культура и искусство10.7256/2454-0625.2023.6.38496(56-76)Online publication date: Jun-2023
https://doi.org/10.7256/2454-0625.2023.6.38496
Economidou E(2023)Engaging the General Public in Speculation on Human-Building Interaction Futures at a Pop-up Event: A Design Fiction ApproachProceedings of the 26th International Academic Mindtrek Conference10.1145/3616961.3616966(154-168)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1145/3616961.3616966
Fang XNg DLeung JChu S(2023)A systematic review of artificial intelligence technologies used for story writingEducation and Information Technologies10.1007/s10639-023-11741-528:11(14361-14397)Online publication date: 5-Apr-2023
https://dl.acm.org/doi/10.1007/s10639-023-11741-5
Taylor AMurakami MKim SChu RRiek L(2022)Hospitals of the Future: Designing Interactive Robotic Systems for Resilient Emergency DepartmentsProceedings of the ACM on Human-Computer Interaction10.1145/35555436:CSCW2(1-40)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555543
Wessel MAbdellatif AWiese IConte TShihab EGerosa MSteinmacher IDwyer MDamian DZeller A(2022)Bots for pull requestsProceedings of the 44th International Conference on Software Engineering10.1145/3510003.3512765(274-286)Online publication date: 21-May-2022
https://dl.acm.org/doi/10.1145/3510003.3512765
Puspasari SErmatita Zulkardi (2021)Constructing Smart Digital Media for Museum Education Post Pandemic Recovery: A Review and Recommendation2021 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS10.1109/ICIMCIS53775.2021.9699345(238-243)Online publication date: 28-Oct-2021
https://doi.org/10.1109/ICIMCIS53775.2021.9699345
Candello HPichiliani MPinhanez CVidon SWessel MRubegni EVasalou AParés NSawhney N(2020)Co-designing a conversational interactive exhibit for childrenProceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts10.1145/3397617.3397840(326-331)Online publication date: 21-Jun-2020
https://dl.acm.org/doi/10.1145/3397617.3397840

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten