skip to main content
10.1145/3544549.3585884acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

A Database for Kitchen Objects: Investigating Danger Perception in the Context of Human-Robot Interaction

Published: 19 April 2023 Publication History

Abstract

In the future, humans collaborating closely with cobots in everyday tasks will require handing each other objects. So far, researchers have optimized human-robot collaboration concerning measures such as trust, safety, and enjoyment. However, as the objects themselves influence these measures, we need to investigate how humans perceive the danger level of objects. Thus, we created a database of 153 kitchen objects and conducted an online survey (N=300) investigating their perceived danger level. We found that (1) humans perceive kitchen objects vastly differently, (2) the object-holder has a strong effect on the danger perception, and (3) prior user knowledge increases the perceived danger of robots handling those objects. This shows that future human-robot collaboration studies must investigate different objects for a holistic image. We contribute a wiki-like open-source database to allow others to study predefined danger scenarios and eventually build object-aware systems: https://hri-objects.leusmann.io/.

Supplementary Material

MP4 File (3544549.3585884-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
Adam T. Biggs, James R. Brockmole, and Jessica K. Witt. 2013. Armed and Attentive: Holding a Weapon Can Bias Attentional Priorities in Scene Viewing. Attention, Perception, & Psychophysics 75, 8 (Nov. 2013), 1715–1724. https://doi.org/10.3758/s13414-013-0538-6
[2]
Paul-Christian Bürkner. 2017. Brms: An R Package for Bayesian Multilevel Models Using Stan. Journal of Statistical Software 80 (Aug. 2017), 1–28. https://doi.org/10.18637/jss.v080.i01
[3]
Berk Calli, Arjun Singh, James Bruce, Aaron Walsman, Kurt Konolige, Siddhartha Srinivasa, Pieter Abbeel, and Aaron M Dollar. 2017. Yale-CMU-Berkeley dataset for robotic manipulation research. The International Journal of Robotics Research 36, 3 (2017), 261–268. https://doi.org/10.1177/0278364917700714
[4]
Bob Carpenter, Andrew Gelman, Matthew D. Hoffman, Daniel Lee, Ben Goodrich, Michael Betancourt, Marcus A. Brubaker, Jiqiang Guo, Peter Li, and Allen Riddell. 2017. Stan: A Probabilistic Programming Language. Journal of Statistical Software 76 (2017), 1. https://doi.org/10.18637/jss.v076.i01
[5]
Elizabeth Cha, Jodi Forlizzi, and Siddhartha S. Srinivasa. 2015. Robots in the Home: Qualitative and Quantitative Insights into Kitchen Organization. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction(HRI ’15). Association for Computing Machinery, New York, NY, USA, 319–326. https://doi.org/10.1145/2696454.2696465
[6]
MichałCzubenko and Zdzisław Kowalczuk. 2021. A Simple Neural Network for Collision Detection of Collaborative Robots. Sensors 21, 12 (Jan. 2021), 4235. https://doi.org/10.3390/s21124235
[7]
Dima Damen, Hazel Doughty, Giovanni Maria Farinella, Antonino Furnari, Jian Ma, Evangelos Kazakos, Davide Moltisanti, Jonathan Munro, Toby Perrett, Will Price, and Michael Wray. 2022. Rescaling Egocentric Vision: Collection, Pipeline and Challenges for EPIC-KITCHENS-100. International Journal of Computer Vision (IJCV) 130 (2022), 33–55. https://doi.org/10.1007/s11263-021-01531-2
[8]
Alexander Dietrich, Thomas Wimbock, Alin Albu-Schaffer, and Gerd Hirzinger. 2012. Integration of Reactive, Torque-Based Self-Collision Avoidance Into a Task Hierarchy. IEEE Transactions on Robotics 28, 6 (Dec. 2012), 1278–1293. https://doi.org/10.1109/TRO.2012.2208667
[9]
Mary Douglas. 2002. Risk Acceptability According to the Social Sciences. Routledge, London. https://doi.org/10.4324/9780203708781
[10]
Mary Douglas and Aaron Wildavsky. 1983. Risk and Culture: An Essay on the Selection of Technological and Environmental Dangers.
[11]
Thomas Franke, Christiane Attig, and Daniel Wessel. 2018. A Personal Resource for Technology Interaction: Development and Validation of the Affinity for Technology Interaction (ATI) Scale. Taylor & Francis. https://doi.org/10.1080/10447318.2018.1456150
[12]
Georgios Georgakis, Md Alimoor Reza, Arsalan Mousavian, Phi-Hung Le, and Jana Kosecka. 2016. Multiview RGB-D Dataset for Object Instance Detection. In 2016 Fourth International Conference on 3D Vision (3DV). IEEE, Stanford, CA, USA, 426–434. https://doi.org/10.1109/3DV.2016.52
[13]
Amin Hamed, Mehdi Tale Masouleh, and Ahmad Kalhor. 2020. Design & Characterization of a Bio-Inspired 3-DOF Tactile/Force Sensor and Implementation on a 3-DOF Decoupled Parallel Mechanism for Human-Robot Interaction Purposes. Mechatronics 66 (April 2020), 102325. https://doi.org/10.1016/j.mechatronics.2020.102325
[14]
Mary B. Harris and Kari C. Miller. 2000. Gender and Perceptions of Danger. Sex Roles 43, 11 (Dec. 2000), 843–863. https://doi.org/10.1023/A:1011036905770
[15]
Matthew Kay, Steve Haroz, Shion Guha, and Pierre Dragicevic. 2016. Special Interest Group on Transparent Statistics in HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1081–1084. https://doi.org/10.1145/2851581.2886442
[16]
Matthew Kay, Gregory L. Nelson, and Eric B. Hekler. 2016. Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4521–4532. https://doi.org/10.1145/2858036.2858465
[17]
Hilde Kuehne, Ali B. Arslan, and Thomas Serre. 2014. The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities. In Proceedings of Computer Vision and Pattern Recognition Conference(CVPR’14). IEEE. https://doi.org/10.1109/CVPR.2014.105
[18]
Kevin Lai, Liefeng Bo, Xiaofeng Ren, and Dieter Fox. 2011. A large-scale hierarchical multi-view RGB-D object dataset. In 2011 IEEE International Conference on Robotics and Automation. 1817–1824. https://doi.org/10.1109/ICRA.2011.5980382
[19]
Jisoo Lee, Erin Walker, Winslow Burleson, Matthew Kay, Matthew Buman, and Eric B. Hekler. 2017. Self-Experimentation for Behavior Change: Design and Formative Evaluation of Two Approaches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6837–6849. https://doi.org/10.1145/3025453.3026038
[20]
Justin Matejka, Michael Glueck, Tovi Grossman, and George Fitzmaurice. 2016. The Effect of Visual Appearance on the Performance of Continuous Sliders and Visual Analogue Scales. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 5421–5432. https://doi.org/10.1145/2858036.2858063
[21]
Carl Oechsner, Sven Mayer, and Andreas Butz. 2022. Challenges and Opportunities of Cooperative Robots as Cooking Appliances. (2022), 7. https://ceur-ws.org/Vol-3154/paper14.pdf
[22]
Valerio Ortenzi, Akansel Cosgun, Tommaso Pardi, Wesley Chan, Elizabeth Croft, and Dana Kulić. 2021. Object Handovers: A Review for Robotics. IEEE Transactions on Robotics 37, 6 (Jan. 2021), 1855–1873. https://doi.org/10.1109/TRO.2021.3075365 arxiv:2007.12952 [cs, eess]
[23]
Max Pascher, Uwe Gruenefeld, Stefan Schneegass, and Jens Gerken. 2023. How to Communicate Robot Motion Intent: A Scoping Review. (2023).
[24]
Ulf-Dietrich Reips and Frederik Funke. 2008. Interval-Level Measurement with Visual Analogue Scales in Internet-based Research: VAS Generator. Behavior Research Methods 40, 3 (Aug. 2008), 699–704. https://doi.org/10.3758/BRM.40.3.699
[25]
David A. Robb, Muneeb I. Ahmad, Carlo Tiseo, Simona Aracri, Alistair C. McConnell, Vincent Page, Christian Dondrup, Francisco J. Chiyah Garcia, Hai-Nguyen Nguyen, Èric Pairet, Paola Ardón Ramírez, Tushar Semwal, Hazel M. Taylor, Lindsay J. Wilson, David Lane, Helen Hastie, and Katrin Lohan. 2020. Robots in the Danger Zone: Exploring Public Perception through Engagement. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’20). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/3319502.3374789
[26]
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, and Stefanie Tellex. 2019. Communicating and Controlling Robot Arm Motion Intent through Mixed-Reality Head-Mounted Displays. The International Journal of Robotics Research 38, 12-13 (Oct. 2019), 1513–1526. https://doi.org/10.1177/0278364919842925
[27]
Ruben Sagues-Tanco, Luis Benages-Pardo, Gonzalo López-Nicolás, and Sergio Llorente. 2020. Fast Synthetic Dataset for Kitchen Object Segmentation in Deep Learning. IEEE Access 8 (2020), 220496–220506. https://doi.org/10.1109/ACCESS.2020.3043256
[28]
Abhraneel Sarma and Matthew Kay. 2020. Prior Setting in Practice: Strategies and Rationales Used in Choosing Prior Distributions for Bayesian Analysis. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376377
[29]
Chauncey Starr. 1969. Social Benefit versus Technological Risk. Science (Sept. 1969). https://doi.org/10.1126/science.165.3899.1232
[30]
Jan-Philipp Stein and Peter Ohler. 2017. Venturing into the Uncanny Valley of Mind—The Influence of Mind Attribution on the Acceptance of Human-like Characters in a Virtual Reality Setting. Cognition 160 (March 2017), 43–50. https://doi.org/10.1016/j.cognition.2016.12.010
[31]
Rainer Stiefelhagen, Christian Fogen, P. Gieselmann, Hartwig Holzapfel, Kai Nickel, and Alex Waibel. 2004. Natural Human-Robot Interaction Using Speech, Head Pose and Gestures. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), Vol. 3. IEEE, Sendai, Japan, 2422–2427. https://doi.org/10.1109/IROS.2004.1389771
[32]
Megan K. Strait, Cynthia Aguillon, Virginia Contreras, and Noemi Garcia. 2017. The Public’s Perception of Humanlike Robots: Online Social Commentary Reflects an Appearance-Based Uncanny Valley, a General Fear of a “Technology Takeover”, and the Unabashed Sexualization of Female-Gendered Robots. In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, Lisbon, 1418–1423. https://doi.org/10.1109/ROMAN.2017.8172490
[33]
Kristina Tornbjerg, Anne Marie Kanstrup, Mikael B. Skov, and Matthias Rehm. 2021. Investigating Human-Robot Cooperation in a Hospital Environment: Scrutinising Visions and Actual Realisation of Mobile Robots in Service Work. In Designing Interactive Systems Conference 2021. ACM, Virtual Event USA, 381–391. https://doi.org/10.1145/3461778.3462101
[34]
Chao Wang, Anna Belardinelli, Stephan Hasler, Theodoros Stouraitis, Daniel Tanneberg, and Michael Gienger. 2023. Explainable Human-Robot Training and Cooperation with Augmented Reality. https://doi.org/10.1145/3544549.3583889 arxiv:2302.01039 [cs]
[35]
Jessica K. Witt and James R. Brockmole. 2012. Action Alters Object Identification: Wielding a Gun Increases the Bias to See Guns.Journal of Experimental Psychology: Human Perception and Performance 38, 5 (2012), 1159–1167. https://doi.org/10.1037/a0027881

Cited By

View all
  • (2024)Privacy communication patterns for domestic robotsProceedings of the Twentieth USENIX Conference on Usable Privacy and Security10.5555/3696899.3696906(121-138)Online publication date: 12-Aug-2024
  • (2024)Therblig to RobotSPOOL10.47982/spool.2024.1.0311:1(49-64)Online publication date: 1-Jul-2024
  • (2024)Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765318:MHCI(1-17)Online publication date: 24-Sep-2024
  • Show More Cited By

Index Terms

  1. A Database for Kitchen Objects: Investigating Danger Perception in the Context of Human-Robot Interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    3914 pages
    ISBN:9781450394222
    DOI:10.1145/3544549
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Check for updates

    Author Tags

    1. bayesian mixed models
    2. dataset
    3. human-computer interaction
    4. human-robot interaction
    5. kitchen
    6. robots

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)251
    • Downloads (Last 6 weeks)28
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Privacy communication patterns for domestic robotsProceedings of the Twentieth USENIX Conference on Usable Privacy and Security10.5555/3696899.3696906(121-138)Online publication date: 12-Aug-2024
    • (2024)Therblig to RobotSPOOL10.47982/spool.2024.1.0311:1(49-64)Online publication date: 1-Jul-2024
    • (2024)Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765318:MHCI(1-17)Online publication date: 24-Sep-2024
    • (2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
    • (2024)Human–robot object handover: Recent progress and future directionBiomimetic Intelligence and Robotics10.1016/j.birob.2024.1001454:1(100145)Online publication date: Mar-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media