Skip to main content

Experiment of Social Robot Collaboration (SRC): Vision-Based Object Segmentation, Localization and Segregation in a Public Interaction Event

  • Conference paper
  • First Online:
Robotics in Natural Settings (CLAWAR 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 530))

Included in the following conference series:

  • 1306 Accesses

Abstract

To bridge the gap between humans and robots, there is a need to focus on the development of technology that can enhance the collaboration between the human and the robot (SRC). This research paper elaborates on a human interactive experiment of vision-based sorting of objects (candy) using a 3R serial spatial collaborative manipulator, used as an exhibit at the annual public ‘Open Day’ event at the Indian Institute of Science Bangalore. We collected feedback from the vast & variety of audience (mostly children and adult) and used this data to compute various human-robot collaboration parameters. 66.67% of the participants who were shown the demonstration demonstrated over 90% effectiveness in interaction during the sorting task as defined above. It was also statistically shown that there was no significant difference in the effectiveness between researchers and non-researchers who took part in the experiment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Robla-Gómez, S., Becerra, V.M., Llata, J.R., González-Sarabia, E., Torre-Ferrero, C., Pérez-Oria, J.: Working together: a review on safe human-robot collaboration in industrial environments. IEEE Access 5, 26754–26773 (2017)

    Google Scholar 

  2. Anuar, S., Baharuddin, A.B., Mohammad, A.: Lego bricks color sorting machine. In: 2016 2nd International Symposium on Agent, Multi-agent Systems and Robotics (ISAMSR) (2016)

    Google Scholar 

  3. Wang, J., Hu, H., Chen, L., He, C.: Assembly defect detection of atomizers based on machine vision. In: CACRE 2019, Shenzhen, China (2019)

    Google Scholar 

  4. Wang, W., et al.: Measurement system of gear parameters based on machine vision. Meas. Control 48(8), 242–248 (2015)

    Google Scholar 

  5. Peng, G., Zhang, Z., Li, W.: Computer vision algorithm for measurement and inspection of O-rings. Measurement 94, 828–836 (2016)

    Article  Google Scholar 

  6. Murphy, R.R., Schreckenghost, D.: Survey of metrics for human-robot interaction. In: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE (2013)

    Google Scholar 

  7. Bensch, S., Jevtic, A., Hellström, T.: On interaction quality in human-robot interaction. In: ICAART 2017 Proceedings of the 9th International Conference on Agents and Artificial Intelligence, vol. 1. SciTePress (2017)

    Google Scholar 

  8. Robb, D.A., et al.: Robots in the danger zone: exploring public perception through engagement. In: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (2020)

    Google Scholar 

  9. Foster, M.E. et al.: The MuMMER project: engaging human-robot interaction in real-world public spaces. In: Agah, A., Cabibihan, J.J., Howard, A., Salichs, M., He, H. (eds.) Social Robotics. ICSR 2016. LNCS, vol. 9979, pp. 753–763. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47437-3_74

  10. Savela, N., Turja, T., Oksanen, A.: Social acceptance of robots in different occupational fields: a systematic literature review. Int. J. Soc. Robot. 10(4), 493–502 (2018)

    Article  Google Scholar 

  11. Kim, M.-G., et al.: Effectiveness of robot exhibition through visitors experience: a case study of Nagoya Science Hiroba exhibition in Japan. In: 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS). IEEE (2016)

    Google Scholar 

  12. Kim, M.G., Lee, H., Lee, J., Kwak, S.S., Joo, Y.: Effectiveness and service quality of robot museum through visitors experience: a case study of RoboLife Museum in South Korea. In: 2015 International Symposium on Micro-NanoMechatronics and Human Science (MHS), pp.1–5. IEEE (2015)

    Google Scholar 

  13. Moro, C., et al.: Social robots and seniors: a comparative study on the influence of dynamic social features on human–robot interaction. Int. J. Soc. Robot. 11(1), 5–24 (2019)

    Google Scholar 

  14. Erdogan, K., Yilmaz, N.: Shifting colors to overcome not realizing objects problem due to color vision deficiency.In: 2nd International Conference on Advances in Computing, Electronics and Electrical Technology - CEET. Kuala Lumpur, Malaysia (2014). https://doi.org/10.15224/978-1-63248-034-7-27

Download references

Acknowledgment

This project is funded by Samarth Udyog, Common Engineering Facility Centre (CEFC) CPDM, IISc, Bangalore; Department of Heavy Industries (DHI), Govt. of India.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abhra Roy Chowdhury .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaushik, B., Chowdhury, A.R. (2023). Experiment of Social Robot Collaboration (SRC): Vision-Based Object Segmentation, Localization and Segregation in a Public Interaction Event. In: Cascalho, J.M., Tokhi, M.O., Silva, M.F., Mendes, A., Goher, K., Funk, M. (eds) Robotics in Natural Settings. CLAWAR 2022. Lecture Notes in Networks and Systems, vol 530. Springer, Cham. https://doi.org/10.1007/978-3-031-15226-9_43

Download citation

Publish with us

Policies and ethics