Skip to main content

Advertisement

Springer Nature Link
Log in

A Methodology for end user programming of ROS-based service robots using jigsaw metaphor and ontologies

  • Original Research Paper
  • Published:
Intelligent Service Robotics Aims and scope Submit manuscript

Abstract

This study proposes a methodology to build an interface that will enable end users to interact with ROS-based service robots. The proposed methodology enables building an easy-to-use interface using the jigsaw metaphor. The methodology exploits ontologies to maximize the data sharing and integration among the users of the system. This methodology is verified on a cocktail robot as a case study and an end user-based survey is conducted to evaluate the built interface. The case study proved the feasibility of the methodology. User-based evaluation results provided positive feedback regarding the usability and preferability of the interface built with the proposed methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Fraser N Google Blockly - a Visual Programming Editor. https://developers.google.com/blockly/

  2. Gruber TR (1993) A translation approach to portable ontology specifications. Knowl Acquis 5(2):199–220

    Article  Google Scholar 

  3. Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, Wheeler R, Ng AY et al: Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3, p. 5 (2009). Kobe, Japan

  4. Ajaykumar G, Steele M, Huang C-M (2021) A survey on end-user robot programming. ACM Comput. Surv. 54(8)

  5. Johnson DO, Agah A (2013) Learning macro actions from instructional videos through integration of multiple modalities. Int J Soc Robotics 5(1):53–73. https://doi.org/10.1007/S12369-012-0167-6

    Article  Google Scholar 

  6. Johnson DO, Agah A (2009) Human robot interaction through semantic integration of multiple modalities, dialog management, and contexts. Int J Soc Robotics 1(4):283–305. https://doi.org/10.1007/S12369-009-0028-0

    Article  Google Scholar 

  7. Johnson DO Human robot interaction through semantic integration of multiple modalities, dialog management, and contexts. Phd thesis, Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS, USA (April 2008). Available at https://doi.org/10.1007/s12369-009-0028-0

  8. Nicolescu MN, Mataric MJ (2001) Learning and interacting in human-robot domains. IEEE Trans Syst, Man, Cybern - Part A: Syst Hum 31(5):419–430. https://doi.org/10.1109/3468.952716

    Article  Google Scholar 

  9. Calinon S, Guenter F, Billard A (2005) Goal-directed imitation in a humanoid robot. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005, April 18-22, 2005, Barcelona, Spain, pp. 299–304. https://doi.org/10.1109/ROBOT.2005.1570135

  10. Calinon S, Guenter F, Billard A (2006) On learning the statistical representation of a task and generalizing it to various contexts. In: Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006., pp. 2978–2983. https://doi.org/10.1109/ROBOT.2006.1642154

  11. Green A, Severinson-Eklundh K (2001) Task-oriented dialogue for cero: a user-centered approach. In: Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591), pp. 146–151. https://doi.org/10.1109/ROMAN.2001.981893

  12. Gadre SY, Rosen E, Chien G, Phillips E, Tellex S, Konidaris G (2019) End user robot programming using mixed reality. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 2707–2713

  13. Gao Y, Huang C-M (2019) Pati: A projection-based augmented table-top interface for robot programming. In: Proceedings of the 24th International Conference on Intelligent User Interfaces, pp. 345–355. Association for Computing Machinery, New York, NY, USA

  14. Huang G, Rao PS, Wu M-H, Qian X, Nof SY, Ramani K, Quinn AJ (2020) Vipo: Spatial-visual programming with functions for robot-iot workflows. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. Association for Computing Machinery, New York, NY, USA

  15. Kapinus M, Beran V, Materna Z, Bambusek D (2019) Spatially situated end-user robot programming in augmented reality. In: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1–8

  16. Kubota A, Peterson EIC, Rajendren V, Kress-Gazit H, Riek LD (2020) Jessie: Synthesizing social robot behaviors for personalized neurorehabilitation and beyond. In: Proceedings of the 2020 ACM IEEE International Conference on Human Robot Interaction, pp. 121–130. Association for Computing Machinery, New York, NY, USA

  17. Liang YS, Pellier D, Fiorino H, Pesty S (2019) End user programming of low and high level actions for robotic task planning. In: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (ROMAN), pp. 1–8

  18. Ong SK, Yew AWW, Thanigaivel NK, Nee AYC (2020) Augmented reality-assisted robot programming system for industrial applications. Robotics Comput. Integr, Manuf, p 61

    Google Scholar 

  19. Quintero C, Li S, Pan M, Chan W, Loos HF, Croft E (2018) Robot programming through augmented trajectories in augmented reality, pp. 1838–1844

  20. Riedl M, Henrich D (2019) A fast robot playback programming system using video editing concepts. In: Tagungsband des 4. Kongresses Montage Handhabung Industrieroboter, pp. 259–268. Springer, Berlin, Heidelberg

  21. Sefidgar YS, Weng T, Harvey H, Elliott S, Cakmak M (2018) Robotist: Interactive situated tangible robot programming. In: Proceedings of the 2018 ACM Symposium on Spatial User Interaction, pp. 141–149. Association for Computing Machinery, New York, NY, USA

  22. Buchina NG, Sterkenburg P, Lourens T, Barakova EI (2019) Natural language interface for programming sensory-enabled scenarios for human-robot interaction. In: 2019 28th IEEE International Conference on Robot and Human Interactive Communication (ROMAN), pp. 1–8

  23. Beschi S, Fogli D, Tampalini F (2019) Capirci: A multi-modal system for collaborative robot programming. End-User Development. Springer, Cham, pp 51–66

    Chapter  Google Scholar 

  24. Studio N Niryo One. https://niryo.com/niryo-one/

  25. Noy NF, Fergerson RW, Musen MA (2000) The knowledge model of protege 2000: Combining interoperability and flexibility. In: Knowledge Engineering and Knowledge Management Methods, Models, and Tools. Lecture Notes in Computer Science, vol. 1937, pp. 17–32

  26. Smith MK, Welty C, McGuinness DL (2004) OWL Web Ontology Language Guide. www.heppnetz.de/ontologies/vso/ns

  27. Brooke J (1996) Sus: a quick and dirty usability scale. In: Jordan PW, Thomas BAWB (eds) Usability Evaluation in Industry. Taylor and Francis, London

    Google Scholar 

  28. Tullis TS, Stetson JN (2004) A comparison of questionnaires for assessing website usability. In: Proceedings of UPA 2004

  29. Miller JT, Bangor A, Kortum PT (2009) Determining what individual sus scores mean: Adding an adjective rating scale. J Usability Stud 4(3):114–123

    Google Scholar 

  30. Bangor A, Kortum PT, Miller JT (2008) An empirical evaluation of the system usability scale. Int J Hum Comput Interaction 24(6):574–594

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Manisa Celal Bayar University, Manisa, 45140, Turkey

    Övünç Öztürk

Authors
  1. Övünç Öztürk
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Övünç Öztürk.

Ethics declarations

Conflicts of Interest

The authors whose names are listed immediately below certify that they have NO affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Öztürk, Ö. A Methodology for end user programming of ROS-based service robots using jigsaw metaphor and ontologies. Intel Serv Robotics 17, 745–757 (2024). https://doi.org/10.1007/s11370-024-00528-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11370-024-00528-3

Keywords