Skip to main content

Graphical Programming Interface for Enabling Non-technical Professionals to Program Robots and Internet-of-Things Devices

  • Conference paper
  • First Online:
Advances in Computational Intelligence (IWANN 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10306))

Included in the following conference series:

Abstract

This paper presents a graphical programming interface that enables non-technical professionals to program robots. Increasingly, robots are used by non-technical persons, such as service workers, therapists or marketers and graphical programming enables them to adjust robots to the situational needs through intuitive but expressive ways.

We present our implementation of graphical environment for programming a set of internet-of-things (IoT) devices and robots for therapists of autism. It is based on Robot Operating System (ROS) and Snap, and is called Robokol. Compared to previous solutions our system is easily extensible to new devices, with an interface enabling plug-and-play device discoverability and uses nonproprietary, well-known tools.

We detail two use cases of our interface, one where therapists of autism create sense-act loops for sensory therapy employing robot-like or IoT devices, and second where Robokol is used to create interfaces for Wizard-of-Oz scenario with robots.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hardware that can connect to scratch (2015). http://wiki.scratch.mit.edu/wiki/Hardware_That_Can_Connect_to_Scratch

  2. Arent, K., Kabala, M., Wnuk, M.: Programowanie i konstrukcja kulistego robota spolecznego wspomagajacego terapie dzieci autystycznych. Ph.D. thesis, Politechnika Wroclawska (2005)

    Google Scholar 

  3. Billard, A., Calinon, S., Dillmann, R., Schaal, S.: Robot programming by demonstration. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 1371–1394. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Chong, J., Ong, S., Nee, A., Youcef-Youmi, K.: Robot programming using augmented reality: an interactive method for planning collision-free paths. Robot. Comput. Integr. Manufact. 25(3), 689–701 (2009)

    Article  Google Scholar 

  5. Glas, D.F., Kanda, T., Ishiguro, H.: Human-robot interaction design using interaction composer: eight years of lessons learned. In: The Eleventh ACM/IEEE International Conference on Human Robot Interation, HRI 2016, pp. 303–310. IEEE Press, Piscataway (2016). http://dl.acm.org/citation.cfm?id=2906831.2906884

  6. Granosik, G., Stasiak, K.: Pyrobotics managing the family of heterogeneous robots. In: 13th IEEE IFAC International Conference on Methods and Models in Automation and Robotics, pp. 965–969. IEEE (2007)

    Google Scholar 

  7. Huang, J., Lau, T., Cakmak, M.: Design and evaluation of a rapid programming system for service robots. In: The Eleventh ACM/IEEE International Conference on Human Robot Interation, HRI 2016, pp. 295–302. IEEE Press, Piscataway (2016). http://dl.acm.org/citation.cfm?id=2906831.2906883

  8. Jost, B., Ketterl, M., Budde, R., Leimbach, T.: Graphical programming environments for educational robots: open roberta - yet another one? In: 2014 IEEE International Symposium on Multimedia, pp. 381–386, December 2014

    Google Scholar 

  9. McIver, L.: Syntactic and Semantic Issues in Introductory Programming Education. Monash Univesity, Clayton (2001)

    Google Scholar 

  10. McNerney, T.S.: Tangible programming bricks: an approach to making programming accessible to everyone. Ph.D. thesis, Massachusetts Institute of Technology (1999)

    Google Scholar 

  11. Gordon, M., Ackermann, E., Breazeal, C.: Social robot toolkit: Tangible programming for young children. HRI 15 Extended Abstracts, Portland, OR, USA, March 2015

    Google Scholar 

  12. Mnig, J.: Snap! (build your own blocks) 4.0. (2016). http://snap.berkeley.edu/

  13. Nguyen, H., Ciocarlie, M., Hsiao, K., Kemp, C.C.: ROS commander (ROSCo): behavior creation for home robots. In: 2013 IEEE International Conference on Robotics and Automation (ICRA), pp. 467–474. IEEE (2013)

    Google Scholar 

  14. Pinciroli, C., Lee-Brown, A., Beltrame, G.: Buzz: An extensible programming language for self-organizing heterogeneous robot swarms. CoRR abs/1507.05946 (2015). http://arxiv.org/abs/1507.05946

  15. Pot, E., Monceaux, J., Gelin, R., Maisonnier, B.: Choregraphe: a graphical tool for humanoid robot programming. In: The 18th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2009, pp. 46–51. IEEE (2009)

    Google Scholar 

  16. Thomas, B.: ROS Scratch: Enabling Block-Based Robotics. 1 edn. (2011). http://robotics.cs.brown.edu/test/slides/brian-final.pdf

  17. Valk, L.: LEGO MINDSTORMS EV3 Discovery Book: A Beginner’s Guide to Building and Programming Robots. No Starch Press, San Francisco (2014)

    Google Scholar 

  18. Wahl, F.M., Thomas, U.: Robot programming-from simple moves to complex robot tasks. Institute for Robotics and Process Control, Technical University of Brawnschweig (2002)

    Google Scholar 

  19. Werner, L., Campe, S., Denner, J.: Children learning computer science concepts via alice game-programming. In: Proceedings of the 43rd ACM Technical Symposium on Computer Science Education, pp. 427–432. ACM (2012)

    Google Scholar 

  20. Zubrycki, I., Kolesiski, M., Granosik, G.: A participatory design for enhancing the work environment of therapists of disabled children. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 781–786, August 2016

    Google Scholar 

  21. Zubrycki, I., Granosik, G.: Designing an interactive device for sensory therapy. In: The Eleventh ACM/IEEE International Conference on Human Robot Interation, HRI 2016, pp. 545–546. IEEE Press, Piscataway (2016). http://dl.acm.org/citation.cfm?id=2906831.2906969

  22. Zubrycki, I., Granosik, G.: Understanding therapists’ needs and attitudes towards robotic support. The roboterapia project. Int. J. Soc. Robot. 8(4), 553–563 (2016). http://dx.doi.org/10.1007/s12369-016-0372-9

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Igor Zubrycki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Zubrycki, I., Kolesiński, M., Granosik, G. (2017). Graphical Programming Interface for Enabling Non-technical Professionals to Program Robots and Internet-of-Things Devices. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2017. Lecture Notes in Computer Science(), vol 10306. Springer, Cham. https://doi.org/10.1007/978-3-319-59147-6_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59147-6_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59146-9

  • Online ISBN: 978-3-319-59147-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics