Abstract
This paper proposes and explores an approach in which robotics projects of novice engineering students focus on development of learning robots. We implemented a reinforcement learning scenario in which a humanoid robot learns to lift a weight of unknown mass through autonomous trial-and-error search. To expedite the process, trials of the physical robot are substituted by simulations with its virtual twin. The optimal parameters of the robot posture for executing the weightlifting task, found by analysis of the virtual trials, are transmitted to the robot through internet communication. The approach exposes students to the concepts and technologies of machine learning, parametric design, digital prototyping and simulation, connectivity and internet of things. Pilot implementation of the approach indicates its potential for teaching freshman and HS students, and for teacher education.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Peters, J., Lee, D.D., Kober, J., Nguyen-Tuong, D., Bagnell, D., Schaal, S.: Robot learning. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 357–394. Springer (2017)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Kormushev, P., Calinon, S., Caldwell, D.G.: Reinforcement learning in robotics: applications and real-world challenges. Robotics 2(3), 122–148 (2013)
Nguyen-Tuong, D., Peters, J.: Model learning for robot control: a survey. Cogn. Process. 12(4), 319–340 (2011)
Reckhaus, M., Hochgeschwender, N., Paulus, J., Shakhimardanov, A., Kraetzschmar, G.K.: An overview about simulation and emulation in robotics. In: Proceedings of SIMPAR, pp. 365–374 (2010)
Kehoe, B., Patil, S., Abbeel, P., Goldberg, K.: A survey of research on cloud robotics and automation. IEEE Trans. Autom. Sci. Eng. 12(2), 398–409 (2015)
Verner, I., Cuperman, D., Krishnamachar, A., Green S.: Learning with learning robots: a weight-lifting project. In: Robot Intelligence Technology and Applications, vol. 4, pp. 319–327. Springer (2017)
Harada, K., Kajita, S., Saito, H., Morisawa, M., Kanehiro, F., Fujiwara, K., Kaneko, K., Hirukawa, H.: A humanoid robot carrying a heavy object. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1712–1717 (2005)
Arisumi, H., Miossec, S., Chardonnet, J.R., Yokoi, K.: Dynamic lifting by whole body motion of humanoid robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 668–675 (2008)
Rosenstein, M.T., Barto, A.G., Van Emmerik, R.E.: Learning at the level of synergies for a robot Weightlifter. Robot. Auton. Syst. 54(8), 706–717 (2006)
Kuo, C.H., Kuo, Y.C., Chen, T.S.: Process modeling and task execution of FIRA weight-lifting games with a humanoid robot. In: Conference Towards Autonomous Robotic Systems, pp. 354–365. Springer, Heidelberg (2012)
Michieletto, S., Tosello, E., Pagello, E., Menegatti, E.: Teaching humanoid robotics by means of human teleoperation through RGB-D sensors. Robot. Auton. Syst. 75, 671–678 (2016)
Anderson, J., Baltes, J., Cheng, C.T.: Robotics competitions as benchmarks for AI research. Knowl. Eng. Rev. 26(1), 11–17 (2011)
Ahlgren, D.J., Verner, I.M.: Socially responsible engineering education through assistive robotics projects: the RoboWaiter competition. Int. J. Soc. Robot. 5(1), 127–138 (2013)
Verner, I.M., Cuperman, D., Cuperman, A., Ahlgren, D., Petkovsek, S., Burca, V.: Humanoids at the assistive robot competition RoboWaiter 2012. In: Robot Intelligence Technology and Applications 2012, pp. 763–774. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Verner, I., Cuperman, D., Fang, A., Reitman, M., Romm, T., Balikin, G. (2018). Robot Online Learning Through Digital Twin Experiments: A Weightlifting Project. In: Auer, M., Zutin, D. (eds) Online Engineering & Internet of Things. Lecture Notes in Networks and Systems, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-319-64352-6_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-64352-6_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-64351-9
Online ISBN: 978-3-319-64352-6
eBook Packages: EngineeringEngineering (R0)