Abstract
A natural interaction with appliances in smart environment is a highly desired form of controlling the surroundings using intuitively learned interpersonal means of communication. Hand and arm gestures, recognized by depth cameras, are a popular representative of this interaction paradigm. However they usually require stationary units that limit applicability in larger environments. To overcome this problem we are introducing a self-localizing mobile robot system that autonomously follows the user in the environment, in order to recognize performed gestures independent from the current user position. We have realized a prototypical implementation using a custom robot platform and evaluated the system with various users.
Chapter PDF
Similar content being viewed by others
References
Valli, A.: The design of natural interaction. Multimed. Tools Appl. 38, 295–305 (2008)
Braun, A., Kamieth, F.: Passive identification and control of arbitrary devices in smart environments. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part III, HCII 2011. LNCS, vol. 6763, pp. 147–154. Springer, Heidelberg (2011)
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. Commun. ACM. 56, 116–124 (2013)
Caon, M., Yue, Y., Tscherrig, J., Mugellini, E., Abou Khaled, O.: Context-aware 3d gesture interaction based on multiple kinects. In: Ambient 2011, First Int. Conf. Ambient Comput. Appl. Serv. Technol., pp. 7–12 (2011)
Forlizzi, J., Disalvo, C.: Service Robots in the Domestic Environment: A Study of the Roomba Vacuum in the Home. In: Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, pp. 258–265 (2006)
Graf, B., Parlitz, C., Hägele, M.: Robotic home assistant Care-O-bot® 3-product vision and innovation platform. In: Jacko, J.A. (ed.) HCI International 2009, Part II. LNCS, vol. 5611, pp. 312–320. Springer, Heidelberg (2009)
Tonin, L., Carlson, T., Leeb, R., Millán, J.d.R.: Brain-controlled telepresence robot by motor-disabled people. In: Conf. Proc. IEEE Eng. Med. Biol. Soc., pp. 4227–4230 (2011)
Nickel, K., Stiefelhagen, R.: Visual recognition of pointing gestures for human–robot interaction. Image Vis. Comput. 25, 1875–1884 (2007)
Grisetti, G., Stachniss, C., Burgard, W.: Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters. IEEE Trans. Robot. 23, 34–46 (2007)
Newcombe, R.A., Davison, A.J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., Fitzgibbon, A.: KinectFusion: Real-time dense surface mapping and tracking. In: Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 127–136. IEEE (2011)
Doisy, G., Jevti, A., Lucet, E., Edan, Y.: Adaptive Person-Following Algorithm Based on Depth Images and Mapping*. In: Proceedings of Workshop on Robot Motion Planning (2012)
Ko, N., Simmons, R.: The lane-curvature method for local obstacle avoidance. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1615–1621 (1998)
Gockley, R., Forlizzi, J., Simmons, R.: Natural person-following behavior for social robots. In: Proceeding of the ACM/IEEE International Conference on Human-Robot Interaction - HRI 2007, pp. 17–24. ACM Press, New York (2007)
Hiroi, Y., Matsunaka, S., Ito, A.: Mobile Robot System with Semi-Autonomous Navigation Using Simple and Robust Person Following Behavior. J. Man, Mach. Technol. 1, 44–62 (2012)
Majewski, M., Braun, A., Marinc, A., Kuijper, A.: Visual Support System for Selecting Reactive Elements in Intelligent Environments. In: International Conference on Cyberworlds, pp. 251–255 (2012)
Marinc, A., Stockloew, C., Tazari, S.: 3D Interaction in AAL Environments Based on Ontologies. Fourth Ambient Assisted Living Congress (2012)
Wilson, A., Shafer, S.: XWand: UI for intelligent spaces. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 545–552. ACM (2003)
Braun, A., Fischer, A., Marinc, A., Stocklöw, C., Majewski, M.: Context-based bounding volume morphing in pointing gesture applications. In: Kurosu, M. (ed.) Human-Computer Interaction, Part IV, HCII 2013. LNCS, vol. 8007, pp. 147–156. Springer, Heidelberg (2013)
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50, 174–188 (2002)
MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, p. 14 (1967)
Quigley, M., Conley, K.: ROS: An open-source Robot Operating System. ICRA Work. Open Source Softw. 3 (2009)
Fox, D., Burgard, W., Thrun, S.: The dynamic window approach to collision avoidance. IEEE Robot. Autom. Mag. 4, 23–33 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Prediger, M., Braun, A., Marinc, A., Kuijper, A. (2014). Robot-Supported Pointing Interaction for Intelligent Environments. In: Streitz, N., Markopoulos, P. (eds) Distributed, Ambient, and Pervasive Interactions. DAPI 2014. Lecture Notes in Computer Science, vol 8530. Springer, Cham. https://doi.org/10.1007/978-3-319-07788-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-07788-8_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07787-1
Online ISBN: 978-3-319-07788-8
eBook Packages: Computer ScienceComputer Science (R0)