skip to main content
10.1145/1514095.1514124acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
research-article

Mobile human-robot teaming with environmental tolerance

Published: 09 March 2009 Publication History

Abstract

We demonstrate that structured light-based depth sensing with standard perception algorithms can enable mobile peer-to-peer interaction between humans and robots. We posit that the use of recent emerging devices for depth-based imaging can enable robot perception of non-verbal cues in human movement in the face of lighting and minor terrain variations. Toward this end, we have developed an integrated robotic system capable of person following and responding to verbal and non-verbal commands under varying lighting conditions and uneven terrain. The feasibility of our system for peer-to-peer HRI is demonstrated through two trials in indoor and outdoor environments.

References

[1]
H. G. Barrow, J. M. Tenenbaum, R. C. Boles, and H. C. Wolf. Parametric correspondence and chamfer matching: Two new techniques for image matching. In IJCAI, pages 659--663, 1977.
[2]
Cepstral, 2008. http://www.cepstral.com.
[3]
C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/ cjlin/libsvm.
[4]
N. Dalal, B. Triggs, and C. Schmid. Human detection using oriented histograms of flow and appearance. In European Conference on Computer Vision, 2006.
[5]
R. Gockley, J. Forlizzi, and R. G. Simmons. Natural person-following behavior for social robots. In HRI, pages 17--24, 2007.
[6]
A. Haasch, S. Hohenner, S. Huwel, M. Kleinehagenbrock, S. Lang, I. Toptsis, G. Fink, J. Fritsch, B. Wrede, and G. Sagerer. BIRON - the bielefeld robot companion. In Int. Workshop on Advances in Service Robotics, pages 27--32, Stuttgart, Germany, 2004.
[7]
O. Jenkins, G. Gonzalez, and M. Loper. Interactive human pose and action recognition using dynamical motion primitives. International Journal of Humanoid Robotics, 4(2):365--385, Jun 2007.
[8]
W. G. Kennedy, M. Buga jska, M. Marge, W. Adams, P. Fransen, B. R., A. C. D., Schultz, and J. G. Trafton. Spatial representation and reasoning for human-robot collaboration. In Twenty-second National Conference on Artificial Intel ligence (AAAI-07), 2007.
[9]
S. Knoop, S. Vacek, and R. Dillmann. Sensor fusion for 3d human body tracking with an articulated 3d body model. In ICRA 2006: Proceedings 2006 IEEE International Conference on Robotics and Automation, pages 1686--1691, May 2006.
[10]
N. Ko jo, T. Inamura, K. Okada, and M. Inaba. Gesture recognition for humanoids using proto-symbol space. In Humanoid Robots, 2006 6th IEEE-RAS International Conference on, pages 76--81, 2006.
[11]
M. N. Nicolescu and M. J. Mataric. Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, pages 241--248. ACM Press, 2003.
[12]
M. Oren, C. Papageorigiou, P. Sinha, edgar Osuna, and T. Poggio. Pedestrian detection using wavelet templates. In Computer Vision and Pattern Recognition, pages 193--199, June 1997.
[13]
L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Readings in speech recognition, pages 267--296, 1990.
[14]
O. Rogalla, M. Ehrenmann, R. Zollner, R. Becher, and R. Dillmann. Using gesture and speech control for commanding a robot assistant. In Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication, pages 454--459, 2002.
[15]
P. E. Rybski, K. Yoon, J. Stolarz, and M. M. Veloso. Interactive robot task training through dialog and demonstration. In HRI '07: Proceeding of the ACM/IEEE international conference on Human-robot interaction, pages 49--56, New York, NY, USA, 2007. ACM Press.
[16]
D. Schulz. A probabilistic exemplar approach to combine laser and vision for person tracking. In Proceedings of Robotics: Science and Systems, Philadelphia, USA, August 2006.
[17]
H. Shimizu and T. Piggio. Direction estimation of pedestrian from multiple still images. In Intel ligent Vehicles Symposium, pages 596--600, June 2004.
[18]
C. Sminchisescu and A. Telea. Human pose estimation from silhouettes - a consistent approach using distance level sets. In WSCG International Conference on Computer Graphics,Visualization and Computer Vision, pages 413--420, 2002.
[19]
Sphinx-3, 2008. http://cmusphinx.sourceforge.net.
[20]
R. Stiefelhagen, C. Fugen, R. Gieselmann, H. Holzapfel, K. Nickel, and A. Waibel. Natural human-robot interaction using speech, head pose and gestures. In IEEE/RSJ International Conference Intel ligent Robots and Systems, volume 3, pages 2422--2427, Sendai, Japan, 2004.
[21]
SwissRanger specifications, 2008. http://www.swissranger.ch/main.php.
[22]
S. Thrun. Toward a framework for human-robot interaction. Human Computer Interaction, 19(1&2):9--24, 2004.
[23]
S. Waldherr, S. Thrun, and R. Romero. A gesture-based interface for human-robot interaction. Autonomous Robots, 9(2):151--173, 2000.

Cited By

View all
  • (2023)Literature Review on Recent Trends and Perspectives of Collaborative Robotics in Work 4.0Robotics10.3390/robotics1203008412:3(84)Online publication date: 7-Jun-2023
  • (2022)ROS-based remote control of industrial robot joystickProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science10.1177/09544062221115549237:1(160-169)Online publication date: 16-Aug-2022
  • (2022)Speed Maps: An Application to Guide Robots in Human EnvironmentsHuman-Friendly Robotics 202110.1007/978-3-030-96359-0_9(123-138)Online publication date: 16-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
March 2009
348 pages
ISBN:9781605584041
DOI:10.1145/1514095
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. gesture recognition
  2. human-robot interaction
  3. person following

Qualifiers

  • Research-article

Conference

HRI09
HRI09: International Conference on Human Robot Interaction
March 9 - 13, 2009
California, La Jolla, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Literature Review on Recent Trends and Perspectives of Collaborative Robotics in Work 4.0Robotics10.3390/robotics1203008412:3(84)Online publication date: 7-Jun-2023
  • (2022)ROS-based remote control of industrial robot joystickProceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science10.1177/09544062221115549237:1(160-169)Online publication date: 16-Aug-2022
  • (2022)Speed Maps: An Application to Guide Robots in Human EnvironmentsHuman-Friendly Robotics 202110.1007/978-3-030-96359-0_9(123-138)Online publication date: 16-Apr-2022
  • (2021)Recognition of human activity and the state of an assembly task using vision and inertial sensor fusion methods2021 22nd IEEE International Conference on Industrial Technology (ICIT)10.1109/ICIT46573.2021.9453672(919-924)Online publication date: 10-Mar-2021
  • (2019)Person-following for Telepresence Robots Using Web Cameras2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS40897.2019.8967645(2096-2101)Online publication date: Nov-2019
  • (2019)Human–robot interaction in industrial collaborative robotics: a literature review of the decade 2008–2017Advanced Robotics10.1080/01691864.2019.163671433:15-16(764-799)Online publication date: 4-Jul-2019
  • (2018)Context-aware robot navigation using interactively built semantic mapsPaladyn, Journal of Behavioral Robotics10.1515/pjbr-2018-00209:1(254-276)Online publication date: 6-Sep-2018
  • (2017)Classifying a Person’s Degree of Accessibility From Natural Body Language During Social Human–Robot InteractionsIEEE Transactions on Cybernetics10.1109/TCYB.2016.252036747:2(524-538)Online publication date: Feb-2017
  • (2017)Affective Human–Robot InteractionEmotions and Affect in Human Factors and Human-Computer Interaction10.1016/B978-0-12-801851-4.00015-X(359-381)Online publication date: 2017
  • (2016)Human Interaction With Robot Swarms: A SurveyIEEE Transactions on Human-Machine Systems10.1109/THMS.2015.248080146:1(9-26)Online publication date: Feb-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media