Abstract
The perception of affordances in unknown environments is an essential prerequisite for autonomous humanoid robots. In our previous work we developed a perceptual pipeline for the extraction of affordances for loco-manipulation actions based on a simplified representation of the environment starting from RGB-D camera images. The feasibility of this approach has been demonstrated in various examples in simulation as well as on real robotic platforms. The overall goal of the perceptual pipeline is to provide a robust and reliable perceptual mechanism for affordance-based action execution.
In this work we evaluate the performance of the perceptual pipeline in combination with sensor systems other than RGB-D cameras, in order to utilize redundant sensor equipment of humanoid robots. This is particularly important when considering challenging scenarios where particular sensors are not applicable, e.g. due to intense sunlight or reflective surfaces. In this work we focus on stereo cameras and LIDAR laser scanners.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
SE(3) denotes the special Euclidean group.
- 2.
WALK-MAN is equipped with a MultiSense SL sensor head from Carnegie Robotics containing a LIDAR sensor and a stereo camera system. The LIDAR scanner captures 1024 points per scan and was configured to rotate with 0.5 rad/sec. The stereo camera system produces point clouds using semi-global matching based on 1 Mpx camera images. No postprocessing filters have been applied in both cases.
- 3.
In our experiments, we chose \(\varepsilon = 0.1\).
References
Gibson, J.J.: The Ecological Approach to Visual Perception (1978)
Şahin, E., Çakmak, M., Doǧar, M.R., Uǧur, E., Üçoluk, G.: To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adapt. Behav. 15, 447 (2007)
Krüger, N., Geib, C., Piater, J., Petrick, R., Steedman, M., Wörgötter, F., Ude, A., Asfour, T., Kraft, D., Omrčen, D., Agostini, A., Dillmann, R.: Object-action complexes: grounded abstractions of sensorimotor processes. Robot. Auton. Syst. 59(10), 740–757 (2011)
Romay, A., Kohlbrecher, S., Conner, D.C., von Stryk, O.: Achieving versatile manipulation tasks with unknown objects by supervised humanoid robots based on object templates. In: IEEE-RAS International Conference on Humanoid Robots, pp. 249–255 (2015)
Fallon, M., Kuindersma, S., Karumanchi, S., Antone, M., Schneider, T., Dai, H., Pérez, C., D’Arpino, R., Deits, M., DiCicco, D., Fourie, T., Koolen, P., Marion, M., Posa, A., Valenzuela, K.-T., Yu, J., Shah, K., Iagnemma, R., Tedrake, R., Teller, S.: An architecture for online affordance-based perception and whole-body planning. J. Field Rob. 32(2), 229–254 (2015)
Hart, S., Dinh, P., Hambuchen, K.: The affordance template ROS package for robot task programming. In: IEEE International Conference on Robotics and Automation, pp. 6227–6234 (2015)
Fallon, M.F., Marion, P., Deits, R., Whelan, T., Antone, M., McDonald, J., Tedrake, R.: Continuous humanoid locomotion over uneven terrain using stereo fusion. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 881–888 (2015)
Stein, S.C., Schoeler, M., Papon, J., Wörgötter, F.: Object partitioning using local convexity. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 304–311 (2014)
Kaiser, P., Gonzalez-Aguirre, D., Schültje, F., Borràs, J., Vahrenkamp, N., Asfour, T.: Extracting whole-body affordances from multimodal exploration. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 1036–1043 (2014)
Kaiser, P., Vahrenkamp, N., Schültje, F., Borràs, J., Asfour, T.: Extraction of whole-body affordances for loco-manipulation tasks. Int. J. Human. Rob. (IJHR) 12(3), 155031 (2015)
Kaiser, P., Grotz, M., Aksoy, E.E., Do, M., Vahrenkamp, N., Asfour, T.: Validation of whole-body loco-manipulation affordances for pushability and liftability. In: IEEE/RAS International Conference on Humanoid Robots (Humanoids) (2015)
Vahrenkamp, N., Wächter, M., Kröhnert, M., Welke, K., Asfour, T.: The robot software framework armarx. Inf. Technol. 57(2), 99–111 (2015)
Kaiser, P., Aksoy, E.E., Grotz, M., Asfour, T.: Towards a hierarchy of loco-manipulation affordances. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2016)
Tsagarakis, N.G., Caldwell, D.G., Bicchi, A., Negrello, F., Garabini, M., Choi, W., Baccelliere, L., Loc, V., Noorden, J., Catalano, M., Ferrati, M., Muratore, L., Margan, A., Natale, L., Mingo, E., Dallali, H., Malzahn, J., Settimi, A., Rocchi, A., Varricchio, V., Pallottino, L., Pavan, C., Ajoudani, A., Lee, J., Kryczka, P., Kanoulas, D.: WALK-MAN: a high performance humanoid platform for realistic environments. J. Field Rob. (JFR) (2016)
Acknowledgments
The research leading to these results has received funding from the European Union Seventh Framework Programme under grant agreement no. 611832 (WALK-MAN).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Kaiser, P., Aksoy, E.E., Grotz, M., Kanoulas, D., Tsagarakis, N.G., Asfour, T. (2017). Experimental Evaluation of a Perceptual Pipeline for Hierarchical Affordance Extraction. In: Kulić, D., Nakamura, Y., Khatib, O., Venture, G. (eds) 2016 International Symposium on Experimental Robotics. ISER 2016. Springer Proceedings in Advanced Robotics, vol 1. Springer, Cham. https://doi.org/10.1007/978-3-319-50115-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-50115-4_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50114-7
Online ISBN: 978-3-319-50115-4
eBook Packages: EngineeringEngineering (R0)