Christopher Dale McMurrough
ABSTRACT
This paper presents an outline of dissertation research activities which aim to advance the use of non-traditional, multimodal interfaces in assistive robotic devices. The data modalities which are of particular interest in the work are perception of the environment using 3D scanning and computer vision, estimation of the user point of gaze, and perception of user intent during interaction with objects of interest. The main goal of this research is to explore the hypothesis that the combination of these data modalities can be used to provide intuitive and effective means of control over existing robotic platforms, such as wheelchairs and manipulators, to users with severe physical impairments.
- G. Galatas, C. McMurrough, G. L. Mariottini, and F. Makedon. eyeDog. In Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments - PETRA '11, volume 10, New York, New York, USA, 2011. ACM Press. Google Scholar
Digital Library
- D. Li, J. Babcock, and D. J. Parkhurst. openEyes: a low-cost head-mounted eye-tracking solution. In Proceedings of the 2006 symposium on Eye tracking research & applications - ETRA '06, page 95, New York, New York, USA, 2006. ACM Press. Google ScholarDigital Library
- Z. Lieberman, C. Sugrue, T. Watson, J. Powderly, E. Roth, and T. Quan. The EyeWriter, 2009.Google Scholar
- C. Mcmurrough, A. Papangelis, and A. Boisselle. A Survey of Assistive Devices for Cerebral Palsy Patients. In Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments - PETRA '12, 2012. Google ScholarDigital Library
- C. McMurrough, J. Rich, V. Metsis, A. Nguyen, and F. Makedon. Low-cost Head Position Tracking for Gaze Point Estimation. In Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments - PETRA '12, 2012. Google ScholarDigital Library
- C. D. McMurrough, V. Metsis, J. Rich, and F. Makedon. An eye tracking dataset for point of gaze detection. In Proceedings of the Symposium on Eye Tracking Research and Applications - ETRA '12, page 305, New York, New York, USA, 2012. ACM Press. Google ScholarDigital Library
- C. D. McMurrough, J. Rich, C. Conly, V. Athitsos, and F. Makedon. Multi-Modal Object of Interest Detection Using Eye Gaze and RGB-D Cameras. 2012.Google Scholar
- D. Milner and M. Goodale. The Visual Brain in Action. Oxford University Press, Oxford, UK, 2nd edition, 2006.Google Scholar
- V. Pasian, F. Corno, I. Signorile, and L. Farinetti. The Impact of Gaze Controlled Technology on Quality of Life. In Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies, chapter 6, pages 48--54. IGI Global, 2012.Google ScholarCross Ref
- F. Pirri, M. Pizzoli, and A. Rudi. A general method for the point of regard estimation in 3D space. In CVPR 2011, pages 921--928. IEEE, June 2011. Google ScholarDigital Library
- J. San Agustin, H. Skovsgaard, J. P. Hansen, and D. W. Hansen. Low-cost gaze interaction: ready to deliver the promises. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems - CHI EA '09, page 4453, New York, New York, USA, 2009. ACM Press. Google ScholarDigital Library
- K. Takemura, Y. Kohashi, T. Suenaga, J. Takamatsu, and T. Ogasawara. Estimating 3D point-of-regard and visualizing gaze trajectories under natural head movements. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications - ETRA '10, volume 1, page 157, New York, New York, USA, 2010. ACM Press. Google ScholarDigital Library
- D. Winfield and D. Parkhurst. Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, volume 3, pages 79--79. IEEE. Google ScholarDigital Library
Index Terms
- Multi-modal interfaces for control of assistive robotic devices
Recommendations
Vocal Interaction with a 7-DOF Robotic Arm for Object Detection, Learning and Grasping
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot InteractionThis work presents preliminary results on the de- velopment of a system for multimodal interaction between a user and a robotic arm for human-robot cooperation tasks. In particular the system allows the user to ask the robot to grasp objects lying on a ...
A multi-modal perception based assistive robotic system for the elderly
We present a complete multi-modal perception driven non-intrusive domestic robotic system for the elderly.We present a novel multi-modal user's intention-for-interaction detection modality.A fusion method to improve the speech recognition given the user'...
Assistive Robots for Persons with Visual Impairments: Current Research and Open Challenges
PETRA '23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive EnvironmentsRobots have the potential to support persons with different abilities, including individuals with blindness or visual impairments (BVI). This paper aims to investigate the current developments in robotic research that focus on BVI robotic users and ...
Comments