Abstract
The Multimodal User Supervised Interface and Intelligent Control (MUSIIC) project addresses the issue of telemanipulation of everyday objects in an unstructured environment. Telerobot control by individuals with physical limitations pose a set of challenging problems that need to be resolved. MUSIIC addresses these problems by integrating a speech and gesture driven human-machine interface with a knowledge driven planner and a 3-D vision system. The resultant system offers the opportunity to study unstructured world telemanipulation by people with physical disabilities and provides means for generalizing to effective manipulation techniques for real-world unstructured tasks in domains where direct physical control may be limited due to time delay, lack of sensation, and coordination.
Preview
Unable to display preview. Download preview PDF.
References
A. Andreadis and P. Tsalides. Coloured object recognition using invariant spectral features. Intelligent and Robotic Systems, 13:93–106, 1995.
D. C. Bacon, T. Rahman, and W. S. Harwin, editors. Fourth International Confer-ence on Rehabilation Robotics, AI DuPont Institute, Wilmington, Delaware, USA, 1994. Applied Science and Engineering Laboratories.
A. Batavia and G. Hammer. Consumer criteria for evaluating assistive devices: Implications for technology transfer. In 12th annual Conference on Rehabilitation Technology, pages 194–195, Washington DC, 1989. RESNA Press.
Bath Institute of Medical Engineering. Fifth International Conference on Rehabilation Robotics, Bath University, Bath, UK, 1997.
S. Chai and W Tsai. Line segment matching for 3d /computer vision using a new iteration scheme. Machine Vision and Applications, 6:191–205, 1993.
C. Crangle, L. Liang, P. Suppes, and M. Barlow. Using English to instruct a robotic aid: An experiment in an office-like environment. In Proc. of the International Conference of the Association for the Advancement of Rehabilitation Technology (ICAART-88), pages 466–467, Montreal, Canada, 1988.
C. Crangle and P. Suppes. Language and Learning for Robots. CSLI Publications, Stanford, CA, 1994.
J. Cruz, G. Pajares, J. Aranda, and J. Vindel. Stereo matching technique based on the perceptron criterion function. Pattern Recognition Letters, 16(9):933–944,1995.
R. A. Foulds, editor. Interactive Robotics Aids-One Option for Independent Living: an International Perspective. Monograph 37. World Rehabilitation Fund, 1986.
R. A. Foulds. Multimodal user direction of a rehabilitation robot. In Rehabilitation Research Center on Robotics to Enhance the Functioning of Individuals with Disablities, volume 2, pages 41–61. Center for Applied Science and Engineering, University of Delaware, 1993.
C. Fu. An independent vocational workstation for a quadriplegic. In R. Foulds, editor, Interactive Robotics Aids-One Option for Independent Living: an International Perspective, Monograph 37, page 42. World Rehabilitation Fund, 1986.
M. Gilbert and R. Foulds. Robotics at the Tufts New England Medical Center. In 10th Annual Conference on Rehabilitation Engineering, pages 778–780, San Jose, California, 1987. RESNA Press.
M. Gilbert and J Trefsager, editors. Proceedings of the 1990 International Conference on Rehabilitation Robotics, Wilmington, Delaware, 1990. Applied Science and Engineering Laboratories.
J. Hammel, M. Van der Loos, and I. Perkash. Evaluation of DeVAR-IV with a quadriplegic employee. Technical report, Rehabilitation Research and Development Center, Palo Alto, California, 1991.
R. Haralich. Computer and Robot Vision. Addison-Wesley, 1993.
W. Harwin, A. Ginige, and R. Jackson. A potential application in early education and a possible role for a vision system in a workstation based robotic aid for physically disabled persons. In R Foulds, editor, Interactive Robotic Aids-One Option for Independent Living: An International Perspective, Monograph 37, pages 18–23. World Rehabilitation Fund, 1986.
Z. Kazi. Integrating Human-Computer Interaction with Planning for a Telerobotic System. PhD thesis, University of Delaware, Department of Computer and Information Sciences, 1997.
H. Kwee, M. Thonninsen, G. Cremers, J. Duimel, and R. Westgeest. Configuring the Manus system. In RESNA International Conference, 1992, pages 584–587,Toronto, Canada, 1992. RESNA Press.
J. Li and T. Schenk. Stereo image matching with sub-pixel accuracy. Technical paper, ACSM ASPRS, 1991.
D. McNeill. Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, 1982.
S. Michalowski, C. Crangle, and L. Liang. Experimental study of a natural language interface to an instructable robotic aid for the severely disabled. In 10th Annual Conference on Rehabilitation Technology, pages 466–467, Washington, DC, 1987.RESNA Press.
M. Okutomi and T. Kanade. A stereo matching algorithm: an adaptive window based statistical model. Systems and Computers in Japan, 23(8):26–35, 1992.
B. Ross. A practical stereo vision system. In IEEE Computer Vision and Pattern Recognition, pages 148–153, 1993.
E. D. Sacerdoti. The non-linear nature of plans. In International Joint Conference on Artificial Intelligence, pages 1123–1145, Tbilisi, USSR, 1975.
E. D. Sacerdoti. A Structure for Plans and Behaviour. American Elsevier, New York, 1977.
W. Seamone and G. Schmeisser. Evaluation of the APL/JHU robotic arm workstation. In R. Foulds, editor, Interactive Robotics Aids-One Option for Independent Living: an International Perspective, Monograph 37, page 51. World Rehabilitation Fund, 1986.
C. A. Stanger, C. Anglin, W. S. Harwin, and D. P. Romilly. Devices for assisting manipulation: A summary of user task priorities. IEEE Transactions on Rehabilitation Engineering, 2(4):256–265, 1994.
C. Stewart and J. MacCrone. Experimental analysis of a number of stereo matching components using lma. In International Conference on Pattern Recognition, volume 1, pages 254–258, 1990.
S. Tominaga. Colour classification method for color images using uniform colour space. In IEEE International Conference on Pattern Recognition, pages 803–807, 1990.
M. Van der Loos, J. Hammel, D. Lees, D. Chang, I. Perkash, and L. Leifer. Voice controlled robot systems as a quadriplegic programmer's assistant. In 13th Annual RESNA Conference, pages 327–328, Washington DC, June 1990. RESNA Press.
T. Vlachos and A. Constantinides. Graph theoretical approach to colour picture segmentation. In IEEE Part 1, pages 36–45, 1993.
L. Wolff and E. Angelopoulou. Three-dimensional stereo by photometric ratios.Journal of the Optical Society of America: Optics and Image Science and Vision, 11(11):3069–3078, November 1994.
A. Zeelenberg. Domestic use of a training robot-manipulator by children with muscular dystrophy. In R. Foulds, editor, Interactive Robotic Aids-One Option for Independent Living: An International Perspective, Monograph 37, pages 29–33. World Rehabilitation Fund, 1986.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kazi, Z., Chen, S., Beitler, M., Chester, D., Foulds, R. (1998). Speech and gesture mediated intelligent teleoperation. In: Mittal, V.O., Yanco, H.A., Aronis, J., Simpson, R. (eds) Assistive Technology and Artificial Intelligence. Lecture Notes in Computer Science, vol 1458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055979
Download citation
DOI: https://doi.org/10.1007/BFb0055979
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64790-4
Online ISBN: 978-3-540-68678-1
eBook Packages: Springer Book Archive