Skip to main content
Springer Nature Link
Log in

Telerobotic system based on natural language and computer vision

  • 2 Modification Tasks
  • Conference paper
  • First Online:
Tasks and Methods in Applied Artificial Intelligence (IEA/AIE 1998)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1416))

  • 1677 Accesses

Abstract

Although telerobotic systems are becoming more complex, there are few actions they can perform on their own and, moreover, knowledge about the tasks they are being used for often relies only on their operator. In this paper, we present the design of a telerobotic system that features learning capabilities, can accept commands given in natural language and provides control of a generic vision-guided robot. This system is composed of a set of functional blocks that communicate among them according to the CORBA standard over an Internet-based network. Knowledge is originated from interaction with users and is stored in a shared database. The user interface translates user commands into a set of predefined commands that the robot controller can understand, making it unnecessary for users to know which particular robot they are working with. We describe the design of this system and focus on two of its main components: the user interface and the robot controller.

This work has been funded by CICYT (TAP 95-0710), Generalitat Valenciana (GV2214/94), Fundació Caixa-Castelló (PlA94-22) and ESPRIT (IOTA) project grants.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Hopper, D., Boddy, C., Reilly, D. “Human-Centered vs Task-Centered Design of Telerobotic Systems”. In Human-Oriented Design of Advanced Robotics Systems. A Postprint volume from the IFAC Workshop, edited by P. Kopacek, Pergamon, Elsevier Science, Vienna, Austria, 1995, pp. 7–12.

    Google Scholar 

  2. Goertz, R., Thompson, R. “Electronically Controlled Manipulator”. Nucleonics, 1954.

    Google Scholar 

  3. Goldberg, K., Mascha, M., Gentner, S., Rothenberg, N. “Desktop Teleoperation via the World Wide Web”. In Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, 1995.

    Google Scholar 

  4. Taylor, K., Trevelyan, J. “Australia's Telerobot on the Web”. In Proceedings of the 26th International Symposium on Industrial Robots, Singapore, 1995.

    Google Scholar 

  5. The Tele-Garden. http://telegarden.aec.at/

    Google Scholar 

  6. USC Interactive Art Museum. http://digimuse.usc.edu/robot/test/

    Google Scholar 

  7. Simmons, R.G. et al. “Xavier: Experience with a Layered Robot Architecture”. ACM magazine Intelligence, edited by Manuela M. Veloso, 1997. Also available via http://www.cs.cmu.edu/~Xavier/

    Google Scholar 

  8. Ishii, M., Saita, H. “A New Approach to Robot Teaching Method with Multimedia Tools”. In Human-Oriented Design of Advanced Robotics Systems. A Postprint volume from the IFAC Workshop, edited by P. Kopacek, Pergamon, Elsevier Science, Vienna, Austria, 1995, pp. 137–140.

    Google Scholar 

  9. Sheridan, T.B. Telerobotics, Automation and Human Supervisory Control. MIT Press, 1992.

    Google Scholar 

  10. Interesting Devices Connected to the Net. http://www.yahoo.com/Computers-and-Internet/Internet/Entertainment/ Interesting_Devices_Connected_to_the_let/Robots/

    Google Scholar 

  11. Hamilton, G., Cattell, R.G.G., Fisher, M. JDBC Database Access with Java. A Tutorial and Annotated Reference. The Java Series, JavaSoft Press, Addison-Wesley, 1997. ISBN: 0-201-30995-5.

    Google Scholar 

  12. Nelson, B.J., Papanikolopoulos, N.P., Khosla, P.K. “Robotic Visual Servoing and Robotic Assembly Tasks”. In IEEE Robotics and Automation Magazine, vol. 3, no. 2, June, 1996, pp. 23–31.

    Google Scholar 

  13. Sanz, P.J., Domingo, J., del Pobil, A.P., Pelechano, J. “An Integral Approach to Position a Robot Arm in a System for Planar Part Grasping”. In Advanced Manufacturing Forum, vol. 1, Special Issue on Applications of Artificial Intelligence, 1996, pp. 137–148.

    Google Scholar 

  14. Sanz, P.J., del Pobil, A.P., Iñesta, J.M., Recatalá, G. “Vision-Guided Grasping of Unknown Objects for Service Robots”. In Proceedings of the IEEE Conference on Robotics and Automation, Leuven, Belgium, 1998 (in press).

    Google Scholar 

  15. Hu, M.K. “Visual Pattern Recognition by Moment Invariants”. In IRE Transactions on Information Theory, vol. IT-8, 1962, pp. 179–187.

    Google Scholar 

  16. Peréz-Francisco, M., Martínez-Salvador, B., del Pobil, A.P. “Very Fast Collision Detection for Practical Motion Planning. Part II: The Parallel Algorithm”. In Proceedings of the IEEE Conference on Robotics and Automation, Leuven, Belgium, 1998 (in press).

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lucent Technologies Network Systems (Bell Laboratories), Madrid, Spain

    R. Marín

  2. Department of Computer Science, Jaume-I University, Penyeta Roja Campus, E-12071, Castellon, Spain

    G. Recatalá, P.J. Sanz, J.M. Iñesta & A.P. del Pobil

Authors
  1. R. Marín
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. Recatalá
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. P.J. Sanz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J.M. Iñesta
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A.P. del Pobil
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Angel Pasqual del Pobil José Mira Moonis Ali

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Marín, R., Recatalá, G., Sanz, P., Iñesta, J., del Pobil, A. (1998). Telerobotic system based on natural language and computer vision. In: Pasqual del Pobil, A., Mira, J., Ali, M. (eds) Tasks and Methods in Applied Artificial Intelligence. IEA/AIE 1998. Lecture Notes in Computer Science, vol 1416. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64574-8_421

Download citation

  • DOI: https://doi.org/10.1007/3-540-64574-8_421

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64574-0

  • Online ISBN: 978-3-540-69350-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics