skip to main content
10.1145/1865909.1865931acmotherconferencesArticle/Chapter ViewAbstractPublication PagespermisConference Proceedingsconference-collections
research-article

The role of competitions in advancing intelligent systems: a practitioner's perspective

Authors Info & Claims
Published:21 September 2009Publication History

ABSTRACT

In recent years, the number of competitions in the robotic domain has increased tremendously. This growth is spurred by the appealing nature of robots, the flexibility that they afford in competition themes due to the practically unlimited applications, and by the recognition that competitions can yield advances in a technological domain that is immature. The National Institute of Standards and Technology has supported a variety of competitions to help stimulate innovation in certain critical technologies and capabilities needed in robotics. In this paper we present some general views of competitions and discuss the experiences NIST has had with robotics competitions as catalysts for advancing the state of intelligent systems. This paper is a lead-in to others in a special session organized at the 2010 Performance Metrics for Intelligent Systems (PerMIS) workshop that describe in more detail how competitions are used to advance intelligent systems.

References

  1. http://www.marcthorpe.com/robot.htmlGoogle ScholarGoogle Scholar
  2. http://www.battlebots.com/BattleBots.com/Home/Home.htmlGoogle ScholarGoogle Scholar
  3. http://www.usfirst.org/Google ScholarGoogle Scholar
  4. http://micromouse.cannock.ac.uk/history.htmGoogle ScholarGoogle Scholar
  5. Braünl. T., Research Relevance of Mobile Robot Competitions, in IEEE Robotics and Automation Magazine, Vol. 6, no. 4, Dec 1999, pp 32--76. Balch T. and Yanco, H., Ten Years of the AAAI Mobile Robot Competition and Exhibition, AI Magazine, Vol. 23, No. 1 (Spring 2002).Google ScholarGoogle ScholarCross RefCross Ref
  6. Miller, D., Using robotics to teach computer programming and AI concepts to engineering students. In Accessible Hands-on Artificial Intelligence and Robotics Education, AAAI Spring Symposium, 2005.Google ScholarGoogle Scholar
  7. http://www.auvsi.org/AUVSI/AUVSI/Events/AUVSIStudentCompetitions/Google ScholarGoogle Scholar
  8. Seetharaman, G. Lakhotia, A. Blasch, E. P., Unmanned Vehicles Come of Age: The DARPA Grand Challenge, Computer, Volume: 39, Issue: 12, December, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Buehler, M., Iagnemma, K., and Singh, S., Editorial, Journal of Field Robotics, Special Issue on the 2007 DARPA Urban Challenge, Part I, Volume 25 Issue 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Yanco. H., "Designing Metrics for Comparing the Performance of Robotic Systems in Robot Competitions, " In Proceedings of the Workshop on Measuring Performance and Intelligence of Intelligent Systems (PerMIS), IEEE Conference on Control Applications, Mexico City, Mexico, September 2001.Google ScholarGoogle Scholar
  11. Balch T. and Yanco, H., "Ten Years of the AAAI Mobile Robot Competition and Exhibition," AI Magazine, Vol. 23, No. 1 (Spring 2002) Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Kitano, H., Kuniyoshi, Y., Noda, I., Asada, M., Matsubara, H., and Osawa, E., RoboCup: A challenge problem for AI. AI Magazine, 18(1):73--85, Spring 1997.Google ScholarGoogle Scholar
  13. E. Pagello, E. Menegatti, A. Bredenfel, P. Costa, T. Christaller, A. Jacoff, D. Polani, M. Riedmiller, A. Saffiotti, E, Sklar, and T. Tomoichi, "RoboCup-2003 New Scientific and Technical Advances", AI Magazine, Volume 25, No. 2, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jacoff, A., Messina, E., Evans, J., "A Standard Test Course for Urban Search and Rescue Robots," Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) Workshop, NIST SP 970, August 2000.Google ScholarGoogle Scholar
  15. Kitano, H. and Tadokoro, S., "RoboCup Rescue: A Grand Challenge for Multiagent and Intelligent Systems," AI Magazine, Volume 22, No. 1, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  16. http://www.robocuprescue.org/Google ScholarGoogle Scholar
  17. S. Balakirsky, S. Carpin, and A. Visser, "Evaluating The RoboCup 2009 Virtual Robot Rescue Competition," Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) Workshop, Gaithersburg, MD, September 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Messina, E., "Performance Standards for Urban Search & Rescue Robots: Enabling Deployment of New Tools for Responders," Defense Standardization Program Office Journal, July/December 2007, pp. 43--48.Google ScholarGoogle Scholar
  19. Balakirsky, S. and Madhavan, R., "Advancing Manufacturing Research Through Competitions," Proceedings of the SPIE Defense Security and Sensing, Orlando, FL, April 13--17, 2009.Google ScholarGoogle Scholar
  20. L. Almeida, J. Azevedo, C. Cardeira, P. Costa, P. Fonseca, P. Lima, F. Ribeiro, V. Santos, "Mobile Robot Competitions: Fostering Advances in Research, Development, and Education in Robotics," in Proceedings of CONTROLO'2000, the 4th Portuguese Conference on Automatic Control, Guimarães, 2000Google ScholarGoogle Scholar

Index Terms

  1. The role of competitions in advancing intelligent systems: a practitioner's perspective

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      PerMIS '09: Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
      September 2009
      322 pages
      ISBN:9781605587479
      DOI:10.1145/1865909

      Copyright © 2009 This paper is authored by employees of the United States Government and is in the public domain.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 September 2009

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader