skip to main content
10.1145/860575.860766acmconferencesArticle/Chapter ViewAbstractPublication PagesaamasConference Proceedingsconference-collections
Article

Decision-theoretic active sensing for autonomous agents

Published:14 July 2003Publication History

ABSTRACT

Classification is a sub-task common to many problems faced by autonomous agents. Traditional treatment of classification in the Machine Learning literature assumes that a feature vector is given as input. This ignores the essential role of an autonomous agent as a proactive information gatherer. In this paper, we present a framework for making optimal sensing and information gathering decisions with respect to classification goals by formulating the problem as a partially observable Markov decision process and solving for the optimal policy. We demonstrate the utility of this approach on a simulated meteorite collection task faced by an autonomous rover.

References

  1. M. Littman. A. Cassandra and N. Zhang. Incremental pruning: A simple, fast, exact algorithm for partially observable Markov decision processes. In Proceedings of the Thirteenth Annual Conference on Uncertainty in Artificial Intelligence, 1997.Google ScholarGoogle Scholar
  2. W. Lovejoy. A survey of algorithmic methods for partially observed Markov decision processes. Annals of Operations Research, 28(1):47--65, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. P. Maes. Artificial life meets entertainment: Lifelike autonomous agents. Communications of the ACM, 38(11):108--114, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Decision-theoretic active sensing for autonomous agents

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      AAMAS '03: Proceedings of the second international joint conference on Autonomous agents and multiagent systems
      July 2003
      1200 pages
      ISBN:1581136838
      DOI:10.1145/860575

      Copyright © 2003 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 14 July 2003

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate1,155of5,036submissions,23%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader