skip to main content
article

Efficient reasoning

Published:01 March 2001Publication History
Skip Abstract Section

Abstract

Many tasks require “reasoning”—i.e., deriving conclusions from a corpus of explicitly stored information—to solve their range of problems. An ideal reasoning system would produce all-and-only the correct answers to every possible query, produce answers that are as specific as possible, be expressive enough to permit any possible fact to be stored and any possible query to be asked, and be (time) efficient. Unfortunately, this is provably impossible: as correct and precise systems become more expressive, they can become increasingly inefficient, or even undecidable. This survey first formalizes these hardness results, in the context of both logic- and probability-based reasoning, then overviews the techniques now used to address, or at least side-step, this dilemma.

References

  1. AAAI. 1992. Workshop on Approximation and Abstraction of Computational Theories. Tech. Rep., AAAI.Google ScholarGoogle Scholar
  2. ABDELBAR,A.M.,AND HEDETNIEMI, S. M. 1998. Approximating MAPs for belief networks is NP- hard and other theorems. Artificial Intelligence 102, 21-38. Google ScholarGoogle Scholar
  3. ALCHOURR ON, C. E., G ARDENFORS,P.,AND MAKIN- SON, D. 1985. On the logic of theory change: partial meet contraction and revision functions. Journal of Symbolic Logic 50, 510- 30.Google ScholarGoogle Scholar
  4. ANDERSEN, S. K., OLESEN,K.G.,JENSEN,F.V.,AND JENSEN, F. 1989. HUGIN-a shell for building Bayesian belief universes for expert systems. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89), Detroit, Michigan, Aug. 1989. Morgan Kaufmann, San Mateo, CA, vol. 2, 1080- 1085.Google ScholarGoogle Scholar
  5. ARNBORG, S. 1985. Efficient algorithms for combinatorial problems on graphs with bounded decomposability-a survey. BIT 25, 2-33. Google ScholarGoogle Scholar
  6. AZEVEDO, P. J. 1997. Magic sets with full sharing. Journal of Logic Programming 30, 3 (March), 223-237.Google ScholarGoogle Scholar
  7. BACCHUS, F., GROVE, A., HALPERN,J.,AND KOLLER, D. 1996. From statistical knowledge bases to degrees of belief. Artificial Intelligence 87, 75- 143. Google ScholarGoogle Scholar
  8. BARKER, V. E., O'CONNOR, D. E., BACHANT,J.,AND SOLOWAY, E. 1989. Expert systems for configuration at Digital: XCON and beyond. Communications of the ACM 32, 3 (March), 298- 318. Google ScholarGoogle Scholar
  9. BEINLICH, I. A., SUERMONDT,H.J.,CHAVEZ,R.M.,AND COOPER, G. F. 1989. The ALARM monitoring system: a case study with two probabilistic inference techniques for belief networks. In Proceedings of the Second European Conference on Artificial Intelligence in Medicine, London, Aug. 1989. Springer, Berlin.Google ScholarGoogle Scholar
  10. BOBROW. 1980. Artificial intelligence. Special Issue on Non-Monotonic Logic.Google ScholarGoogle Scholar
  11. BOROS, E., CRAMA,Y.,AND HAMMER, P. 1990. Polynomial-time inference of all valid implications for horn and related formulae. Annals of Mathematics and Artificial Intelligence 1, 21- 32.Google ScholarGoogle Scholar
  12. BRACEWELL, R. N. 1978. The Fourier Transform and Its Applications. McGraw-Hill, New York.Google ScholarGoogle Scholar
  13. BROWNSTON, L., FARRELL, R., KANT, E., AND MARTIN, N. 1986. Programming Expert Systems in OPS-5. Addison-Wesley, Reading, MA. Google ScholarGoogle Scholar
  14. CHANG, C.-L. AND LEE, R. C.-T. 1973. Symbolic Logic and Mechanical Theorem Proving. Academic Press, New York. Google ScholarGoogle Scholar
  15. CHARNIAK, E. 1991. Bayesian networks without tears. AI Magazine 12, 50-63. Google ScholarGoogle Scholar
  16. CHAUDHRI,V.AND GREINER, R. 1992. A formal analysis of solution caching. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, 1992.Google ScholarGoogle Scholar
  17. CHOW,C.K.AND LUI, C. N. 1968. Aproximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory 14, 3, 462-467.Google ScholarGoogle Scholar
  18. CLARK, K. 1978. Negation as failure. In Logic and Data Bases, H. Gallaire and J. Minker Eds. Plenum Press, New York, 293-322.Google ScholarGoogle Scholar
  19. CLOCKSIN,W.F.AND MELLISH, C. S. 1981. Programming in Prolog. Springer, New York. Google ScholarGoogle Scholar
  20. COOPER, G. 1990. The computational complexity of probabilistic inference using Bayesian belief networks. Artificial Intelligence 42, 2-3, 393- 405. Google ScholarGoogle Scholar
  21. COUSINS, S., CHEN,W.,AND FRISSE, M. 1993. A tutorial introduction to stochastic simulation algorithms for belief networks. Artificial Intelligence in Medicine 5, 315-340.Google ScholarGoogle Scholar
  22. DAGUM,P.AND LUBY, M. 1993. Approximating probabilistic inference in bayesian belief networks is NP-hard. Artificial Intelligence 60, 1 (March), 141-153. Google ScholarGoogle Scholar
  23. DAGUM,P.AND LUBY, M. 1997. An optimal approximation algorithm for bayesian inference. Artificial Intelligence 93, 1-27. Google ScholarGoogle Scholar
  24. DALAL,M.AND ETHERINGTON, D. W. 1992a. Tractable approximate deduction using limited vocabulary. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, May 1992.Google ScholarGoogle Scholar
  25. DALAL,M.AND ETHERINGTON, D. W. 1992b. A hierarchy of tractable satisfiability problems. Information Processing Letters 44, 4 (Dec.), 173-180. Google ScholarGoogle Scholar
  26. DARWICHE,A.AND PROVAN, G. M. 1996. Query dags: a practical paradigm for implementing belief network inference. In Proc. Uncertainty in AI. Google ScholarGoogle Scholar
  27. DARWICHE,A.AND PROVAN, G. M. 1997. A standard approach for optimizing belief network inference using query dags. In Proc. Uncertainty in AI. Google ScholarGoogle Scholar
  28. DECHTER, R. 1996. Topological parameters for timespace tradeoff. In Proc. Uncertainty in AI, San Francisco, 1996, E. Horvitz and F. Jensen, Eds. Morgan Kaufmann, San Maeto, CA, 220- 227. Google ScholarGoogle Scholar
  29. DECHTER, R. 1998. Bucket elimination: a unifying framework for probabilistic inference. In Learning and Inference in Graphical Models. Google ScholarGoogle Scholar
  30. DECHTER,R.AND RISH, I. 1997. A scheme for approximating probabilistic inference. In Proc. Uncertainty in AI. Google ScholarGoogle Scholar
  31. DELCHER, A. L., GROVE, A., KASIF,S.,AND PEARL, J. 1996. Logarithmic-time updates and queries in probabilistic networks. J. Artificial Intelligence Research 4, 37-59. Google ScholarGoogle Scholar
  32. DONINI, F. M., LENZERINI, M., NARDI,D.,AND NUTT,W. 1997. The complexity of concept languages. Information and Computation 134, 1 (10 April), 1- 58. Google ScholarGoogle Scholar
  33. DOWLING,W.F.AND GALLIER, J. H. 1984. Linear time algorithms for testing the satisfiability of propositional horn formula. Journal of Logic Programming 3, 267-84.Google ScholarGoogle Scholar
  34. DOYLE,J.AND PATIL, R. 1991. Two theses of knowledge representation: language restrictions, taxonomic classification, and the utility of representation services. Artificial Intelligence 48, 3, 261- 297. Google ScholarGoogle Scholar
  35. DRAPER,D.L.AND HANKS, S. 1994. Localized partial evaluation of belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MANTARAS AND D. POOLE, Eds. Morgan Kaufmann, San Maeto, CA, 170- 177.Google ScholarGoogle Scholar
  36. ELLMAN, T. 1993. Abstraction via approximate symmetry. In IJCAI-93.Google ScholarGoogle Scholar
  37. ENDERTON, H. B. 1972. AMathematical Introduction to Logic. Academic Press, New York.Google ScholarGoogle Scholar
  38. FELLER, W. 1966. An Introduction to Probability Theory and Its Applications II. John Wiley, New York.Google ScholarGoogle Scholar
  39. FINDLER, N. V., Ed. 1979. Associative Networks: Representation and Use of Knowledge by Computers. Academic Press, New York. Google ScholarGoogle Scholar
  40. FREUDER, E. C. 1996. Principles and Practice of Constraint Programming. Springer, New York. Google ScholarGoogle Scholar
  41. FRIEDMAN, N., GEIGER,D.,AND GOLDSZMIDT, M. 1997. Bayesian network classifiers. Machine Learning 29, 131-163. Google ScholarGoogle Scholar
  42. GAREY,M.R.AND JOHNSON, D. S. 1979. Computers and Intractability: A Guide to the Theory of NP- Completeness. W. H. Freeman, New York. Google ScholarGoogle Scholar
  43. GENESERETH,M.R.AND NILSSON, N. J. 1987. Logical Foundations of Artificial Intelligence. Morgan Kaufmann, Los Altos, CA. Google ScholarGoogle Scholar
  44. GENESERETH,M.R.AND FIKES, R. E. 1992. Knowledge Interchange Format, Version 3.0 Reference Manual. Tech. Rep. Logic-92-1 (June), Computer Science Dept., Stanford Univ.Google ScholarGoogle Scholar
  45. GHAHRAMANI,Z.AND JORDAN, M. I. 1997. Factorial hidden markov models. Machine Learning 29, 245. Google ScholarGoogle Scholar
  46. GINSBERG, M. 1987. Readings in Nonmonotonic Reasoning. Morgan Kaufmann, Los Altos, CA. Google ScholarGoogle Scholar
  47. GINSBERG, M. L. 1991. Knowledge Interchange Format: The KIF of Death. Tech. Rep., Stanford Univ.Google ScholarGoogle Scholar
  48. GRATCH,J.AND DEJONG, G. 1996. Adecisiontheoretic approach to adaptive problem solving. Artificial Intelligence 88, 1-2, 365-396. Google ScholarGoogle Scholar
  49. GREINER, R. 1991. Finding the optimal derivation strategy in a redundant knowledge base. Artificial Intelligence 50, 1, 95-116. Google ScholarGoogle Scholar
  50. GREINER, R. 1996. PALO: a probabilistic hillclimbing algorithm. Artificial Intelligence 83,1- 2 (July), 177-204. Google ScholarGoogle Scholar
  51. GREINER, R. 1999. Explanation-based learning. In The Encyclopedia of Cognitive Science,R.WILSON AND F. KEIL, Eds. MIT Press, Cambridge, MA, 301-303. A Bradford Book.Google ScholarGoogle Scholar
  52. GREINER,R.AND ELKAN, C. 1991. Measuring and improving the efiectiveness of representations. In Proceedings of the Twelfth International Joint Conference on Artificial Intelligence, Sydney, Australia, Aug. 1991, 518-524.Google ScholarGoogle Scholar
  53. GREINER,R.AND SCHUURMANS, D. 1992. Learning useful horn approximations. In Proceedings of KR-92, San Mateo, CA, Oct. 1992, B. NEBEL, C. RICH, AND W. SWARTOUT, Eds. Morgan Kaufmann, San Mateo, CA.Google ScholarGoogle Scholar
  54. GREINER, R., GROVE, A., AND SCHUURMANS, D. 1997. Learning Bayesian nets that perform well. In Uncertainty in Artificial Intelligence. Google ScholarGoogle Scholar
  55. HALPERN, J. Y. 1990. An analysis of first-order logics of probability. Artificial Intelligence 46, 3 (Dec.), 311-350. Google ScholarGoogle Scholar
  56. HECKERMAN, D. 1991. Probabilistic Similarity Networks. MIT Press, Cambridge, MA. Google ScholarGoogle Scholar
  57. HECKERMAN, D. E. 1995. A Tutorial on Learning with Bayesian Networks. Tech. Rep. MSR-TR- 95-06, Microsoft Research.Google ScholarGoogle Scholar
  58. HERSKOVITS,E.H.AND COOPER, C. 1991. Algorithms for Bayesian Belief-network Precomputation. In Methods of Information in Medicine.Google ScholarGoogle Scholar
  59. HOOS,H.H.AND STUTZLE, T. 1998. Evaluating las vegas algorithms-pitfalls and remedies. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA. Google ScholarGoogle Scholar
  60. HORVITZ,E.J.,SUERMONDT,H.J.,AND COOPER,G.F. 1989. Bounded conditioning: flexible inference for decisions under scarce resources. In Proceedings of the Fifth Conference on Uncertainty in Artificial Intelligence (UAI-89), Windsor, Ontario, 1989. Morgan Kaufmann, San Mateo, CA, 182- 193.Google ScholarGoogle Scholar
  61. JAAKKOLA,T.S.AND JORDAN, M. I. 1996a. Computing upper and lower bounds on likelihoods in intractable networks. In Proc. Uncertainty in AI. Google ScholarGoogle Scholar
  62. JAAKKOLA,T.S.AND JORDAN, M. I. 1996b. Recursive algorithms for approximating probabilities in graphical models. Tech. Rep. 9604 (June), MIT Computational Cognitive Science.Google ScholarGoogle Scholar
  63. JENSEN,F.V.,LAURITZEN,S.L.,AND OLESEN, K. G. 1990. Bayesian updating in causal probabilistic networks by local computations. SIAM Journal on Computing 4, 269-282.Google ScholarGoogle Scholar
  64. KAUTZ,H.AND SELMAN, B. 1996. Pushing the envelope: planning, propositional logic and stochastic search. In Proceedings AAAI96, Menlo Park, Aug. 1996. AAAI Press/MIT Press, Cambridge, MA, 1194-1201. Google ScholarGoogle Scholar
  65. KAUTZ, H., KEARNS, M., AND SELMAN, B. 1993. Reasoning with characteristic models. In AAAI-93, 34-39.Google ScholarGoogle Scholar
  66. KHARDON,R.AND ROTH, D. 1994. Reasoning with models. In AAAI-94, 1148-1153. Google ScholarGoogle Scholar
  67. KJARULFF, U. 1994. Reduction of computational complexity in Bayesian networks through removal of weak dependences. In Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference, Seattle, WA, 1994, R. L. DE MANTARAS AND D. POOLE, Eds.Google ScholarGoogle Scholar
  68. KOLLER,D.AND PFEFFER, A. 1997. Learning probabilities for noisy first-order rules. In Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI), Nagoya, Japan, Aug. 1997. Google ScholarGoogle Scholar
  69. KOLLER, D., LEVY, A., AND PFEFFER, A. 1997. P- classic: a tractable probabilistic description logic. In Proceedings of the 14th National Conference on Artificial Intelligence (AAAI), Providence, Rhode Island, Aug. 1997. Google ScholarGoogle Scholar
  70. KONDRAK,G.AND VAN BEEK, P. 1997. A theoretical evaluation of selected backtracking algorithms. Artificial Intelligence 89, 365- 387. Google ScholarGoogle Scholar
  71. LAURITZEN,S.AND SPIEGELHALTER, D. J. 1988. Local computations with probabilities on graphical structures and their application to expert systems (with discussion). Journal of the Royal Statistical Society series B 50, 157-224. Reprinted in (Shafer and Pearl 1990).Google ScholarGoogle Scholar
  72. LEPAR,V.AND SHENOY, P. P. 1998. A comparison of lauritzen-spiegelhalter, hugin, and shenoy-shafer architectures for computing marginals of probability distributions. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA. Google ScholarGoogle Scholar
  73. LEVESQUE, H. J. 1984. Foundations of a functional approach to knowledge representation. Artificial Intelligence 23, 155-212. Google ScholarGoogle Scholar
  74. LEVESQUE,H.AND BRACHMAN, R. 1985. A fundamental tradeoff in knowledge representation and reasoning. In Readings in Knowledge Representation, Los Altos, CA, 1985, R. BRACHMAN AND H.Google ScholarGoogle Scholar
  75. LEVESQUE, Eds. Morgan Kaufmann, San Mateo, CA. 41-70.Google ScholarGoogle Scholar
  76. LI,Z.AND D'AMBROSIO, B. 1994. Efficient inference in bayes nets as a combinatorial optimization problem. International Journal of Approximate Reasoning 11, 1, 55-81.Google ScholarGoogle Scholar
  77. LIU, C.-L. AND WELLMAN, M. P. 1997. On statespace abstraction for anytime evaluation of bayesian network. Sigart Bulletin 7,2. Google ScholarGoogle Scholar
  78. MAREK,W.AND TRUSZCZY' NSKI, M. 1989. Relating autoepistemic and default logics. In Proceedings of the 1st International Conference on Principles of Knowledge Representation and Reasoning, Toronto, Canada, May 1989, H. J. L. R. J. BRACHMAN AND R. REITER, Eds. Morgan Kaufmann, San Mateo, CA, 276- 288. Google ScholarGoogle Scholar
  79. MCALLESTER, D. A. 1989. Ontic: A Knowledge Representation System for Mathematics. MIT Press, Cambridge, MA. Google ScholarGoogle Scholar
  80. MCCARTHY, J. 1977. Epistemological problems in artificial intelligence. In Proceedings of the Fifth International Joint Conference on Artificial Intelligence (IJCAI-77), Cambridge, MA, Aug. 1977. IJCAI.Google ScholarGoogle Scholar
  81. MCCARTHY, J. 1980. Circumscription-a form of non-monotonic reasoning. Artificial Intelligence 13, 1-2 (April), 27-39.Google ScholarGoogle Scholar
  82. MCCUNE,W.AND WOS, L. 1997. Otter-the CADE-13 competition incarnations. Journal of Automated Reasoning 18, 2 (April), 211-220. Google ScholarGoogle Scholar
  83. MENGSHOEL,O.J.AND WILKINS, D. 1997. Abstraction and aggregation in belief networks. In AAAI97 Workshop on Abstractions, Decisions and Uncertainty.Google ScholarGoogle Scholar
  84. MITCHELL, T. M., KELLER,R.M.,AND KEDAR-CABELLI, S. T. 1986. Example-based generalization: a unifying view. Machine Learning 1, 1, 47-80. Google ScholarGoogle Scholar
  85. MITCHELL, T. M. 1997. Machine Learning. McGraw-Hill, New York. Google ScholarGoogle Scholar
  86. MOORE, R. C. 1982. The role of logic in knowledge representation and commonsense reasoning. In Proceedings of the National Conference on Artificial Intelligence, Pittsburgh, PA, Aug. 1982, D. WALTZ, Ed. AAAI Press, Menlo Park, Calif., 428- 433.Google ScholarGoogle Scholar
  87. NAGEL,E.AND NEWMAN, J. 1958. G odel's Proof. New York University Press, New York.Google ScholarGoogle Scholar
  88. NECHES, R., FIKES, R., FININ, T., GRUBER, T., PATIL, R., SENATOR,T.,AND SWARTON, W. R. 1991. Enabling technology for knowledge sharing. AI Magazine, 37-51. Google ScholarGoogle Scholar
  89. NGO,L.AND HADDAWY, P. 1995. Probabilistic logic programming and Bayesian networks. Lecture Notes in Computer Science 1023, 286-300. Google ScholarGoogle Scholar
  90. NILSSON, N. J. 1986. Probabilistic logic. Artificial Intelligence 28, 1 (Feb.), 71-88. Google ScholarGoogle Scholar
  91. PEARL, J. 1988. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, CA. Google ScholarGoogle Scholar
  92. PELLETIER, F. J. 1986. Thinker. In Proceedings of the 8th International Conference on Automated Deduction, Oxford, UK, July 1986, J. H. SIEK-MANN, Ed. vol. 230 of LNCS. Springer, Berlin, 701-702. Google ScholarGoogle Scholar
  93. POOLE, D. 1993a. Average-case analysis of a search algorithm for estimating prior probabilities in Bayesian networks with extreme probabilities. In Proceedings IJCAI-93, Chamberery, France, Aug. 1993, 606-612.Google ScholarGoogle Scholar
  94. POOLE, D. 1993b. Probabilistic horn abduction and bayesian networks. Artificial Intelligence 64, 81- 129. Google ScholarGoogle Scholar
  95. POOLE, D., GOEBEL, R., AND ALELIUNAS, R. 1987. Theorist: a logical reasoning system for default and diagnosis. In The Knowledge Frontier: Essays in the Representation of Knowledge, New York, 1987, N. CERCONE AND G. MCCALLA, Eds. Springer, Berlin, 331-52.Google ScholarGoogle Scholar
  96. POOLE, D., MACKWORTH, A., AND GOEBEL, R. 1998. Computational Intelligence: A Logical Approach. Oxford. Google ScholarGoogle Scholar
  97. PRADHAN,M.AND DAGUM, P. 1996. Optimal Monte Carlo estimation of belief network inference. In Proceedings of the 12th Conference on Uncertainty in Artificial Intelligence (UAI-96), San Francisco, Aug. 1996, E. HORVITZ AND F. J ENSEN, Eds. Morgan Kaufmann, San Mateo, CA. 446- 453. Google ScholarGoogle Scholar
  98. PRADHAN, M., PROVAN, G., MIDDLETON,B.,AND HENRION, M. 1994. Knowledge engineering for large belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MAN- TARAS AND D. POOLE, Eds. Morgan Kaufmann, San Mateo, CA, 484-490.Google ScholarGoogle Scholar
  99. RABINER,L.R.AND JUANG, B. H. 1986. An introduction to hidden Markov models. IEEE ASSP Magazine, 4ff.Google ScholarGoogle Scholar
  100. REITER, R. 1978a. Deductive question-answering on relational data bases. In Logic and Data Bases, H. GALLAIRE AND J. MINKER, Eds. Plenum Press, New York, 149-177.Google ScholarGoogle Scholar
  101. REITER, R. 1978b. On closed world data bases. In Logic and Data Bases,H.GALLAIRE AND J. MINKER Eds. Plenum Press, New York, 55-76.Google ScholarGoogle Scholar
  102. REITER, R. 1980. Equality and domain closure in first-order databases. Journal of the Association for Computing Machinery 27, 2 (April), 235- 49. Google ScholarGoogle Scholar
  103. REITER, R. 1987. Nonmonotonic reasoning. In Annual Review of Computing Sciences, vol. 2, Annual Reviews, Palo Alto, 147-187.Google ScholarGoogle Scholar
  104. ROBINSON, J. A. 1965. A machine-oriented logic based on the resolution principles. JACM12, 23- 41. Google ScholarGoogle Scholar
  105. ROTH, D. 1996. On the hardness of approximate reasoning. Artificial Intelligence Journal 82, 1-2 (April), 273-302. Google ScholarGoogle Scholar
  106. RUDNICKI, P. 1992. An overview of the Mizar project. In Notes to a Talk at the Workshop on Types for Proofs and Programs.Google ScholarGoogle Scholar
  107. SACERDOTI, E. D. 1973. Planning in a hierarchy of abstraction spaces. In IJCAI-73.Google ScholarGoogle Scholar
  108. SARKAR,S.AND MURTHY, I. 1996. Constructing efficient belief network structures with expert provided information. IEEE Transactions on Knowledge and Data Engineering 8,1 (Feb.), 134-143. Google ScholarGoogle Scholar
  109. SCOTT,A.C.,CLAYTON,J.E.,AND GIBSON, E. L. 1991. A Practical Guide to Knowledge Acquisition. Addison-Wesley, Reading, MA. Google ScholarGoogle Scholar
  110. SELMAN,B.AND KAUTZ, H. 1996. Knowledge compilation and theory approximation. Journal of the ACM 43, 193-224. Google ScholarGoogle Scholar
  111. SELMAN, B., LEVESQUE, H., AND MITCHELL, D. 1992. A new method for solving hard satisfiability problems. In Proceedings of the Twelfth National Conference on Artificial Intelligence, San Jose, July 1992, 440-446.Google ScholarGoogle Scholar
  112. SHAFER,G.AND PEARL, J. 1990. Readings in Uncertain Reasoning. Morgan Kaufmann, Los Altos, CA. Google ScholarGoogle Scholar
  113. SINGH, M. 1998. Learning Belief Networks. Ph.D. thesis, Dept. of Computer Science, Univ. of Pennsylvania.Google ScholarGoogle Scholar
  114. SMITH,D.E.AND GENESERETH, M. R. 1985. Ordering conjunctive queries. Artificial Intelligence 26,2 (May), 171-215. Google ScholarGoogle Scholar
  115. SMITH, D. E., GENESERETH, M. R., AND GINSBERG,M. L. 1986. Controlling recursive inference. Artificial Intelligence 30, 3, 343-389. Google ScholarGoogle Scholar
  116. SMYTH, P., HECKERMAN,D.,AND JORDAN, M. I. 1997. Probabilistic independence networks for hidden markov probability models. Neural Computation 9, 2, 227-269. Google ScholarGoogle Scholar
  117. SRINIVAS, S. 1994. A probabilistic apprach to hierarchical model-based diagnosis. Tech. Rep. Research Rep. no. KSL-94-14 (Feb.), Knowledge Systems Laboratory, Stanford Univ.Google ScholarGoogle Scholar
  118. SUERMONDT,H.J.AND COOPER, G. F. 1991. Initialization for the method of conditioning in bayesian belief networks (research note). Artificial Intelligence 50, 1 (June), 83-94. Google ScholarGoogle Scholar
  119. SWAMI,A.AND GUPTA, A. 1988. Optimization of large join queries. SIGMOD Record (ACM Special Interest Group on Management of Data) 17,3 (Sept.), 8-17. Google ScholarGoogle Scholar
  120. TOWELL,G.G.AND SHAVLIK, J. W. 1993. Extracting refined rules from knowledge-based neural networks. Machine Learning 13, 71- 101. Google ScholarGoogle Scholar
  121. TREITEL,R.J.AND GENESERETH, M. R. 1987. Choosing orders for rules. Journal of Automated Reasoning 3, 4 (Dec.), 395-432. Google ScholarGoogle Scholar
  122. TURING, A. M. 1936. On computable numbers, with an application to the Entscheidungs problem. Proc. London Math. Soc. 2, 42, 230-265. Corrections on vol. 2, 43, 544-546.Google ScholarGoogle Scholar
  123. VALIANT, L. G. 1979. The complexity of enumeration and reliability problems. SIAM Journal on Computing 8, 3, 410-421.Google ScholarGoogle Scholar
  124. VAN DER LANS, R. F. 1989. The SQL Standard: A Complete Reference. Prentice Hall, Englewood Cliffs, NJ. Translated by Andrea Gray. Google ScholarGoogle Scholar
  125. VAN ENGELEN, R. A. 1997. Approximating Bayesian belief networks by arc removal. IEEE PAMI 19, 9 (Aug.), 916-920. Google ScholarGoogle Scholar
  126. WELLMAN, M. P. 1990. Fundamental concepts of qualitative probablistic networks. Artificial Intelligence 44, 3, 257-303. Google ScholarGoogle Scholar
  127. WELLMAN, M. 1994. Abstraction in Probabilistic Reasoning. Tech. Rep., Univ. of Michigan. Tutorial prepared for the Summer Institute on Probability in AI, Corvallis, OR, July 1994. See http://ai.eecs.umich.edu/people/wellman/ tut/Abstraction.html.Google ScholarGoogle Scholar
  128. WELD,D.S.AND DE KLEER, J. 1990. Readings in Qualitative Reasoning and Physical Systems. Morgan Kaufmann, Los Altos, CA. Google ScholarGoogle Scholar
  129. WEBB, G. I., WELLS,J.,AND ZHENG, Z. 1999. An experimental evaluation of integrating machine learning with knoweldge acquisition. Machine Learning 35, 5-21. Google ScholarGoogle Scholar
  130. ZHANG,N.L.AND POOLE, D. 1994. A simple approach to Bayesian network computations. In Proc. of the 10th Canadian Conference on Artificial Intelligence, Banff, Alberta, Canada, May 1994.Google ScholarGoogle Scholar
  131. ZILBERSTEIN, S. 1993. Operational Rationality through Compilation of Anytime Algorithms. Tech. Rep. CSD-93-743, Univ. of California, Berkeley. Google ScholarGoogle Scholar
  132. ZILBERSTEIN, S. 1996. Resource-bounded reasoning in intelligent systems. ACM Computing Surveys 28, 4 (Dec.), 15. Google ScholarGoogle Scholar

Recommendations

Reviews

John Abel Moyne

The authors begin with the premise that many tasks require "reasoning"--i.e., deriving conclusions from a corpus of explicitly sotred information--to solve their range of problems. The paper is a useful survey and a formal mathematical description of various methodologies in reasoning: logical, probabilistic, expressive systems and methods of reducing expressiveness, imprecise logical and probabilistic reasoning, stochastic logical and probabilistic reasoning, and so forth. The authors admit that an ideal reasoning system, that would produce all and only the correct answers to every possible query, is not attainable. An ideal reasoning system has to be able to have an answer for all queries, and the answers have to be specific and expressive to permit facts to be stored. The problem is, according to the authors, that as correct and precise systems become more expressive, they can become inefficient. The authors propose various methods to overcome this dilemma, as far as possible. They summarize their procedure as, "[W]e have overviewed a large variety of techniques for improving the effectiveness of a reasoning system, considering both sound logical reasoners (focusing on Horn clauses), and probabilistic reasoners (focusing on belief nets). In general, these techniques embody some (perhaps implicit) tradeoff, where the system designer is willing to sacrifice some desirable property (such as expressiveness, precision, or correctness) to increase the system's efficiency..." (p. 23).

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader