Keywords and Synonyms
Oracles and queries that are sufficient for exact learning
Problem Definition
In the exact learning model of Angluin [1], a learning algorithm A must discover an unknown function \( \mathsf{f} \colon \{0,1\}^{n} \rightarrow \{0,1\} \) that is a member of a known class C of Boolean functions. The learning algorithm can make at least one of the following types of queries about f:
Equivalence query \( { \mathsf{EQ}_{\mathsf{f}}(\mathsf{g}) } \), for a candidate function g: The reply is either “yes”, if \( { \mathsf{g} \Leftrightarrow \mathsf{f} } \), or a counterexample a with \( { \mathsf{g}(a) \neq \mathsf{f}(a) } \), otherwise.
Membership query \( { \mathsf{MQ}_{\mathsf{f}}(a) } \), for some \( { a \in \{0,1\}^{n} } \): The reply is the Boolean value \( { \mathsf{f}(a) } \).
Subset query \( { \mathsf{SubQ}_{\mathsf{f}}(\mathsf{g}) } \), for a candidate function g: The reply is “yes”, if \( { \mathsf{g} \Rightarrow \mathsf{f} } \), or a counterexample a with \( {...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Recommended Reading
Angluin, D.: Queries and Concept Learning. Mach. Learn. 2, 319–342 (1988)
Angluin, D., Kharitonov, M.: When Won't Membership Queries Help? J. Comput. Syst. Sci. 50, 336–355 (1995)
Bshouty, N.H.: Exact Learning Boolean Function via the Monotone Theory. Inform. Comput. 123, 146–153 (1995)
Bshouty, N.H., Cleve, R., Gavaldà, R., Kannan, S., Tamon, C.: Oracles and Queries That Are Sufficient for Exact Learning. J. Comput. Syst. Sci. 52(3), 421–433 (1996)
Gunopolous, D., Khardon, R., Mannila, H., Saluja, S., Toivonen, H., Sharma, R.S.: Discovering All Most Specific Sentences. ACM Trans. Database Syst. 28, 140–174 (2003)
Jerrum, M.R., Valiant, L.G., Vazirani, V.V.: Random Generation of Combinatorial Structures from a Uniform Distribution. Theor. Comput. Sci. 43, 169–188 (1986)
Karp, R.M., Lipton, R.J.: Some Connections Between Nonuniform and Uniform Complexity Classes. In: Proc. 12th Ann. ACM Symposium on Theory of Computing, 1980, pp. 302–309
Klivans, A.R., Servedio, R.A.: Learning DNF in Time \( { 2^{\tilde{O}(n^{1/3})} } \). J. Comput. Syst. Sci. 68, 303–318 (2004)
Köbler, J., Watanabe, O.: New Collapse Consequences of NP Having Small Circuits. SIAM J. Comput. 28, 311–324 (1998)
Littlestone, N.: Learning Quickly When Irrelevant Attributes Abound: A New Linear‐Threshold Algorithm. Mach. Learn. 2, 285–318 (1987)
Sipser, M.: A complexity theoretic approach to randomness. In: Proc. 15th Annual ACM Symposium on Theory of Computing, 1983, pp. 330–334
Stockmeyer, L.J.: On approximation algorithms for #P. SIAM J. Comput. 14, 849–861 (1985)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag
About this entry
Cite this entry
Tamon, C. (2008). Learning with the Aid of an Oracle. In: Kao, MY. (eds) Encyclopedia of Algorithms. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-30162-4_193
Download citation
DOI: https://doi.org/10.1007/978-0-387-30162-4_193
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-30770-1
Online ISBN: 978-0-387-30162-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering