Abstract
Information explosion has led to diminishing awareness: disciplines are becoming increasingly specialized; individuals and groups are becoming ever more insular. This paper considers how awareness can be enhanced via text-based knowledge discovery. Knowledge representation is motivated from a socio-cognitive perspective. Concepts are represented as vectors in a high dimensional semantic space automatically derived from a text corpus. Information flow computation between vectors is proposed as a means of discovering implicit associations between concepts. The potential of information flow analysis in text based knowledge discovery has been demonstrated by two case studies: literature-based scientific discovery by attempting to simulate Swanson’s Raynaud-fish oil discovery in medical texts; and automatic category derivation from document titles. There is some justification to believe that the techniques create awareness of new knowledge.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barwise, J., Seligman, J.: Information Flow: The Logic of Distributed Systems. Cambridge Tracts in Theoretical Computer Science 44 (1997)
Bruza, P.D., Song, D.: Inferring Query Models by Information Flow Analysis. In: Proceedings of the 11th International ACM Conference on Information and Knowledge Management (CIKM 2002), pp. 260–269 (2002)
Bruza, P.D.: Stratified Information Disclosure. Ph.D. Thesis. University of Nijmegen, The Netherlands (1993)
Burgess, C., Livesay, L., Lund, K.: Explorations in Context Space: Words, Sentences, Discourse. In: Foltz, P.W. (ed.) Quantitative Approaches to Semantic Knowledge Representation. Discourse Processes, vol. 25(2,3), pp. 179–210 (1998)
Gabbay, D., Woods, J.: Abduction. In: Lecture notes from ESSLLI 2000 (European Summer School on Logic, Language and Information) (2000), Online: http://www.cs.bham.ac.uk/~esslli/notes/gabbay.html
Gärdenfors, P.: Conceptual Spaces: The Geometry of Thought. MIT Press, Cambridge (2000)
Gordon, M.D., Dumais, S.: Using Latent Semantic Indexing for literature-based discovery. Journal of the American Society for Information Science 49(8), 674–685 (1998)
Landauer, T., Dumais, S.: A Solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104(2), 211–240 (1997)
Lund, K., Burgess, C.: Producing High-dimensional Semantic Spaces from Lexical Co-occurrence. Behavior Research Methods, Instruments, & Computers 28(2), 203–208 (1996)
Robertson, S.E., Walker, S., Spark-Jones, K., Hancock-Beaulieu, M.M., Gatford, M.: OKAPI at TREC-3. In: Proceedings of the 3rd Text Retrieval Conference (TREC-3), pp. 109–126 (1994)
Song, D., Bruza, P.D.: Discovering Information Flow Using a High Dimensional Conceptual Space. In: Proceedings of the 24th Annual International Conference on Research and Development in Information Retrieval (SIGIR 2001), pp. 327–333 (2001)
Song, D., Bruza, P.D.: Towards context-sensitive information inference. Journal of the American Society for Information Science and Technology 54(4), 321–334 (2003)
Swanson, D.R., Smalheiser, N.R.: An Interactive system for finding complementary literatures: a stimulus to scientific discovery. Artificial Intelligence 91, 183–203 (1997)
Swanson, D.R.: Fish Oil, Raynaud’s Syndrome, and Undiscovered Public Knowledge. Perspectives in Biology and Medicine 30(1), 7–18 (1986)
Text Retrieval Conference (TREC), National Institution of Standards and Technology(NIST), http://trec.nist.gov/data/
Weeber, M., Klein, H., Jong van den Berg, L., Vos, R.: Using concepts in literature-based discovery: Simulating Swanson’s Raynaud-Fish Oil and migraine-magnesium discoveries. Journal of the American Society for Information Science and Technology 52(7), 548–557 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Song, D., Bruza, P. (2006). Text Based Knowledge Discovery with Information Flow Analysis. In: Zhou, X., Li, J., Shen, H.T., Kitsuregawa, M., Zhang, Y. (eds) Frontiers of WWW Research and Development - APWeb 2006. APWeb 2006. Lecture Notes in Computer Science, vol 3841. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11610113_60
Download citation
DOI: https://doi.org/10.1007/11610113_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31142-3
Online ISBN: 978-3-540-32437-9
eBook Packages: Computer ScienceComputer Science (R0)