skip to main content
10.1145/1066677.1066923acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
Article

InfoFilter: a system for expressive pattern specification and detection over text streams

Published:13 March 2005Publication History

ABSTRACT

Information filtering includes monitoring text streams to detect patterns that are more complex than those handled by search engines. Text stream monitoring and pattern detection have far reaching applications such as tracking information flow among terrorist outfits, web parental control, and business intelligence. Pattern characterization requirements of applications entail an expressive language for specifying patterns than what is currently provided by Information Retrieval Query Languages (IRQLs) and current information filtering systems. Pattern specification alone does not suffice, as detecting these complex patterns is equally important in order to use these systems for real-world applications.InfoFilter, a content-based information filtering system, presented in this paper, allows users to specify complex patterns and detects these patterns in incoming text streams from various sources such as news feed, emails, web pages and caption text from streaming videos. Complex patterns such as combinations of sequential, structural patterns, wild cards, word frequencies, proximity, Boolean operators and synonyms are formulated using the expressive pattern specification language, PSL, proposed in this paper. Once specified, these complex patterns are detected using a data flow paradigm over Pattern Detection Graphs (PDGs).

References

  1. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. New York: ACM Press / Addison-Wesley, 1999.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. G. Salton and M. McGill, Introduction to Modern Information Retrieval. New York: McGraw-Hill, Inc., 1983.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. W. Berry, Survey of Text Mining: Clustering, Classification, and Retrieval. New York: Springer-Verlag, 2004.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Fellbaum, "WordNet: An Electronic Lexical Database," MIT press, 1998.]]Google ScholarGoogle Scholar
  5. T. Yan and H. Garcia-Molina, "The SIFT Information Dissemination System," in ACM TODS, vol. 24, no. 4, pp. 529 - 565, December 1999.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. C. Stevens, "Knowledge-Based Assistance For Accessing Large, Poorly Structured Information Spaces," Ph.D. dissertation, Dept. of CS. University of Colorado, Boulder, 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. U. Manber, "Glimpse: A Tool To Search Through Entire File System," in Proc. of USENIX Winter 1994 Technical Conference.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. Araújo, G. Navarro, and N. Ziviani, "Large Text Searching Allowing Errors," in Proc. of South American Workshop on String Processing, 1997, pp. 2--20.]]Google ScholarGoogle Scholar
  9. K. Aas, "A Survey on Personalized Information Filtering Systems For The World Wide Web," Report No. 922, Norwegian Computing Center, December, 1997.]]Google ScholarGoogle Scholar
  10. W. B. C. James, P. Callan and S. M. Harding, "The INQUERY Retrieval System," in Proc. of DEXA, 1992.]]Google ScholarGoogle Scholar
  11. "Structured Query Retrieval in Lemur." {Online}. Available: http://www-2.cs.cmu.edu/~emur/2.2/StructuredQuery.html]]Google ScholarGoogle Scholar
  12. R. Adaikkalavan and S. Chakravarthy, "SnoopIB: Interval-Based Event Specification and Detection for Active Databases," in Proc. of Advances in Databases and Information Systems (ADBIS), LNCS 2798, 2003, pp. 190--204.]]Google ScholarGoogle Scholar
  13. L. Elkhalifa, "InfoFilter: Complex Pattern Specification and Detection Over Text Streams," M. S. Thesis, Dept. of CSE, The University of Texas at Arlington, 2004. {Online}. Available: http://itlab.uta.edu/ITLABWEB/Students/sharma/theses/Laali.pdf]]Google ScholarGoogle Scholar
  14. "JWNL (Java WordNet Library)." {Online}. Available: http://sourceforge.net/projects/jwordnet]]Google ScholarGoogle Scholar
  15. S. Wu and U. Manber, "Fast Text Searching Allowing Errors," in Communications of the ACM, vol. 35, no. 10, pp. 83--91, 1992.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Nelson, "Fast String Searching With Suffix Trees," in Dr. Dobb's Journal, August 1996.]]Google ScholarGoogle Scholar
  17. "Sun Microsystems, JavaMail API Specification v 1.3.1." 2003.]]Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    SAC '05: Proceedings of the 2005 ACM symposium on Applied computing
    March 2005
    1814 pages
    ISBN:1581139640
    DOI:10.1145/1066677

    Copyright © 2005 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 13 March 2005

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • Article

    Acceptance Rates

    Overall Acceptance Rate1,650of6,669submissions,25%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader