skip to main content
10.1145/2396761.2398647acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
poster

An unsupervised method for author extraction from web pages containing user-generated content

Published:29 October 2012Publication History

ABSTRACT

In this paper, we address the problem of author extraction (AE) from user generated content (UGC) pages. Most existing solutions for web information extraction, including AE, adopt supervised approaches, which require expensive manual annotation. We propose a novel unsupervised approach for automatically collecting and labeling training data based on two key observations of author names: (1) people tend to use a single name across sites if their preferred names are available; (2) people tend to create unique usernames to easily distinguish themselves from others, e.g. travelbug61. Our AE solution only requires features extracted from a single UGC page instead of relying on clues from multiple UGC pages. We conducted extensive experiments. (1) The evaluation of automatically labeled author field data shows 95.0% precision. (2) Our method achieves an F1 score of 96.1%, which significantly outperforms a state-of-the-art supervised approach with single page features (F1 score: 68.4%) and has a comparable performance to its multiple page solution (F1 score: 95.4%). (3) We also examine the robustness of our approach on various UGC pages from forums and review sites, and achieve promising results as well.

References

  1. F. Abel, N. Henze, E. Herder, and D. Krause. Interweaving public user profiles on the web. UMAP, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM TIST, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. D. Gruhl, R. Guha, D. Liben-Nowell, and A. Tomkins. Information diffusion through blogspace. In WWW, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. Liu, Y. Song, and C. Lin. Competition-based user expertise score estimation. In SIGIR, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P. Luo, F. Lin, Y. Xiong, Y. Zhao, and Z. Shi. Towards combining web classification and web information extraction: a case study. In SIGKDD, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Newman. Communities, modules and large-scale structure in networks. Nature Physics, 2011.Google ScholarGoogle Scholar
  7. X. Song, J. Liu, Y. Cao, C. Lin, and H. Hon. Automatic extraction of web data records containing user-generated content. In CIKM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. K. Wang, C. Thrasher, and B. Hsu. Web scale nlp: A case study on url word breaking. In WWW, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. K. Wang, C. Thrasher, E. Viegas, X. Li, and B. Hsu. An overview of microsoft web n-gram corpus and applications. In NAACL, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Yang, R. Cai, Y. Wang, J. Zhu, L. Zhang, and W. Ma. Incorporating site-level knowledge to extract structured data from web forums. In WWW, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Y. Zhai and B. Liu. Web data extraction based on partial tree alignment. In WWW, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Zhu, Z. Nie, J. Wen, B. Zhang, and W. Ma. Simultaneous record detection and attribute labeling in web data extraction. In SIGKDD, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. An unsupervised method for author extraction from web pages containing user-generated content

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge management
        October 2012
        2840 pages
        ISBN:9781450311564
        DOI:10.1145/2396761

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 October 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • poster

        Acceptance Rates

        Overall Acceptance Rate1,861of8,427submissions,22%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader