Abstract
This paper illustrates how a combination of information retrieval, machine learning, and NLP corpus annotation techniques was applied to a problem of text content reliability estimation in Web documents. Our proposal for text content reliability estimation is based on a model in which reliability is a similarity measure between the content of the documents and a knowledge corpus. The proposal includes a new representation of text which uses entailment-based graphs. Then we use the graph-based representations as training instances for a machine learning algorithm allowing to build a reliability model. Experimental results illustrate the feasibility of our proposal by performing a comparison with a state-of-the-art method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Al-Eidan, R.M.B., Al-Khalifa, H.S., Al-Salman, A.S.: Towards the measurement of arabic weblogs credibility automatically. In: Proceedings of the 11th iiWAS Conference, pp. 618–622. ACM, New York (2009)
Cusinato, A., Della Mea, V., Di Salvatore, F., Mizzaro, S.: Quwi: quality control in wikipedia. In: Proceedings of the 3rd Workshop on Information Credibility on the Web, WICOW 2009, pp. 27–34. ACM, New York (2009)
Dang, H.T.: Overview of DUC 2005. In: Proceedings of the 2005 Document Understanding Workshop, Vancouver, B.C., Canada (2005)
Dang, H.T., Owczarzak, K.: Overview of the tac 2008 update summarization task. In: Proceedings of the First Text Analysis Conference (TAC 2008), Gaithersburg, Maryland, USA, pp. 1–16 (2008)
Hickl, A., Bensley, J.: A discourse commitment-based framework for recognizing textual entailment. In: Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, pp. 171–176. ACL, Prague (2007)
Hovy, E., Lin, C.Y., Zhou, L.: Evaluating duc 2005 using basic elements. In: Proceedings of DUC 2005, Vancouver, B.C., Canada, pp. 1–6 (2005)
Juffinger, A., Granitzer, M., Lex, E.: Blog credibility ranking by exploiting verified content. In: Proceedings of the 3rd Workshop on Information Credibility on the Web, WICOW 2009, pp. 51–58. ACM, New York (2009)
Kolluru, B., Gotoh, Y.: On the subjectivity of human authored short summaries. In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation, pp. 12–18. ACL, Michigan (2005)
Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Proc. ACL workshop on Text Summarization Branches Out, Barcelona, Spain, pp. 9–17 (2004)
Metzger, M.J.: Making sense of credibility on the web: Models for evaluating online information and recommendations for future research. Journal of the American Society for Information Science and Technology 58(13), 2078–2091 (2007)
Metzger, M.J., Flanagin, A.J., Medders, R.B.: Social and heuristic approaches to credibility evaluation online. Journal of Communication 60, 413–439 (2010)
Nenkova, A., Passonneau, R.: Evaluating content selection in summarization: The pyramid method. In: Proceedings of the HLT-NAACL Conference, p. 8. Association for Computational Linguistics, New York (2004)
Nichols, E., Murakami, K., Inui, K., Matsumoto, Y.: Constructing a scientific blog corpus for information credibility analysis. In: Proceedings of the PACLING Conference, pp. 1–6. ACM, Sapporo (2009)
Rieh, S.Y.: Judgment of information quality and cognitive authority in the Web. J. Am. Soc. Inf. Sci. 53(2), 145–161 (2002)
Negri, M., Kouylekov, M., Magnini, B., Mehdad, Y., Cabrio, E.: Towards Extensible Textual Entailment Engines: The EDITS Package. In: Proceedings of AIIA, Emergent Perspectives in Artificial Intelligence, Reggio Emilia, Italy (2009)
Vega, L.C., Sun, Y.T., McCrickard, D.S., Harrison, S.: Time: a method of detecting the dynamic variances of trust. In: Proceedings of the 4th Workshop on Information Credibility, WICOW 2010, pp. 43–50. ACM, New York (2010)
Weerkamp, W., Rijke, M.D.: Credibility improves topical blog post retrieval. In: ACL 2008: HLT, pp. 923–931. ACL, Columbus (2008)
Xu, Y.C., Chen, Z.: Relevance judgment: What do information users consider beyond topicality? J. Am. Soc. Inf. Sci. Technol. 57(7), 961–973 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sanz, L., Allende, H., Mendoza, M. (2012). Text Content Reliability Estimation in Web Documents: A New Proposal. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2012. Lecture Notes in Computer Science, vol 7182. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28601-8_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-28601-8_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28600-1
Online ISBN: 978-3-642-28601-8
eBook Packages: Computer ScienceComputer Science (R0)