Abstract
This paper is focused on discovering bilingual news clusters in a comparable corpus. Particularly, we deal with the news representation and with the calculation of the similarity between documents. We use as representative features of the news the cognate named entities they contain. One of our main goals consists of proving whether the use of only named entities is a good source of knowledge for multilingual news clustering. In the vectorial news representation we take into account the category of the named entities. In order to determine the similarity between two documents, we propose a new approach based on a fuzzy system, with a knowledge base that tries to incorporate the human knowledge about the importance of the named entities category in the news. We have compared our approach with a traditional one obtaining better results in a comparable corpus with news in Spanish and English.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Atserias, J., Casas, B., Comelles, E., González, M., Padró, L., Padró, M.: FreeLing 1.3. Syntactic and semantic services in an open-source NLP library. In: Proceedings of the LREC’06. Genoa, Italy (2006), http://garraf.epsevg.upc.es/freeling/
Braschler, M., Ripplinger, B., Schuble, P.: Experiments with the Eurospider Retrieval System for CLEF 2001. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 102–110. Springer, Heidelberg (2002)
Chau, R., Yeh, C., Smith, K.A.: A Neural Network Model for Hierarchical Multilingual Text Categorization. In: Wang, J., Liao, X.-F., Yi, Z. (eds.) ISNN 2005. LNCS, vol. 3497, Springer, Heidelberg (2005)
Chen, H., Lin, C.: A Multilingual News Summarizer. In: Proceedings of 18th International Conference on Computational Linguistics, pp. 159–165 (2000)
Friburger, N., Maurel, D.: Textual Similarity Based on Proper Names. Mathematical Formal Information Retrieval (MFIR 2002), 155–167 (2002)
Gang, W.: Named Entity Recognition and An Apply on Document Clustering. MCSc Thesis. Dalhousie University, Faculty of Computer Science, Canada (2004)
García-Vega, M., Martínez-Santiago, F., Urea-López, L.A., Martín-Valdivia, M.T.: Generación de un tesauro de similitud multilinge a partir de un corpus comparable aplicado a CLIR. Procesamiento del Lenguaje Natural, vol. 28 (2002)
Gliozzo, A., Strapparava, C.: Cross language Text Categorization by acquiring Multilingual Domain Models from Comparable Corpora. In: Proceedings of the ACL Workshop on Building and Using Parallel Texts, pp. 9–16 (2005)
Hansen, B.K.: Analog forecasting of ceiling and visibility using fuzzy sets. In: Proceedings of the AMS 2000 (2000)
IPTC - NAA Information Interchange Model Version 4, http://www.iptc.org/std/IIM/4.1/specification/IIMV4.1.pdf
Isermann, R.: On Fuzzy Logic Applications for Automatic Control Supervision and Fault Diagnosis. IEEE Trans. Syst. Man and Cybern. 28, 221–235 (1998)
Karypis, G.: CLUTO: A Clustering Toolkit. Technical Report: 02-017. University of Minnesota, Department of Computer Science, Minneapolis, MN 55455 (2002)
Lawrence, J.L.: Newsblaster Russian-English Clustering Performance Analysis. Columbia computer science Technical Reports, http://www1.cs.columbia.edu/library/2003.html
Mathieu, B., Besancon, R., Fluhr, C.: Multilingual document clusters discovery. RIAO 2004, pp. 1–10 (2004)
Montalvo, S., Martínez, R., Casillas, A., Fresno, V.: Multilingual Document Clustering: an Heuristic Approach Based on Cognate Named Entities. In: Proceedings of COLING-ACL 2006, pp. 1145–1152 (2006)
NEClassifier (2004), http://l2r.cs.uiuc.edu/cogcomp/software.php
Pouliquen, B., Steinberger, R., Ignat, C., Ksper, E., Temikova, I.: Multilingual and cross-lingual news topic tracking. In: Proc. of the CoLing 2004, pp. 23–27 (2004)
Rauber, A., Dittenbach, M., Merkl, D.: Towards Automatic Content-Based Organization of Multilingual Digital Libraries: An English, French, and German View of the Russian Information Agency Novosti News. In: Proceedings of RCDL 2001 (2001)
Silva, J., Mexia, J., Coelho, C., Lopes, G.: A Statistical Approach for Multilingual Document Clustering and Topic Extraction form Clusters. Pliska Studia Mathematica Bulgarica 16, 207–228 (2004)
Steinberger, R., Pouliquen, B., Ignat, C.: Exploting multilingual nomenclatures and language-independent text features as an interlingua for cross-lingual text analysis applications. In: SILTC (2004)
Steinberger, R., Pouliquen, B., Scheer, J.: Cross-Lingual Document Similarity Calculation Using the Multilingual Thesaurus EUROVOC. In: Gelbukh, A. (ed.) CICLing 2002. LNCS, vol. 2276, Springer, Heidelberg (2002)
van Rijsbergen, C.J.: Foundations of evaluation. Journal of Documentation 30, 365–373 (1974)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Montalvo, S., Martínez, R., Casillas, A., Fresno, V. (2007). Bilingual News Clustering Using Named Entities and Fuzzy Similarity. In: Matoušek, V., Mautner, P. (eds) Text, Speech and Dialogue. TSD 2007. Lecture Notes in Computer Science(), vol 4629. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74628-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-74628-7_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74627-0
Online ISBN: 978-3-540-74628-7
eBook Packages: Computer ScienceComputer Science (R0)