Abstract
Sentiment ambiguous adjectives, which have been neglected by most previous researches, pose a challenging task in sentiment analysis. We present an evaluation task at SemEval-2010, designed to provide a framework for comparing different approaches on this problem. The task focuses on 14 Chinese sentiment ambiguous adjectives, and provides manually labeled test data. There are 8 teams submitting 16 systems in this task. In this paper, we define the task, describe the data creation, list the participating systems, and discuss different approaches.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andreevskaia, A., & Bergler, S. (2006). Sentiment tagging of adjectives at the meaning level. In The 19th Canadian conference on artificial intelligence.
Balahur, A., & Montoyo, A. (2010). The OpAL participation in the SemEval-2010 Task 18: Disambiguation of sentiment ambiguous adjectives. In Proceedings of 5th international workshop on semantic evaluation.
Ding, X., Liu, B., & Yu, P. (2008). A holistic lexicon-based approach to opinion mining. In Proceedings of WSDM-2006.
Esuli, A., & Sebastiani, F. (2006). SentiWordNet: A publicly available lexical resource for opinion mining. In Proceedings of LREC-2006.
Hatzivassiloglou, V., & McKeown, K. (1997). Predicting the semantic orientation of adjectives. In Proceedings of ACL-1997.
Jin, W., & Ho, H. (2009). A novel lexicalized HMM-based learning framework for web opinion mining. In Proceedings of the 26th annual international conference on machine learning (ICML-09).
Justeson, J., & Kats, S. (1995). Principled disambiguation: Discriminating adjective senses with modified nouns. Computational Lingustics, 21(1), 1–27.
Kim, S., & Hovy, E. (2004). Determining the sentiment of opinions. In Proceedings of COLING-2004.
Li, F., Han, C., Huang, M., Zhu, X., Xia, Y., Zhang, S., & Yu, H. (2010). Structure-aware review mining and summarization. In Proceedings of COLING-2010.
Lu, B., & Tsou, B. (2010). CityU-DAC: Disambiguating sentiment-ambiguous adjectives within context. In Proceedings of 5th international workshop on semantic evaluation.
McCarthy, D., & Carroll, J. (2003). Disambiguating nouns, verbs and adjectives using automatically acquired selectional preferences. Computational Linguistics, 29(4), 639–654.
Meng, X., & Wang, H. (2010). Bootstrapping word dictionary based on random walking on biparty graph. In Proceedings of 5th international workshop on semantic evaluation.
Pak, A., & Paroubek, P. (2010). Using Twitter for disambiguating sentiment ambiguous adjectives. In Proceedings of 5th international workshop on semantic evaluation.
Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval.
Qiu, L., Zhang, W., Hu, C., & Zhao, K. (2009). SELC: A self-supervised model for sentiment analysis. In Proceedings of CIKM-2009.
Su, F., & Markert, K. (2008). From words to senses: A case study of subjectivity recognition. In Proceedings of COLING-2008.
Takamura, H., Inui, T., & Okumura, M. (2006). Latent variable models for semantic orientations of phrases. In Proceedings of EACL-2006.
Takamura, H., Inui, T., & Okumura, M. (2007). Extracting semantic orientations of phrases from dictionary. In Proceedings of NAACL HLT-2007.
Turney, P., & Littman, M. (2003). Measuring praise and criticism: Inference of semantic orientation from association. ACM Transaction on Information Systems, 21(4), 315–346.
Wen, M., & Wu, Y. (2011). Predicting expectation of nouns using bootstrapping method. In Proceedings of IJCNLP-2011.
Wiebe, J., & Mihalcea, R. (2006). Word sense and subjectivity. In Proceedings of ACL-2006.
Wilson, T., Wiebe, J., & Hoffmann, P. (2005). Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of HLT/EMNLP-2005.
Wu, Y., & Wen, M. (2010). Disambiguating dynamic sentiment ambiguous adjectives. In Proceedings of COLING-2010.
Xu, R., Xu, J., & Kit, C. (2010). HITSZ_CITYU: Combine collocation, context words and neighboring sentence sentiment in sentiment adjectives disambiguation. In Proceedings of 5th international workshop on semantic evaluation.
Yang, S., & Liu, M. (2010). YSC-DSAA: An approach to disambiguate sentiment ambiguous adjectives based on SAAOL. In Proceedings of 5th international workshop on semantic evaluation.
Yarowsky, D. (1993). One sense per collocation. In Proceedings of ARPA human language technology workshop.
Acknowledgments
This work was supported by National High Technology Research and Development Program of China (863 Program) (No. 2012AA011101) and 2009 Chiang Ching-kuo Foundation for International Scholarly Exchange (No. RG013-D-09).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wu, Y., Jin, P. SemEval-2010 task 18: disambiguating sentiment ambiguous adjectives. Lang Resources & Evaluation 47, 743–755 (2013). https://doi.org/10.1007/s10579-012-9206-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10579-012-9206-z