Skip to main content
SpringerLink
Log in

Hybrid Words Representation for Airlines Sentiment Analysis

  • Conference paper
  • First Online:
AI 2019: Advances in Artificial Intelligence (AI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11919))

Included in the following conference series:

Abstract

Social media sentimental analysis is interesting field with the aim to analyze social conservation and determine deeper context as they apply to a topic or theme. However, it is challenging as tweets are unstructured, informal and noisy in nature. Also, it involves natural language complexities like words with same meanings (Polysemy). Most of the existing approaches mainly rely on clean textual data, however Twitter data is quite noisy in real life. Aiming to improve the performance, in this paper, we present hybrid words representation and Bi-directional Long Short Term Memory (BiLSTM) with attention modeling resulting in improvement in tweet quality by not only treating the noise within the textual context but also considers polysemy, semantics, syntax, out of vocabulary (OOV) words as well as words sentiments within a tweet. The proposed model overcomes the current limitations and improves the accuracy for tweets classification as showed by the evaluation of the model performed on real-world airline related datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://sentiment.christopherpotts.net/code-data/happyfuntokenizing.py.

  2. 2.

    https://nlp.stanford.edu/projects/glove/.

  3. 3.

    https://code.google.com/archive/p/word2vec/.

  4. 4.

    http://ir.hit.edu.cn/dytang/.

References

  1. Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC 2010), Valletta, Malta, May 2010. European Languages Resources Association (ELRA) (2010)

    Google Scholar 

  2. Cambria, E., Poria, S., Hazarika, D., Kwok, K.: Senticnet 5: discovering conceptual primitives for sentiment analysis by means of context embeddings. In: AAAI (2018)

    Google Scholar 

  3. Chelba, C., Mikolov, T., Schuster, M., Ge, Q., Brants, T., Koehn, P.: One billion word benchmark for measuring progress in statistical language modeling. CoRR, abs/1312.3005 (2013)

    Google Scholar 

  4. Chiavetta, F., Lo Bosco, G., Pilato, G.: A lexicon-based approach for sentiment classification of Amazon books reviews in Italian language, pp. 159–170, January 2016

    Google Scholar 

  5. da Silva, N.F.F., Hruschka, E.R., Hruschka, E.R.: Tweet sentiment analysis with classifier ensembles. Decis. Support Syst. 66(C), 170–179 (2014)

    Article  Google Scholar 

  6. dos Santos, C.N., de Gatti, M.A.: Deep convolutional neural networks for sentiment analysis of short texts. In: COLING (2014)

    Google Scholar 

  7. Go, A., Bhayani, R., Huang, L.: Twitter sentiment classification using distant supervision. Processing, pp. 1–6 (2009)

    Google Scholar 

  8. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2004, pp. 168–177. ACM, New York (2004)

    Google Scholar 

  9. Hutto, C.J., Gilbert, E.: Vader: a parsimonious rule-based model for sentiment analysis of social media text. In: ICWSM (2014)

    Google Scholar 

  10. Zhao, J., Gui, X.: Deep convolution neural networks for Twitter sentiment analysis. IEEE Access 6, 23253–23260 (2018)

    Article  Google Scholar 

  11. Kiritchenko, S., Zhu, X.-D., Cherry, C., Mohammad, S.: NRC-Canada-2014: detecting aspects and sentiment in customer reviews. In: SemEval@COLING (2014)

    Google Scholar 

  12. Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C.: Neural architectures for named entity recognition. CoRR, abs/1603.01360 (2016)

    Google Scholar 

  13. Liu, P., Qiu, X., Huang, X.: Learning context-sensitive word embeddings with neural tensor skip-gram model. In: Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI 2015, pp. 1284–1290. AAAI Press (2015)

    Google Scholar 

  14. Melamud, O., Goldberger, J., Dagan, I.: context2vec: learning generic context embedding with bidirectional LSTM. In: CoNLL (2016)

    Google Scholar 

  15. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 26, pp. 3111–3119. Curran Associates Inc. (2013)

    Google Scholar 

  16. Mohammad, S.: A practical guide to sentiment annotation: challenges and solutions. In: WASSA@NAACL-HLT (2016)

    Google Scholar 

  17. Mohammad, S., Kiritchenko, S., Zhu, X.: NRC-Canada: building the state-of-the-art in sentiment analysis of Tweets. In: Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013), pp. 321–327. Association for Computational Linguistics (2013)

    Google Scholar 

  18. Naseem, U., Musial, K.: Dice: deep intelligent contextual embedding for Twitter sentiment analysis. In: 2019 15th International Conference on Document Analysis and Recognition (ICDAR), pp. 1–5 (2019)

    Google Scholar 

  19. Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)

    Google Scholar 

  20. Peters, M.E., et al.: Deep contextualized word representations. CoRR, abs/1802.05365 (2018)

    Google Scholar 

  21. Rezaeinia, S.M., Ghodsi, A., Rahmani, R.: Improving the accuracy of pre-trained word embeddings for sentiment analysis. CoRR, abs/1711.08609 (2017)

    Google Scholar 

  22. Saeed, Z., et al.: Whats happening around the world? A survey and framework on event detection techniques on twitter. J. Grid Comput. 17, 1–34 (2019)

    Article  Google Scholar 

  23. Saeed, Z., Abbasi, R.A., Razzak, I., Maqbool, O., Sadaf, A., Xu, G.: Enhanced heartbeat graph for emerging event detection on Twitter using time series networks. Exp. Syst. Appl. 136, 115–132 (2019)

    Article  Google Scholar 

  24. Saeed, Z., Abbasi, R.A., Razzak, M.I., Xu, G.: Event detection in Twitter stream using weighted dynamic heartbeat graph approach. arXiv preprint arXiv:1902.08522 (2019)

  25. Saeed, Z., Abbasi, R.A., Sadaf, A., Razzak, M.I., Xu, G.: Text stream to temporal network - a dynamic heartbeat graph to detect emerging events on Twitter. In: Phung, D., Tseng, V.S., Webb, G.I., Ho, B., Ganji, M., Rashidi, L. (eds.) PAKDD 2018. LNCS (LNAI), vol. 10938, pp. 534–545. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93037-4_42

    Chapter  Google Scholar 

  26. Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. Trans. Sig. Proc. 45(11), 2673–2681 (1997)

    Article  Google Scholar 

  27. Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., Zhou, M.: Sentiment embeddings with applications to sentiment analysis. IEEE Trans. Knowl. Data Eng. 28(2), 496–509 (2016)

    Article  Google Scholar 

  28. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A.J., Hovy, E.H.: Hierarchical attention networks for document classification. In: HLT-NAACL (2016)

    Google Scholar 

  29. Yu, L.-C., Wang, J., Robert Lai, K., Zhang, X.: Refining word embeddings using intensity scores for sentiment analysis. IEEE/ACM Trans. Audio Speech Lang. Proc. 26(3), 671–681 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Advanced Analytics Institue, University of Technology Sydney, Sydney, Australia

    Usman Naseem & Imran Razzak

  2. School of Engineering, RMIT University, Melbourne, Australia

    Shah Khalid Khan

  3. Norwegian University of Science and Technology, Trondheim, Norway

    Ibrahim A. Hameed

Authors
  1. Usman Naseem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shah Khalid Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Imran Razzak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ibrahim A. Hameed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Usman Naseem .

Editor information

Editors and Affiliations

  1. University of South Australia, Adelaide, SA, Australia

    Jixue Liu

  2. The University of Melbourne, Melbourne, VIC, Australia

    James Bailey

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Naseem, U., Khan, S.K., Razzak, I., Hameed, I.A. (2019). Hybrid Words Representation for Airlines Sentiment Analysis. In: Liu, J., Bailey, J. (eds) AI 2019: Advances in Artificial Intelligence. AI 2019. Lecture Notes in Computer Science(), vol 11919. Springer, Cham. https://doi.org/10.1007/978-3-030-35288-2_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-35288-2_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-35287-5

  • Online ISBN: 978-3-030-35288-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation