Skip to main content

Transfer Learning in Large-Scale Short Text Analysis

  • Conference paper
  • First Online:
Book cover Knowledge Science, Engineering and Management (KSEM 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9403))

Abstract

Transfer learning has emerged as a new learning technique facilitating an improved learning result of one task by integrating the well learnt knowledge from another related task. While much research has been devoted to develop the transfer learning algorithms in the field of long text analysis, the development of the transfer learning techniques over the short texts still remains challenging. The challenge of short text data analysis arises due to its sparse nature, noise words, syntactical structure and colloquial terminologies used. In this paper, we propose AutoTL(Automatic Transfer Learning), a transfer learning framework in short text analysis with automatic training data selection and no requirement of data priori probability distribution. In addition, AutoTL enables an accurate and effective learning by transferring the knowledge automatically learnt from the online information. Our experimental results confirm the effectiveness and efficiency of our proposed technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pan, S.J., Qiang, Y.: A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering 22(10), 1345–1359 (2010)

    Article  Google Scholar 

  2. Yang, Q.: An introduction to transfer learning. In: Tang, C., Ling, C.X., Zhou, X., Cercone, N.J., Li, X. (eds.) ADMA 2008. LNCS (LNAI), vol. 5139, pp. 1–1. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  3. Lu, Z., Zhu, Y., Pan, S.J., et al.: Source free transfer learning for text classification. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 122–128. AAAI Press, Québec (2014)

    Google Scholar 

  4. Jin, O., Liu, N.N., et al.: Transferring topical knowledge from auxiliary long texts for short text clustering. In: Proceedings of the 20th ACM Conference on Information and Knowledge Management, pp. 775–784. ACM Press, Glasgow (2011)

    Google Scholar 

  5. Dumais, S.T., Furnas, G.W., et al.: Using latent semantic analysis to improve information retrieval. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 281–285. ACM Press, Washington D.C. (1988)

    Google Scholar 

  6. Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 10(5), 1373–1396 (2003)

    Article  MATH  Google Scholar 

  7. Dai, W., Yang, Q., Xue, G., et al.: Boosting for transfer learning. In: Proceedings of The 24th Annual International Conference on Machine Learning, Corvallis, Oregon, USA, pp. 193–200 (2007)

    Google Scholar 

  8. Liu, W., Zhang, H.: Ensemble transfer learning algorithm based on dymaica dataset regroup. Computer Egineering and Applications 46(12), 126–128 (2010)

    Google Scholar 

  9. Jiaming, H., Jian, Y., Yun, H., Yubao, Y., Jiahai, W.: TrSVM: A transfer learning method based on the similarity of domains. Computer Research and Development 48(10), 1823–1830 (2011)

    Google Scholar 

  10. Dai, W., Xue, G.-R., et al.: Co-clustering based classification for out-of-domain documents. In: Proceedings of the Thirteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Jose, California, USA, pp. 210–219 (2007)

    Google Scholar 

  11. Xue, G., Dai, W., et al.: Topic-bridged PLSA for cross-domain text classification. In: Proceedings of the 31st Annual International ACM SIGIR Conference, pp. 627–634. ACM Press, Singapore (2008)

    Google Scholar 

  12. Long, M., Wang, J., Ding, G., Shen, D., Yang, Q.: Transfer learning with graph co-regularization. In: Proceedings of the 26th AAAI Conference on Artificial Intelligence. AAAI Press, Toronto, Ontario (2012)

    Google Scholar 

  13. Ling, X., Dai, W., et al.: Can Chinese web pages be classified with english data source. In: Proceedings of the 17th International Conference on World Wide Web 2008, Beijing, China, pp. 969–978 (2008)

    Google Scholar 

  14. Mei, C., Zhang, Y., Xuegang, H., Li, P.: Transfer learning algorithms based on maximum entropy model. Computer Research and Development 48(9), 1722–1728 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yan Chu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Chu, Y., Wang, Z., Chen, M., Xia, L., Wei, F., Cai, M. (2015). Transfer Learning in Large-Scale Short Text Analysis. In: Zhang, S., Wirsing, M., Zhang, Z. (eds) Knowledge Science, Engineering and Management. KSEM 2015. Lecture Notes in Computer Science(), vol 9403. Springer, Cham. https://doi.org/10.1007/978-3-319-25159-2_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25159-2_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25158-5

  • Online ISBN: 978-3-319-25159-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics