Skip to main content

GPU-Accelerated Non-negative Matrix Factorization for Text Mining

  • Conference paper
Natural Language Processing and Information Systems (NLDB 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7337))

Abstract

An implementation of the non-negative matrix factorization algorithm for the purpose of text mining on graphics processing units is presented. Performance gains of more than one order of magnitude are obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Lee, D.D., Seung, H.S.: Algorithms for Non-Negative Matrix Factorization. In: NIPS (2000)

    Google Scholar 

  2. Hwu, W.W. (ed.): GPU Computing Gems. MKP (2011)

    Google Scholar 

  3. NVIDIA CUDA, http://www.nvidia.com/

  4. Khronos Group. OpenCL, http://www.khronos.org/opencl/

  5. Agullo, E., et al.: Numerical Linear Algebra on Emerging Architectures: The PLASMA and MAGMA projects. J. Phys.: Conf. Ser. 180(1) (2009)

    Google Scholar 

  6. ViennaCL, http://viennacl.sourceforge.net/

  7. Rupp, K., et al.: ViennaCL - A High Level Linear Algebra Library for GPUs and Multi-Core CPUs. In: Proc. Intl. Workshop on GPUs and Scientific Applications (GPUScA 2010), pp. 51–56 (2010)

    Google Scholar 

  8. Xu, R., Wunsch II, D.: Survey of Clustering Algorithms. IEEE Trans. on Neural Networks 16(3), 645–678 (2005)

    Article  Google Scholar 

  9. Salton, G., et al.: A Vector Space Model for Automatic Indexing. Communications of the ACM 18(11), 613–620 (1975)

    Article  MATH  Google Scholar 

  10. Deerwester, S., et al.: Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science 41(6), 391–407 (1990)

    Article  Google Scholar 

  11. Van de Cruys, T.: A non-negative tensor factorization model for selectional preference induction. In: Proc. Workshop on Multiword Expressions, pp. 83–90 (2009)

    Google Scholar 

  12. Xu, W., et al.: Document Clustering Based on Non-Negative Matrix Factorization. In: Proc. 26th Intl. Conf. Research and Development in Information Retrieval, pp. 267–273 (2003)

    Google Scholar 

  13. Pauca, V., et al.: Text Mining Using Non-Negative Matrix Factorizations. In: Proc. 4th SIAM Intl. Conf. Data Mining (2004)

    Google Scholar 

  14. Amy, L., Carl, M.: ALS Algorithms Nonnegative Matrix Factorization Text Mining. SAS NMF Day (2005)

    Google Scholar 

  15. Hoyer, P.: Non-Negative Sparse Coding. In: Proc. IEEE Workshop on Neural Networks for Signal Processing (2002)

    Google Scholar 

  16. Saad, Y.: Iterative Methods for Sparse Linear Systems. SIAM (2003)

    Google Scholar 

  17. An Overview of Eigen. First Plafrim Scientific Day. Bordeaux (May 31, 2011), http://eigen.tuxfamily.org/

  18. 20 Newsgroups, http://people.csail.mit.edu/jrennie/20Newsgroups/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kysenko, V., Rupp, K., Marchenko, O., Selberherr, S., Anisimov, A. (2012). GPU-Accelerated Non-negative Matrix Factorization for Text Mining. In: Bouma, G., Ittoo, A., Métais, E., Wortmann, H. (eds) Natural Language Processing and Information Systems. NLDB 2012. Lecture Notes in Computer Science, vol 7337. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31178-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31178-9_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31177-2

  • Online ISBN: 978-3-642-31178-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics