Skip to main content
Springer Nature Link
Log in

Learning to Classify Text Using a Few Labeled Examples

  • Conference paper
Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 348))

  • 1187 Accesses

Abstract

It is well known that supervised text classification methods need to learn from many labeled examples to achieve a high accuracy. However, in a real context, sufficient labeled examples are not always available. In this paper we demonstrate that a way to obtain a high accuracy, when the number of labeled examples is low, is to consider structured features instead of list of weighted words as observed features. The proposed vector of features considers a hierarchical structure, named a mixed Graph of Terms, composed of a directed and an undirected sub-graph of words, that can be automatically constructed from a set of documents through the probabilistic Topic Model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer (2006)

    Google Scholar 

  2. Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. Journal of Machine Learning Research 3, 993–1022 (2003)

    MATH  Google Scholar 

  3. Blum, A.L., Langley, P.: Selection of relevant features and examples in machine learning. Artificial Intelligence 97, 245–271 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  4. Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University (2008)

    Google Scholar 

  5. Fodor, I.: A survey of dimension reduction techniques. Tech. rep. (2002)

    Google Scholar 

  6. Griffiths, T.L., Steyvers, M., Tenenbaum, J.B.: Topics in semantic representation. Psychological Review 114(2), 211–244 (2007)

    Article  Google Scholar 

  7. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning. Springer (2009)

    Google Scholar 

  8. Ko, Y., Seo, J.: Text classification from unlabeled documents with bootstrapping and feature projection techniques. Inf. Process. Manage. 45, 70–83 (2009)

    Article  Google Scholar 

  9. Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: Rcv1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361–397 (2004)

    Google Scholar 

  10. McCallum, A., Nigam, K., Rennie, J., Seymore, K.: A machine learning approach to building domain-specific search engines. In: Proceedings of the 16th International Joint Conference on Artificial Intelligence, vol. 2, pp. 662–667. Morgan Kaufmann (1999)

    Google Scholar 

  11. Salton, G., McGill, M.J.: Introduction to modern information retrieval. McGraw-Hill (1983)

    Google Scholar 

  12. Sebastiani, F.: Machine learning in automated text categorization. ACM Comput. Surv. 34, 1–47 (2002)

    Article  MathSciNet  Google Scholar 

  13. Tsoumakas, G., Katakis, I.: Multi-label classification: An overview. Int. J. Data Warehousing and Mining 2007, 1–13 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronic Engineering and Computer Engineering, University of Salerno, 84084, Fisciano, Italy

    Francesco Colace, Massimo De Santo & Luca Greco

  2. DISCo (Department of Informatics, Systems and Communication), University of Milan, Bicocca Viale Sarca 336, 20126, Milan, Italy

    Paolo Napoletano

Authors
  1. Francesco Colace
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Massimo De Santo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luca Greco
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paolo Napoletano
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. IST - Technical University of Lisbon, Av.Rovisco Pais, 1, 1049-001, Lisbon, Portugal

    Ana Fred

  2. Delft University of Technology, Mekelweg 4, 2628 CD, Delft, The Netherlands

    Jan L. G. Dietz

  3. Informatics Research Centre, Henley Business School, University of Reading, RG6 6UD, Reading, UK

    Kecheng Liu

  4. INSTICC and IPS, Estefanilha, Setúbal, Portugal

    Joaquim Filipe

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Colace, F., De Santo, M., Greco, L., Napoletano, P. (2013). Learning to Classify Text Using a Few Labeled Examples. In: Fred, A., Dietz, J.L.G., Liu, K., Filipe, J. (eds) Knowledge Discovery, Knowledge Engineering and Knowledge Management. IC3K 2011. Communications in Computer and Information Science, vol 348. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37186-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37186-8_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37185-1

  • Online ISBN: 978-3-642-37186-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics