Skip to main content
Springer Nature Link
Log in

Plausibility Testing for Lexical Resources

  • Conference paper
  • First Online:
Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10456))

Abstract

This paper describes principles for evaluation metrics for lexical components and an implementation of them based on requirements from practical information systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Karlgren, J., et al.: Evaluating learning language representations. In: Mothe, J., Savoy, J., Kamps, J., Pinel-Sauvagnat, K., Jones, G.J.F., SanJuan, E., Cappellato, L., Ferro, N. (eds.) CLEF 2015. LNCS, vol. 9283, pp. 254–260. Springer, Cham (2015). doi:10.1007/978-3-319-24027-5_25

    Chapter  Google Scholar 

  2. Landauer, T., Dumais, S.: A solution to Plato’s problem: the latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychol. Rev. 104(2), 211–240 (1997)

    Article  Google Scholar 

  3. Finkelstein, L., Gabrilovich, E., Matias, Y., Rivlin, E., Solan, Z., Wolfman, G., Ruppin, E.: Placing search in context: The concept revisited. In: Proceedings of the 10th international conference on World Wide Web. ACM (2001)

    Google Scholar 

  4. Hill, F., Reichart, R., Korhonen, A.: Simlex-999: evaluating semantic models with (genuine) similarity estimation. arXiv preprint arXiv:1408.3456 (2014)

  5. Schwartz, H.A., Gomez, F.: Evaluating semantic metrics on tasks of concept similarity. In: Proceedings of FLAIRS (2011)

    Google Scholar 

  6. Baroni, M., Lenci, A.: How we BLESSed distributional semantic evaluation. In: Proceedings of the 2011 Workshop on GEometrical Models of Natural Language Semantics, pp. 1–10. ACL (2011)

    Google Scholar 

  7. Taylor, W.L.: Cloze procedure: a new tool for measuring readability. Journalism Q. 30(4), 415–433 (1953)

    Google Scholar 

  8. Chang, J., Boyd-Graber, J.L., Gerrish, S., Wang, C., Blei, D.M.: Reading tea leaves: how humans interpret topic models. In: Proceedings of NIPS (2009)

    Google Scholar 

  9. Katz, S.: Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Trans. Acoust. Speech Signal Process. 35(3), 400–401 (1987)

    Article  Google Scholar 

  10. Francis, W.N., Kucera, H.: Brown Corpus Manual, p. 15. Brown University (1979)

    Google Scholar 

  11. Lewis, D.D.: Reuters-21578, distribution 1.0 (1997)

    Google Scholar 

  12. Stolcke, A., et al.: SRILM - an extensible language modeling toolkit. In: Interspeech, vol. 2002, p. 2002 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Uppsala University, Uppsala, Sweden

    Magdalena Parks & Sara Stymne

  2. Gavagai, Stockholm, Sweden

    Jussi Karlgren

Authors
  1. Magdalena Parks
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jussi Karlgren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sara Stymne
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Magdalena Parks .

Editor information

Editors and Affiliations

  1. Dublin City University, Dublin, Ireland

    Gareth J.F. Jones

  2. Trinity College Dublin, Dublin, Ireland

    Séamus Lawless

  3. National University of Distance Education, Madrid, Spain

    Julio Gonzalo

  4. Dublin City University, Dublin, Ireland

    Liadh Kelly

  5. Université Grenoble Alpes, Grenoble, France

    Lorraine Goeuriot

  6. University of Hildesheim, Hildesheim, Germany

    Thomas Mandl

  7. University of Padua, Padua, Italy

    Linda Cappellato

  8. University of Padua, Padua, Italy

    Nicola Ferro

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Parks, M., Karlgren, J., Stymne, S. (2017). Plausibility Testing for Lexical Resources. In: Jones, G., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2017. Lecture Notes in Computer Science(), vol 10456. Springer, Cham. https://doi.org/10.1007/978-3-319-65813-1_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65813-1_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65812-4

  • Online ISBN: 978-3-319-65813-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics