Skip to main content

MetaScience: An Holistic Approach for Research Modeling

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9974))

Abstract

Conferences have become primary sources of dissemination in computer science research, in particular, in the software engineering and database fields. Assessing the quality, scope and community of conferences is therefore crucial for any researcher. However, digital libraries and online bibliographic services offer little help on this, thus providing only basic metrics. Researchers are instead forced to resort to the tedious task of manually browsing different sources (e.g., DBLP, Google Scholar or conference sites) to gather relevant information about a given venue. In this paper we propose a conceptual schema providing a holistic view of conference-related information (e.g., authors, papers, committees and topics). This schema is automatically and incrementally populated with data available online. We show how this schema can be used as a single information source for a variety of complex queries and metrics to characterize the ER conference. Our approach has been implemented and made available online.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    DBLP is a popular online reference for open bibliographic information in computer science with over 3M publication records.

  2. 2.

    CORE (http://www.core.edu.au/index.php/conference-portal) provides assessment of conferences in computing disciplines according to a mix of indicators such as citation and acceptance rates.

  3. 3.

    Dumps of the DBLP database are released periodically at http://dblp.l3s.de.

  4. 4.

    http://dblp.uni-trier.de.

  5. 5.

    The Levenshtein distance represents the minimum number of single-character changes (i.e. insertions, deletions or substitutions) required to change one word into the other.

  6. 6.

    The queries to calculate the metrics for each dimension are available at the tool website.

  7. 7.

    https://github.com/SOM-Research/metaScience.

  8. 8.

    http://som-research.uoc.edu/tools/metaScience.

  9. 9.

    http://valutazione.unibas.it/cs-conference-rating.

References

  1. Patterson, D.A.: The health of research conferences and the dearth of big idea papers. Commun. ACM 47(12), 23–24 (2004)

    Article  Google Scholar 

  2. Chen, J., Konstan, J.A.: Conference paper selectivity and impact. Commun. ACM 53(6), 79–83 (2010)

    Article  Google Scholar 

  3. Goeminne, M., Mens, T.: A comparison of identity merge algorithms for software repositories. Sci. Comput. Program. 78(8), 971–986 (2013)

    Article  Google Scholar 

  4. Christen, P.: A comparison of personal name matching: techniques and practical issues. In: ICDM Conference, pp. 290–294 (2006)

    Google Scholar 

  5. Vasilescu, B., Serebrenik, A., Mens, T., van den Brand, M.G., Pek, E.: How healthy are software engineering conferences? Sci. Comput. Program. 89, 251–272 (2014)

    Article  Google Scholar 

  6. Zhuang, Z., Elmacioglu, E., Lee, D., Giles, C.L.: Measuring conference quality by mining program committee characteristics. In: Digital Libraries Conference, pp. 225–234 (2007)

    Google Scholar 

  7. Vasilescu, B., Serebrenik, A., Mens, T.: A historical dataset of software engineering conferences. In: MSR Conference, pp. 373–376 (2013)

    Google Scholar 

  8. Hirsch, J.E.: An index to quantify an individual’s scientific research output. Natl. Acad. Sci. USA 102(46), 16569–16572 (2005)

    Article  Google Scholar 

  9. Amin, M., Mabe, M.: Impact factors: use and abuse. Int. J. Environ. Sci. Tech. 1(1), 1 (2004)

    Article  Google Scholar 

  10. Martins, W.S., Gonçalves, M.A., Laender, A.H., Ziviani, N.: Assessing the quality of scientific conferences based on bibliographic citations. Scientometrics 83(1), 133–155 (2010)

    Article  Google Scholar 

  11. Van Eck, N.J., Waltman, L.: CitNetExplorer: a new software tool for analyzing and visualizing citation networks. J. Informetrics 8(4), 802–823 (2014)

    Article  Google Scholar 

  12. Saha, S., Saint, S., Christakis, D.A.: Impact factor: a valid measure of journal quality? J. Med. Libr. Assoc. 91(1), 42 (2003)

    Google Scholar 

  13. Bornmann, L., Daniel, H.D.: Does the H-index for ranking of scientists really work? Scientometrics 65(3), 391–392 (2005)

    Article  Google Scholar 

  14. Montolio, S.L., Dominguez-Sal, D., Larriba-Pey, J.L.: Research endogamy as an indicator of conference quality. ACM SIGMOD Rec. 42(2), 11–16 (2013)

    Article  Google Scholar 

  15. Jarke, M., Pham, M.C., Klamma, R.: Evolution of the CAiSE author community: a social network analysis. In: Seminal Contributions to Information Systems Engineering, 25 Years of CAiSE, pp. 15–33 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Javier Luis Cánovas Izquierdo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Cosentino, V., Cánovas Izquierdo, J.L., Cabot, J. (2016). MetaScience: An Holistic Approach for Research Modeling. In: Comyn-Wattiau, I., Tanaka, K., Song, IY., Yamamoto, S., Saeki, M. (eds) Conceptual Modeling. ER 2016. Lecture Notes in Computer Science(), vol 9974. Springer, Cham. https://doi.org/10.1007/978-3-319-46397-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46397-1_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46396-4

  • Online ISBN: 978-3-319-46397-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics