Skip to main content
SpringerLink
Log in

Research evaluation of Asian countries using altmetrics: comparing South Korea, Japan, Taiwan, Singapore, and China

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

This study assessed the influence of academic articles in five Asian countries—South Korea, Japan, Taiwan, Singapore, and China—using altmetrics, an emerging method of complementing traditional ways of evaluating academic performance on the social media. In particular, the present study examined altmetric mentions of academic papers on social media using the Quadruple Helix by classifying the data into four spaces: innovation, knowledge, consensus, and government. The research questions were posed concerning the types of online social media in which academic articles were mentioned most frequently in Asia. Further, the prominent disciplines featured in the salient academic papers were investigated through an assessment using altmetrics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ackland, R. (2013). Web social science: Concepts, data and tools for social scientists in the digital age. Los Angeles: SAGE.

    Google Scholar 

  • Altmetric. (2018). Retrieved July 23, 2018 from https://www.altmetric.com.

  • Blazquez, D., & Domenech, J. (2017). Big data sources and methods for social and economic analyses. Technological Forecasting & Social Change. https://doi.org/10.1016/j.techfore.2017.07.027.

    Article  Google Scholar 

  • Bornmann, L. (2012). Measuring the societal impact of research. EMBO Reports, 13(8), 673–676.

    Article  Google Scholar 

  • Bornmann, L. (2014a). Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics. Scientometrics, 8(4), 895–903.

    Google Scholar 

  • Bornmann, L. (2014b). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime. Journal of Informetrics, 8(4), 935–950.

    Article  Google Scholar 

  • Bornmann, L., & Haunschild, R. (2018). Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. PLoS ONE, 13(5), e0197133. https://doi.org/10.1371/journal.pone.0197133.

    Article  Google Scholar 

  • Chinnuswamy, Y. (2014). Mendeley co-founder speaks to Asian scientist. Asian Scientist. Retrieved June 6, 2018 from https://www.asianscientist.com/2014/09/features/mendeley-elsevier-interview-jan-reichelt.

  • Cho, J. (2017). A comparative study of the impact of Korean research articles in four academic fields using altmetrics. Performance Measurement and Metrics, 18(1), 38–51.

    Article  Google Scholar 

  • Cho, S. E., & Park, H. W. (2013). A qualitative analysis of cross-cultural new media research: SNS use in Asia and the West. Quality & Quantity, 47(4), 2319–2330.

    Article  Google Scholar 

  • Choi, S., & Park, H. W. (2014). An exploratory approach to a Twitter-based community centered on a political goal in South Korea: Who organized it, what they shared, and how they acted. New Media & Society, 16(1), 129–148.

    Article  Google Scholar 

  • Choi, S., & Park, H. W. (2015). Networking interest and networked structure: A quantitative analysis of Twitter data. Social Science Computer Review, 33(2), 145–162.

    Article  Google Scholar 

  • Choi, S., Yang, J., & Park, H. W. (2015a). Quantifying the Triple Helix relationship in scientific research: Statistical analyses on the dividing pattern between developed and developing countries. Quality & Quantity, 49(4), 1381–1396.

    Article  Google Scholar 

  • Choi, S., Yang, J., & Park, H. W. (2015b). The Triple Helix and international collaboration in science. Journal of the Association for Information Science and Technology, 66(1), 201–212.

    Article  Google Scholar 

  • Chung, C. J., & Park, H. W. (2014). Mapping triple helix innovation in developing and transitional economies: Webometrics, scientometrics, and informetrics. Scientometrics, 99(1), 1–4.

    Article  Google Scholar 

  • Costas, R., Zahedi, Z., & Wouters, P. (2014). Do “Altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology, 66(10), 2003–2019.

    Article  Google Scholar 

  • Cress, P. (2014). Using Altmetrics and social media to supplement impact factor: Maximizing your article’s academic and society impact. Aesthetic Surgery Journal, 34(7), 1123–1126.

    Article  Google Scholar 

  • Cronin, B., & Sugimoto, C. R. (Eds.). (2014). Beyond bibliometrics: Harnessing multidimensional 459 indicators of scholarly impact. Cambridge: MIT Press.

    Google Scholar 

  • De Maeyer, J. (2013). Towards a hyperlinked society: a critical review of link studies. New Media & Society, 15(5), 737–751.

    Article  Google Scholar 

  • Dodgson, M., Mathews, J., Kastelle, T., & Hu, M.-C. (2008). The evolving nature of Taiwan’s national innovation system: The case of biotechnology innovation networks. Research Policy, 37(3), 430–445.

    Article  Google Scholar 

  • Duggan, M., & Smith, A. (2013). Social media update 2013. Retrieved January 2, 2018 from http://www.pewinternet.org/2013/12/30/social-media-update-2013.

  • Elmore, S. (2018). The Altmetric Attention Score: What does it mean and why should I care? Toxicologic Pathology, 46(3), 252–255.

    Article  Google Scholar 

  • Etzkowitz, H. (2017). The Triple Helix quest for innovation and entrepreneurship. Speech presented at the 15th Triple Helix International Conference, Daegu, Korea.

  • Etzkowitz, H., & Leydesdorff, L. (1995). The triple helix—university–industry-government relations: A laboratory for knowledge based economic development. EASST Review, 14(1), 11–19.

    Google Scholar 

  • Etzkowitz, H., & Leydesdorff, L. (Eds.). (1997). Universities in the Global Knowledge Economy: A Triple Helix of University–Industry–Government Relations. London: Pinter.

    Google Scholar 

  • Graham, L. (2013). Lonely ideas: can Russia compete?. Cambridge: The MIT Press.

    Google Scholar 

  • Hassan, S.-U., Imran, M., Gillani, U., Aljohani, N., Bowman, T., & Didegah, F. (2017). Measuring social media activity of scientific literature: An exhaustive comparison of scopus and novel altmetrics big data. Scientometrics, 113(2), 1037–1057.

    Article  Google Scholar 

  • Haustein, S., Peters, I., Bar-Ilan, J., Priem, J., Shema, H., & Terliesner, J. (2014). Coverage and adoption of altmetrics sources in the bibliometric community. Scientometrics, 101(2), 1145–1163.

    Article  Google Scholar 

  • Heo, Y. C., & Park, H. W. (2014). How are newspaper companies using social media to engage and connect with their audiences? Characteristics and forms of Korean Newspapers’ YouTube Use. Quality & Quantity, 48(5), 2899–2914.

    Article  Google Scholar 

  • Holmberg, K. J. (2015). Altmetrics for information professionals: Past, present and future. Oxford: Chandos Publishing.

    Google Scholar 

  • Holmberg, K., & Park, H.W. (2018 Online First). An altmetric investigation of the online visibility of South Korea-based scientific journals. Scientometrics, pp. 1–11. https://doi.org/10.1007/s11192-018-2874-8

  • Holmberg, K., & Vainio, J. (2018). Why do some research articles receive more online attention and higher altmetrics? Reasons for online success according to the authors. Scientometrics, 116(1), 435–447.

    Article  Google Scholar 

  • Hughes, D., Rowe, M., Batey, M., & Lee, A. (2012). A tale of two sites: Twitter versus Facebook and the personality predictors of social media usage. Computers in Human Behavior, 28(2), 561–569.

    Article  Google Scholar 

  • KERIS. (2018). Retrieved June 7, 2018 from http://sam.riss.kr/snsSubject.do.

  • Khan, G., Cho, S., & Park, H. W. (2011). A comparison of the Daegu and Edinburgh musical industries: A triple helix approach. Scientometrics, 90(1), 85–99.

    Article  Google Scholar 

  • Kim, J., & Park, H. W. (2014). Food policy in cyberspace: A webometric analysis of national food clusters in South Korea. Government Information Quarterly, 31(3), 443–453.

    Article  Google Scholar 

  • KISTI. (2018). Retrieved June 7, 2018 from http://www.kpubs.org.

  • Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500, 491–493.

    Article  Google Scholar 

  • Kwon, K.-S., Park, H. W., So, M. H., & Leydesdorff, L. (2012). Has globalization strengthened South Korea’s national research system? National and International dynamics of the Triple Helix of scientific co-authorship relationships in South Korea. Scientometrics, 90(1), 163–176.

    Article  Google Scholar 

  • Lee, K. (2014). Schumpeterian analysis of economic catch-up. Cambridge: Cambridge University Press.

    Google Scholar 

  • Li, F., Yi, Y., Guo, X., & Qi, W. (2012). Performance evaluation of research universities in Mainland China, Hong Kong and Taiwan: based on a two-dimensional approach. Scientometrics, 90(2), 531–542.

    Article  Google Scholar 

  • Leydesdorff, L. (2003). The mutual information of university–industry–government relations: An indicator of the Triple Helix dynamics. Scientometrics, 58(2), 445–467.

    Article  Google Scholar 

  • Nam, Y., Lee, Y., & Park, H. W. (2015). Measuring web ecology by Facebook, Twitter, Blog and online news: 2012 General election in South Korea. Quality & Quantity, 49(2), 675–689. https://doi.org/10.1007/s11135-014-0016-9.

    Article  Google Scholar 

  • Park, H. W. (2014a). Transition from the triple helix to N-tuple helices? An interview with Elias G. Carayannis and David F. J Campbell Scientometrics, 99(1), 203–207.

    Article  Google Scholar 

  • Park, H. W. (2014b). An interview with Loet Leydesdorff: The past, present, and future of the triple Helix in the age of big data. Scientometrics, 99(1), 199–202.

    Article  Google Scholar 

  • Park, H. W., Hong, H. D., & Leydesdorff, L. (2005). A comparison of the knowledge-based innovation systems in the economies of South Korea and The Netherlands using triple Helix indicators. Scientometrics, 65(1), 3–27.

    Article  Google Scholar 

  • Park, H. W., & Kluver, R. (2009). Trends in online networking among South Korean politicians. Government Information Quarterly, 26(3), 505–515.

    Article  Google Scholar 

  • Park, H. C., Yoon, J. H., & Park, H. W. (2018 Online First). Global mapping of scientific information exchange using altmetric data. Quality & Quantity.

  • Phillips, F. (2014). Triple helix and the circle of innovation. Journal of Contemporary Eastern Asia, 13(1), 57–68.

    Article  Google Scholar 

  • Piwower, H. (2013). Value all research products. Nature, 493, 159.

    Google Scholar 

  • Ranga, M., & Etzkowitz, H. (2013). Triple Helix systems: an analytical framework for innovation policy and practice in the knowledge society. Industry & Higher Education, 27(3), 237–262.

    Article  Google Scholar 

  • Rho, W.-J. (2014). Triple Helix for social innovation: The Saemaul Undong for eradicating poverty. Journal of Contemporary Eastern Asia, 13(1), 39–55.

    Article  Google Scholar 

  • Robinson-Garcia, N., Torres-Salinas, D., Zahedi, Z., & Costas, R. (2014). New data, new possibilities: Exploring the insides of Altmetric.com. CoRR, https://www.abs/1408.0135.

  • Statista. (2018). Number of Twitter users in Singapore from 2014 to 2019 (in millions). Retrieved 23 July 2018 from https://www.statista.com/statistics/490600/twitter-users-singapore.

  • Taneja, H. (2016). Mapping an audience-centric World Wide Web: A departure from hyperlink analysis. New Media & Society, 19(9), 1331–1348.

    Article  Google Scholar 

  • Tattersall, A., & Carroll, C. (2017). What can Altmetrics tell us about policy impact of research? An analysis of Altmetrics data for research articles from the University of Sheffield. Frontiers. Abstract retrieved from https://www.frontiersin.org/articles/10.3389/frma.2017.00009/abstract.

  • The Open Syllabus Project. (2017). Retrieved November 4, 2017, from https://opensyllabusproject.org/.

  • Thelwall, M. (2012). A history of webometrics. Bulletin of the Association for Information Science and Technology, 39(6), 18–24. https://doi.org/10.1002/bult.2012.1720380606.

    Article  Google Scholar 

  • Thelwall, M. (2017). Web indicators for research evaluation. San Rafael: Morgan & Claypool.

    Google Scholar 

  • Thomson Reuters. (2016). 2016 Journal Citation Reports®.

  • UNESCO. (2015). UNESCO science report: Towards 2030. Paris: UNESCO Publishing.

    Google Scholar 

  • Wilford, G. (2017). China launches internet crackdown to make it harder for people to avoid its ‘Great Firewall’. Independent. Retrieved July 23, 2018 from https://www.independent.co.uk/news/world/asia/china-internet-crackdown-virtual-private-networks-vpns-facebook-twitter-youtube-google-whatsapp-a7879641.html.

  • Yang, H., & Jung, W. S. (2016). Assessing knowledge structures for public research institutes. Journal of Contemporary Eastern Asia, 15(1), 27–40.

    Article  Google Scholar 

  • Ye, Yu., & Leydesdorff, L. (2013). The triple helix of university–industry–government relations at the country level and its dynamic evolution under the pressure of globalization. Journal of the American Society for Information Science and Technology, 64(11), 2317–2325.

    Article  Google Scholar 

  • Yoon, J. W., Yang, J. S., & Park, H. W. (2017). Quintuple Helix structure of Sino-Korean research collaboration in science. Scientometrics, 113(1), 61–81.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to express our gratitude to Altmetric.com for providing the dataset. We also appreciate thoughtful and precious feedbacks and suggestions from the anonymous reviewers on this paper. The authors wish to thank the assistance from Hyo-Chan Park and Young-Suk Paek during data collection.

Author information

Authors and Affiliations

  1. Department of Educational Theory and Practice, University at Albany, SUNY, Albany, NY, 12222, USA

    Hyejin Park

  2. Department of Media and Communication, Interdisciplinary Program of Digital Convergence Business, Cyber Emotions Research Center, YeungNam University, Gyeongsan-si, Gyeongsangbuk-do, 712-749, South Korea

    Han Woo Park

Authors
  1. Hyejin Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Han Woo Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Han Woo Park.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Park, H., Park, H.W. Research evaluation of Asian countries using altmetrics: comparing South Korea, Japan, Taiwan, Singapore, and China. Scientometrics 117, 771–788 (2018). https://doi.org/10.1007/s11192-018-2884-6

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-018-2884-6

Keywords

Search

Navigation