skip to main content
10.1145/3555228.3555252acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

A Decade of Internationalization of the Brazilian Symposium on Software Engineering: The Good, the Bad, and the Ugly

Published: 05 October 2022 Publication History

Abstract

Increasing the international visibility of their papers is an old desire of the Brazilian Symposium on Software Engineering (SBES) community. In that regard, the community has taken several actions throughout the years, such as incentivizing the submission of papers in English and, since 2009, publishing the symposium’s proceedings in closed-access international digital libraries. However, thus far, there have been no studies aimed at evaluating the real impact of such initiatives. In this paper, we report on a bibliometric study whose goal was to assess the impact of SBES’s internationalization effort. To this end, we have collected and classified language and citation data from papers published in the SBES Research Track from 2010 to 2020. One can examine the results of our study from multiple views. A more generous view (the “good”) reveals that, by obtaining around 40-60% of its citations from the international community, SBES might have achieved its internationalization goals with reasonable success. A more rigorous view (the “bad”), in turn, highlights that, by still attracting at least 40% of its citations from the Brazilian community, SBES’s internationalization might not compensate for its inevitable weight on the community, i.e., the international libraries’ publication costs and their non-compliance to well established Open Science principles. Finally, a more critical view (the “ugly”) calls attention to the relatively high percentage (25-50%) of SBES papers’ self-citations, well above the average rate in Computer Science and other disciplines.

Supplementary Material

SBES 2010-2020 language and citations dataset (p1-mendonca-supplement.zip)

References

[1]
Rodrigo Costas, Thed van Leeuwen, and María Bordons. 2010. Self-citations at the meso and individual levels: effects of different calculation methods. Scientometrics 82, 3 (2010), 517–537.
[2]
Francisco Dantas and Alessandro Garcia. 2013. Relatório Final: Internacionalização do SBES. http://comissoes.sbc.org.br/ce-es/documentos/Relatorio_SBES_survey_comunidade_dantas_garcia.pdf. [Online; último acesso em 2022/08/08 20:54:37].
[3]
Emilio Delgado López-Cózar, Enrique Orduña-Malea, and Alberto Martín-Martín. 2019. Google Scholar as a data source for research assessment. In Springer handbook of science and technology indicators. Springer, 95–127.
[4]
European Commission. 2021. Open Science. https://ec.europa.eu/info/research-and-innovation/strategy/strategy-2020-2024/our-digital-future/open-science_en. [Online; último acesso em 2022/08/08 20:54:37].
[5]
Emmanuel Sávio Silva Freire, Daniela Medeiros Cedro, and Antonio de Barros Serra. 2018. An Analysis of Brazilian Symposium on Software Quality (SBQS) Retrospective, Relevance, and Trends in the Past 5 Years. In Proceedings of the 17th Brazilian Symposium on Software Quality. 31–40.
[6]
Isabela Gasparini 2014. Análise das redes de coautoria do simpósio brasileiro sobre fatores humanos em sistemas computacionais. In 13th Brazilian Symposium on Human Factors in Computing Systems. 323–332.
[7]
Governo Federal. 2020. Portal de Periódicos da CAPES. https://www-periodicos-capes-gov-br.ezl.periodicos.capes.gov.br/. [Online; último acesso em 2022/08/08 20:54:37].
[8]
Alberto Henrique Frade Laender, Claudia Maria Bauzer Medeiros, Iscia Lopes-Cendes, Mauricio Lima Barreto, Marie-Anne Van Sluys, and Ulisses Barres de Almeida. 2020. Abertura e gestão de dados: desafios para a ciência brasileira. Technical Report.
[9]
Nabor C Mendonça. 2021. Abertura e Internacionalização do SBES: Um Oximoro Irreconciliável?. In I Workshop de Práticas de Ciência Aberta para Engenharia de Software. SBC, 49–51.
[10]
Nabor C Mendonça, Igor Steinmacher, Igor Wiese, Bruno Cartaxo, and Gustavo Pinto. 2021. Quao Fechada é a Comunidade do SBES? TL; DR: Nao Passarás!. In I Workshop de Práticas de Ciência Aberta para Engenharia de Software. SBC, 13–18.
[11]
Tobias Milz and Christin Seifert. 2018. Analysing author self-citations in computer science publications. In International Conference on Database and Expert Systems Applications. Springer, 289–300.
[12]
Davi Monteiro, Rômulo Gadelha, Thayse Alencar, Bruno Neves, Italo Yeltsin, Thiago Gomes, and Mariela Cortés. 2017. An analysis of the empirical Software Engineering over the last 10 editions of Brazilian Software Engineering Symposium. In 31st Brazilian Symposium on Software Engineering. 44–53.
[13]
Enrique Orduna-Malea, Alberto Martín Martín, Emilio Delgado Lopez-Cozar, 2017. Google Scholar as a source for scholarly evaluation: A bibliographic review of database errors. Revista Española de Documentación Científica 40, 4(2017), e185.
[14]
Fabio Pacheco, Igor Wiese, Igor Steinmacher, Bruno Cartaxo, and Gustavo Pinto. 2019. How Open is the SBES PC Community?. In XXXIII Brazilian Symposium on Software Engineering. 7–11.
[15]
Paulo Anselmo da Mota Silveira Neto, Joás Sousa Gomes, Eduardo Santana De Almeida, Jair Cavalcanti Leite, Thais Vasconcelos Batista, and Larissa Leite. 2013. 25 years of software engineering in Brazil: Beyond an insider’s view. Journal of Systems and Software 86, 4 (2013), 872–889.
[16]
Igor Steinmacher 2013. Tópicos de pesquisa e rede de coautoria no Simpósio Brasileiro de Sistemas Colaborativos. In 10th Brazilian Symposium on Collaborative Systems. 88–95.
[17]
Martin Szomszor, David A Pendlebury, and Jonathan Adams. 2020. How much is too much? The difference between research influence and self-citation excess. Scientometrics 123, 2 (2020), 1119–1147.
[18]
The Computing Research and Education Association of Australasia. 2016. CORE Rankings Portal. https://www.core.edu.au/conference-portal. [Online; último acesso em 2022/08/08 20:54:37].
[19]
The dblp team. 2021. dblp computer science bibliography. https://dblp.uni-trier.de/. Último acesso em 2022/08/08 20:54:37.
[20]
Ludo Waltman. 2016. A review of the literature on citation impact indicators. Journal of informetrics 10, 2 (2016), 365–391.
[21]
Wikipedia. 2021. Open access. https://en.wikipedia.org/wiki/Open_access. [Online; último acesso em 2022/08/08 20:54:37].
[22]
Glänzel Wolfgang, Thijs Bart, and Schlemmer Balázs. 2004. A bibliometric approach to the role of author self-citations in scientific communication. Scientometrics 59, 1 (2004), 63–77.

Cited By

View all

Index Terms

  1. A Decade of Internationalization of the Brazilian Symposium on Software Engineering: The Good, the Bad, and the Ugly

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      SBES '22: Proceedings of the XXXVI Brazilian Symposium on Software Engineering
      October 2022
      457 pages
      ISBN:9781450397353
      DOI:10.1145/3555228
      Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 October 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. citation impact
      2. empirical studies
      3. open science

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • CAPES
      • CNPq
      • INES

      Conference

      SBES 2022
      SBES 2022: XXXVI Brazilian Symposium on Software Engineering
      October 5 - 7, 2022
      Virtual Event, Brazil

      Acceptance Rates

      Overall Acceptance Rate 147 of 427 submissions, 34%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 76
        Total Downloads
      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media