Abstract
Feedback on research artefacts from people beyond local research groups, such as researchers in online research communities, has the potential to bring in additional support for early-stage researchers and complementary viewpoints to research projects. While current literature has focused primarily on early-stage research seeking or getting support for research skills development in general, less is known about, more specifically, empirical understanding of how early-stage researchers exchange feedback with external researchers. In this paper, we focus on understanding the critical types of external feedback that early-stage researchers desire and the prevalent challenges they face with exchanging feedback with external helpers. We report on a large-scale survey conducted with early-stage researchers of diverse backgrounds. Our findings lay the empirical foundation for informing the designing of socio-technical systems for research feedback exchange.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The full survey is available at https://bit.ly/3bOkwzX.
- 2.
Full demographic information at https://bit.ly/2MVgPP8.
- 3.
We did not considered geographical location due to the distribution of responses, and for not being a reliable indicator of the individual circumstances of the ESRs.
References
Anonymous: The opportunities and challenges of using socio-technical systems to learn research skills from external communities (2021, unpublished)
Campbell, J., Aragon, C., Davis, K., Evans, S., Evans, A., Randall, D.: Thousands of positive reviews: distributed mentoring in online fan communities. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW 2016, pp. 691–704. ACM, New York (2016)
Castán Broto, V., Gislason, M., Ehlers, M.H.: Practising interdisciplinarity in the interplay between disciplines: experiences of established researchers. Environ. Sci. Policy 12(7), 922–933 (2009)
Chen, Y., Lee, S.W., Xie, Y., Yang, Y., Lasecki, W.S., Oney, S.: Codeon: on-demand software development assistance. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI 2017, pp. 6220–6231. ACM, New York (2017)
Cheng, R., Zeng, Z., Liu, M., Dow, S.: Critique me: exploring how creators publicly request feedback in an online critique community. Proc. ACM Hum.-Comput. Interact. 4(CSCW2), 1–24 (2020)
Daniel, F., Kucherbaev, P., Cappiello, C., Benatallah, B., Allahbakhsh, M.: Quality control in crowdsourcing: a survey of quality attributes, assessment techniques, and assurance actions. ACM Comput. Surv. 51(1), 7:1–7:40 (2018)
Evans, S., et al.: More than peer production: fanfiction communities as sites of distributed mentoring. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW 2017, pp. 259–272. ACM, New York (2017)
Hui, J.S., Easterday, M.W., Gerber, E.M.: Distributed apprenticeship in online communities. Hum.-Comput. Interact. 34(4), 328–378 (2019)
Jeng, W., DesAutels, S., He, D., Li, L.: Information exchange on an academic social networking site: a multidiscipline comparison on researchgate Q &A. J. Am. Soc. Inf. Sci. 68(3), 638–652 (2017)
Jiang, Y., Schlagwein, D., Benatallah, B.: A review on crowdsourcing for education: state of the art of literature and practice. In: Proceedings of the 22nd Pacific Asia Conference on Information Systems, PACIS 2018, p. 180. AISeL, Japan (2018)
Jones, R., Colusso, L., Reinecke, K., Hsieh, G.: R/science: challenges and opportunities in online science communication. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–14. ACM (2019). https://doi.org/10.1145/3290605.3300383
Kizilcec, R.F., Halawa, S.: Attrition and achievement gaps in online learning. In: Proceedings of the Second (2015) ACM Conference on Learning @ Scale, L@S 2015, pp. 57–66. Association for Computing Machinery, New York (2015)
Law, E., Gajos, K.Z., Wiggins, A., Gray, M.L., Williams, A.: Crowdsourcing as a tool for research: implications of uncertainty. In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW 2017, pp. 1544–1561. ACM, New York (2017)
Marlow, J., Dabbish, L.: From rookie to all-star: professional development in a graphic design social networking site. In: Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW 2014, pp. 922–933. Association for Computing Machinery, New York (2014). https://doi.org/10.1145/2531602.2531651
Motahar, T., Jasim, M., Ahmed, S.I., Mahyar, N.: Exploring how international graduate students in the us seek support. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–8 (2020)
Storey, M.A., Zagalsky, A., Figueira Filho, F., Singer, L., German, D.M.: How social and communication channels shape and challenge a participatory culture in software development. IEEE Trans. Softw. Eng. 43(2), 185–204 (2017)
Sugimoto, C.R., Work, S., Lariviere, V., Haustein, S.: Scholarly use of social media and altmetrics: a review of the literature. J. Am. Soc. Inf. Sci. 68(9), 2037–2062 (2017)
Torrey, C., McDonald, D.W., Schilit, B.N., Bly, S.: How-to pages: informal systems of expertise sharing. In: Bannon, L.J., Wagner, I., Gutwin, C., Harper, R.H.R., Schmidt, K. (eds.) ECSCW 2007, pp. 391–410. Springer, London, London (2007). https://doi.org/10.1007/978-1-84800-031-5_21
Vaish, R., et al.: Crowd research: open and scalable university laboratories. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, pp. 829–843. Association for Computing Machinery, New York (2017)
Vaish, R., Goyal, S., Saberi, A., Goel, S.: Creating crowdsourced research talks at scale. In: Proceedings of the 2018 World Wide Web Conference, pp. 1–11 (2018)
Van Noorden, R.: Online collaboration: scientists and the social network. Nat. News 512(7513), 126 (2014)
Wang, T., Li, L.Y.: ‘Tell me what to do’ vs. ‘guide me through it’: feedback experiences of international doctoral students. Active Learn. High. Educ. 12(2), 101–112 (2011)
Zhang, H., Easterday, M.W., Gerber, E.M., Lewis, D.R., Maliakal, L.: Agile research studios: orchestrating communities of practice to advance research training. In: Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW 2017, Companion, pp. 45–48. ACM, New York (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, Y., Báez, M., Benatallah, B. (2024). Towards Scaling External Feedback for Early-Stage Researchers: A Survey Study. In: Sellami, M., Vidal, ME., van Dongen, B., Gaaloul, W., Panetto, H. (eds) Cooperative Information Systems. CoopIS 2023. Lecture Notes in Computer Science, vol 14353. Springer, Cham. https://doi.org/10.1007/978-3-031-46846-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-46846-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46845-2
Online ISBN: 978-3-031-46846-9
eBook Packages: Computer ScienceComputer Science (R0)