skip to main content
10.1145/3491140.3528322acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesl-at-sConference Proceedingsconference-collections
short-paper

Collaborative Annotation: Links to Formative Assessment and Issues of Scale for Pedagogy

Published: 01 June 2022 Publication History

Abstract

Annotations on text have been made to spark thoughts, add nuance, and facilitate reading since the inception of printed text itself. Newly emerging collaborative online annotation platforms, such as hypothes.is and Perusall, are enabling annotation of webpages and digital documents on a scale never before seen, serving students in very large numbers. Hypothes.is also seems poised to positively disrupt the peer and post-publication peer review process. Previous review articles have done an excellent job critically analyzing annotation for those in higher education, and predicting the future, but pedagogical issues based on the number of annotators, amount of annotation, and public access for a document have not received much attention. Collaborative annotation also has some natural connections to the formative assessment field, which have not been sufficiently explored in the past. This brief review will examine how the number of annotators, an issue of scale, can hinder or benefit learners, and how annotation can embody a formative assessment practice. The educational technology and assessment fields have much to gain by investigating the routines surrounding dynamically annotated text.

References

[1]
Marc Andreessen. 2014. Why Andreessen Horowitz Is Investing in Rap Genius. Retrieved July 19, 2021 from http://genius.com/Marc-andreessen-why-andreessen-horowitz-is-investing-in-rap-genius-annotated
[2]
David Carless. 2016. Feedback as dialogue. Encycl. Educ. Philos. theory (2016), 1--6.
[3]
Jeffrey Clapp, Matthew DeCoursey, Sze Wah Sarah Lee, and Kris Li. 2020. "Something fruitful for all of us": Social annotation as a signature pedagogy for literature education. Arts Humanit. High. Educ. (2020), 1474022220915128.
[4]
Philippe Duchastel and Yung-Ping Chen. 1980. The use of marginal notes in text to assist learning. Educ. Technol. 20, 11 (1980), 41--45.
[5]
Hypothes.is, "To enable a conversation over the world's knowledge." Retrieved April 1, 2022 from https://web.hypothes.is/about/
[6]
Christopher M Kelty, C Sidney Burrus, and Richard G Baraniuk. 2008. Peer review anew: Three principles and a case study in postpublication quality assurance. Proc. IEEE 96, 6 (2008), 1000--1011.
[7]
Nikolaus Kriegeskorte. 2012. Open Evaluation: A Vision for Entirely Transparent Post-Publication Peer Review and Rating for Science. Front. Comput. Neurosci. 6, October (2012).
[8]
Kelly Miller, Sacha Zyto, David Karger, Junehee Yoo, and Eric Mazur. 2016. Analysis of student engagement in an online annotation system in the context of a flipped introductory physics class. Phys. Rev. Phys. Educ. Res. 12, 2 (2016), 1--12.
[9]
Christine M Neuwirth and Patricia G Wojahn. 1996. Learning to write: Computer support for a cooperative process. CSCL Theory Pract. an Emerg. Paradig. (1996), 147--170.
[10]
David Nicol. 2010. From monologue to dialogue: improving written feedback processes in mass higher education. Assess. Eval. High. Educ. 35, 5 (2010), 501--517.
[11]
David J Nicol and Debra Macfarlane?Dick. 2006. Formative assessment and self?regulated learning: A model and seven principles of good feedback practice. Stud. High. Educ. 31, 2 (2006), 199--218.
[12]
Elena Novak, Rim Razzouk, and Tristan E Johnson. 2012. The educational use of social annotation tools in higher education: A literature review. Internet High. Educ. 15, 1 (2012), 39--49.
[13]
Perusall, "About Perusall." Retrieved April 1, 2022 from https://perusall.com/about
[14]
D Royce Sadler. 1989. Formative assessment and the design of instructional systems. Instr. Sci. 18, 2 (1989), 119--144.
[15]
Michele L Simpson and Sherrie L Nist. 1990. Textbook annotation: An effective and efficient study strategy for college students. J. Read. 34, 2 (1990), 122--129.
[16]
Fiona Townsend. 2013. Post-publication peer review: PubPeer. Ed. Bull. 9, 3 (2013), 45--46.
[17]
Chunhua Weng and John H Gennari. 2004. Asynchronous collaborative writing through annotations. In Proceedings of the 2004 ACM conference on Computer supported cooperative work, 578--581.
[18]
Joanna L Wolfe. 2000. Effects of annotations on student readers and writers. In Proceedings of the fifth ACM conference on Digital libraries, 19--26.
[19]
Joanna L Wolfe and Christine M Neuwirth. 2001. From the margins to the center: The future of annotation. J. Bus. Tech. Commun. 15, 3 (2001), 333--371.
[20]
Min Yang and David Carless. 2013. The feedback triangle and the enhancement of dialogic feedback processes. Teach. High. Educ. 18, 3 (2013), 285--297.

Cited By

View all
  • (2023)Empowering English Teachers to be Grammar ‘Experts’ and Coursebook Analysts via PerusallRELC Journal10.1177/0033688223118523054:2(517-536)Online publication date: 10-Aug-2023
  • (2023)Group formation based on reading annotation data: system innovation and classroom practiceJournal of Computers in Education10.1007/s40692-023-00274-y11:3(667-695)Online publication date: 24-Apr-2023

Index Terms

  1. Collaborative Annotation: Links to Formative Assessment and Issues of Scale for Pedagogy

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    L@S '22: Proceedings of the Ninth ACM Conference on Learning @ Scale
    June 2022
    491 pages
    ISBN:9781450391580
    DOI:10.1145/3491140
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 June 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. annotation
    2. assessment
    3. asynchronous
    4. feedback
    5. formative
    6. hypothes.is
    7. peer learning
    8. perusall

    Qualifiers

    • Short-paper

    Conference

    L@S '22
    L@S '22: Ninth (2022) ACM Conference on Learning @ Scale
    June 1 - 3, 2022
    NY, New York City, USA

    Acceptance Rates

    Overall Acceptance Rate 117 of 440 submissions, 27%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Empowering English Teachers to be Grammar ‘Experts’ and Coursebook Analysts via PerusallRELC Journal10.1177/0033688223118523054:2(517-536)Online publication date: 10-Aug-2023
    • (2023)Group formation based on reading annotation data: system innovation and classroom practiceJournal of Computers in Education10.1007/s40692-023-00274-y11:3(667-695)Online publication date: 24-Apr-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media