skip to main content
10.1145/2556420.2556788acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
demonstration

CrowdCrit: crowdsourcing and aggregating visual design critique

Published: 15 February 2014 Publication History

Abstract

People who create visual designs often struggle to find high-quality critique outside a firm or classroom, and current online feedback solutions are limited. We created a system called CrowdCrit which leverages paid crowdsourcing to generate and visualize high-quality visual design critique. Our work extends prior crowd feedback research by focusing on scaffolding the process and language of studio critique for crowds.

Supplementary Material

JPG File (cscwde16.jpg)
suppl.mov (cscwde16.mp4)
Supplemental video

References

[1]
Dondis, D.A. A primer of visual literacy. MIT Press, Cambridge, Mass., 1973.
[2]
Dow, S., Gerber, E., and Wong, A. A pilot study of using crowds in the classroom. Proc. CHI 2013, ACM (2013), 227--236.
[3]
Feldman, E.B. Practical art criticism. Prentice Hall, 1994.
[4]
Marlow, J. and Dabbish, L. From Rookie to All-Star: Professional Development in a Graphic Design Community of Practice. To appear in Proc. CSCW 2014 (2014).
[5]
Sadler, D.R. Formative Assessment and the Design of Instructional Systems. Instructional Science 18, 2 (1989), 119--44.
[6]
Shneiderman, B. The eyes have it: a task by data type taxonomy for information visualizations. IEEE Symposium on Visual Languages, 1996. Proceedings, (1996), 336--343.
[7]
Soloway, E., Guzdial, M., and Hay, K.E. Learner- centered design: the challenge for HCI in the 21st century. interactions 1, 2 (1994), 36--48.
[8]
Xu, A. and Bailey, B. What do you think?: a case study of benefit, expectation, and interaction in a large online critique community. Proc. CSCW 2012, ACM (2012), 295--304.
[9]
Xu, A., Bailey, B.P., and Huang, S.-W. Voyant: Generating Structured Feedback on Visual Designs Using a Crowd of Non-Experts. To appear in Proc. CSCW 2014 (2014).

Cited By

View all
  • (2024)DesignChecker: Visual Design Support for Blind and Low Vision Web DevelopersProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676369(1-19)Online publication date: 13-Oct-2024
  • (2024)Peerdea: Co-Designing a Peer Support Platform with Creative EntrepreneursProceedings of the ACM on Human-Computer Interaction10.1145/36373848:CSCW1(1-24)Online publication date: 26-Apr-2024
  • (2024)Generating Automatic Feedback on UI Mockups with Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642782(1-20)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. CrowdCrit: crowdsourcing and aggregating visual design critique

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW Companion '14: Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing
    February 2014
    372 pages
    ISBN:9781450325417
    DOI:10.1145/2556420
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 February 2014

    Check for updates

    Author Tags

    1. critique
    2. crowdsourcing
    3. design
    4. feedback
    5. scaffolding

    Qualifiers

    • Demonstration

    Conference

    CSCW'14
    Sponsor:
    CSCW'14: Computer Supported Cooperative Work
    February 15 - 19, 2014
    Maryland, Baltimore, USA

    Acceptance Rates

    CSCW Companion '14 Paper Acceptance Rate 88 of 497 submissions, 18%;
    Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)50
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 04 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)DesignChecker: Visual Design Support for Blind and Low Vision Web DevelopersProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676369(1-19)Online publication date: 13-Oct-2024
    • (2024)Peerdea: Co-Designing a Peer Support Platform with Creative EntrepreneursProceedings of the ACM on Human-Computer Interaction10.1145/36373848:CSCW1(1-24)Online publication date: 26-Apr-2024
    • (2024)Generating Automatic Feedback on UI Mockups with Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642782(1-20)Online publication date: 11-May-2024
    • (2024)"I'd be watching him contour till 10 o'clock at night": Understanding Tensions between Teaching Methods and Learning Needs in Healthcare ApprenticeshipProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642453(1-19)Online publication date: 11-May-2024
    • (2024)Understanding how early-stage researchers leverage socio-technical affordances for distributed research supportInformation and Software Technology10.1016/j.infsof.2023.107340165(107340)Online publication date: Jan-2024
    • (2023)Aligning Crowdworker Perspectives and Feedback Outcomes in Crowd-Feedback System DesignProceedings of the ACM on Human-Computer Interaction10.1145/35794567:CSCW1(1-28)Online publication date: 16-Apr-2023
    • (2023)VisLab: Enabling Visualization Designers to Gather Empirically Informed Design FeedbackProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581132(1-18)Online publication date: 19-Apr-2023
    • (2022)CrowdGraph: A Crowdsourcing Multi-modal Knowledge Graph Approach to Explainable Fauxtography DetectionProceedings of the ACM on Human-Computer Interaction10.1145/35551786:CSCW2(1-28)Online publication date: 11-Nov-2022
    • (2022)SnappView, a Software Development Kit for Supporting End-user Mobile Interface ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35345276:EICS(1-38)Online publication date: 17-Jun-2022
    • (2021)A Framework for Open Civic Design: Integrating Public Participation, Crowdsourcing, and Design ThinkingDigital Government: Research and Practice10.1145/34876072:4(1-22)Online publication date: 16-Dec-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media