skip to main content
10.1145/2526667.2526671acmotherconferencesArticle/Chapter ViewAbstractPublication PagessensecamConference Proceedingsconference-collections
research-article

Do you see what I see: crowdsource annotation of captured scenes

Published: 18 November 2013 Publication History

Abstract

The Archive of Many Outdoor Scenes has captured 400 million images. Many of these cameras and images are of street intersections, a subset of which has experienced built environment improvements during the past seven years. We identified six cameras in Washington, DC, and uploaded 120 images from each before a built environment change (2007) and after (2010) to the crowdsourcing website Amazon Mechanical Turk (n=1,440). Five unique MTurk workers annotated each image, counting the number of pedestrians, cyclists, and vehicles. Two trained Research Assistants completed the same tasks. Reliability and validity statistics of MTurk workers revealed substantial agreement in annotating captured images of pedestrians and vehicles. Using the mean annotation of four MTurk workers proved most parsimonious for valid results. Crowdsourcing was shown to be a reliable and valid workforce for annotating images of outdoor human behavior.

References

[1]
Jacobs, N., et al., The Global Network of Outdoor Webcams: Properties and Applications. ACM International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS), 2009: p. 111--120.
[2]
Hipp, J. A., et al., Emerging Technologies: Webcams and Crowd-Sourcing to Identify Active Transportation. American Journal of Preventive Medicine, 2013. 44(1): p. 96--97.
[3]
Landis, J. R. and G. G. Koch, The Measurement of Observer Agreement for Categorical Data. Biometrics, 1977. 33(1): p. 159--174.

Cited By

View all
  • (2020)From Do You See What I See? to Do You Control What I See? Mediated Vision, From a Distance, for Eyewear UsersProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3432089(326-328)Online publication date: 22-Nov-2020
  • (2019)Visualization of Pedestrian Density Dynamics Using Data Extracted from Public WebcamsISPRS International Journal of Geo-Information10.3390/ijgi81205598:12(559)Online publication date: 5-Dec-2019
  • (2018)Can the crowd tell how I feel? Trait empathy and ethnic background in a visual pain judgment taskUniversal Access in the Information Society10.1007/s10209-018-0611-y17:3(649-661)Online publication date: 1-Aug-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SenseCam '13: Proceedings of the 4th International SenseCam & Pervasive Imaging Conference
November 2013
99 pages
ISBN:9781450322478
DOI:10.1145/2526667
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

  • QI: Qualcomm Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2013

Check for updates

Author Tags

  1. crowdsources
  2. physical activity
  3. reliability
  4. validity
  5. webcams

Qualifiers

  • Research-article

Funding Sources

Conference

SenseCam '13
Sponsor:
  • QI
SenseCam '13: International SenseCam & Pervasive Imaging Conference 2013
November 18 - 19, 2013
California, San Diego, USA

Acceptance Rates

SenseCam '13 Paper Acceptance Rate 9 of 22 submissions, 41%;
Overall Acceptance Rate 9 of 22 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)From Do You See What I See? to Do You Control What I See? Mediated Vision, From a Distance, for Eyewear UsersProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3432089(326-328)Online publication date: 22-Nov-2020
  • (2019)Visualization of Pedestrian Density Dynamics Using Data Extracted from Public WebcamsISPRS International Journal of Geo-Information10.3390/ijgi81205598:12(559)Online publication date: 5-Dec-2019
  • (2018)Can the crowd tell how I feel? Trait empathy and ethnic background in a visual pain judgment taskUniversal Access in the Information Society10.1007/s10209-018-0611-y17:3(649-661)Online publication date: 1-Aug-2018
  • (2016)Webcams, Crowdsourcing, and Enhanced Crosswalks: Developing a Novel Method to Analyze Active TransportationFrontiers in Public Health10.3389/fpubh.2016.000974Online publication date: 19-May-2016
  • (2016)Learning from Outdoor Webcams: Surveillance of Physical Activity Across EnvironmentsSeeing Cities Through Big Data10.1007/978-3-319-40902-3_26(471-490)Online publication date: 8-Oct-2016
  • (2015)Cameras and crowds in transportation trackingProceedings of the conference on Wireless Health10.1145/2811780.2811941(1-8)Online publication date: 14-Oct-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media