research-article

An Evaluation of Gamesourced Data for Human Pose Estimation

Authors:

Scott Spurlock,

Richard SouvenirAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 6, Issue 2

Article No.: 19, Pages 1 - 16

https://doi.org/10.1145/2629465

Published: 31 March 2015 Publication History

Abstract

Gamesourcing has emerged as an approach for rapidly acquiring labeled data for learning-based, computer vision recognition algorithms. In this article, we present an approach for using RGB-D sensors to acquire annotated training data for human pose estimation from 2D images. Unlike other gamesourcing approaches, our method does not require a specific game, but runs alongside any gesture-based game using RGB-D sensors. The automatically generated datasets resulting from this approach contain joint estimates within a few pixel units of manually labeled data, and a gamesourced dataset created using a relatively small number of players, games, and locations performs as well as large-scale, manually annotated datasets when used as training data with recent learning-based human pose estimation methods for 2D images.

References

[1]

Lubomir Bourdev and Jitendra Malik. 2009. Poselets: Body part detectors trained using 3D human pose annotations. In Proceedings of the International Conference on Computer Vision. IEEE.

[2]

Mayur Datar, Nicole Immorlica, Piotr Indyk, and Vahab S. Mirrokni. 2004. Locality-sensitive hashing scheme based on p-stable distributions. In Proceedings of the Symposium on Computational Geometry. ACM, New York, NY, 253--262.

Digital Library

[3]

Marcin Eichner and Vittorio Ferrari. 2009. Better appearance models for pictorial structures. In Proceedings of the British Machine Vision Conference.

[4]

P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. 2009. Object detection with discriminatively trained part-based models. Transactions on Pattern Analysis and Machine Intelligence 32, 1627--1645.

Digital Library

[5]

Vittorio Ferrari, Manuel Marin-Jimenez, and Andrew Zisserman. 2008. Progressive search space reduction for human pose estimation. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 1--8.

[6]

Samantha Finkelstein, Andrea Nickel, Zachary Lipps, Tiffany Barnes, Zachary Wartell, and Evan A. Suma. 2011. Astrojumper: Motivating exercise with an immersive virtual reality exergame. Presence: Teleoperators and Virtual Environments 20, 78--92.

Digital Library

[7]

Simon Fothergill, Helena M. Mentis, Pushmeet Kohli, and Sebastian Nowozin. 2012. Instructing people for training gestural interactive systems. In Proceedings of the CHI, Joseph A. Konstan, Ed H. Chi, and Kristina Höök (Eds.). ACM, New York, NY, 1737--1746.

Digital Library

[8]

Chien-Ju Ho, Tsung-Hsiang Chang, and Jane Yung jen Hsu. 2007. PhotoSlap: A multi-player online game for semantic annotation. In Proceedings of the AAAI Conference on Artificial Intelligence. 1359--1364.

Digital Library

[9]

Allison Janoch, SSergey Karayev, Yangqing Jia, Jonathan T. Barron, Mario Fritz, Kate Saenko, and Trevor Darrell. 2011. A category-level 3-D object dataset: Putting the Kinect to work. In Proceedings of the International Conference on Computer Vision Workshops (ICCV Workshops). IEEE, 1168--1174.

[10]

Sam Johnson and Mark Everingham. 2010. Clustered pose and nonlinear appearance models for human pose estimation. In Proceedings of the British Machine Vision Conference.

[11]

Sam Johnson and Mark Everingham. 2011. Learning effective humanpose estimation from inaccurate annotation. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE.

Digital Library

[12]

Kinect Hacks. 2012. Kung Fu Tetris. Retrieved February 17, 2015 from http://www.kinecthacks.com/kinect-game-kungfu-tetris/.

[13]

Kevin Lai, Liefeng Bo, Xiaofeng Ren, and Dieter Fox. 2011. A large-scale hierarchical multi-view RGB-D object dataset. In Proceedings of the International Conference on Robotics and Automation (ICRA’11). IEEE, 1817--1824.

[14]

Simone Milani and Giancarlo Calvagno. 2012. Joint denoising and interpolation of depth maps for MS Kinect sensors. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 797--800.

[15]

Deva Ramanan. 2007. Learning to parse images of articulated bodies. In Advances in Neural Information Processing Systems. 1129.

[16]

Rómer Rosales and Stan Sclaroff. 2001. Learning body pose via specialized maps. In Advances in Neural Information Processing Systems. 1263--1270.

[17]

Benjamin Sapp and Ben Taskar. 2013. Multimodal decomposable models for human pose estimation. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE.

Digital Library

[18]

Cristian Sminchisescu, Atul Kanaujia, Zhiguo Li, and Dimitris Metaxas. 2005. Discriminative density propagation for 3D human motion estimation. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 390--397.

Digital Library

[19]

Richard Souvenir, Ayman Hajja, and Scott Spurlock. 2012. Gamesourcing to acquire labeled human pose estimation data. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 1--6.

[20]

Luciano Spinello and Kai O. Arras. 2011. People detection in RGB-D data. In Proceedings of the International Conference on Intelligent Robots and Systems (IROS’11). IEEE, 3838--3843.

[21]

Evan A. Suma, Belinda Lange, Albert Rizzo, David Krum, and Mark Bolas. 2011. FAAST: The Flexible Action and Articulated Skeleton Toolkit. In Virtual Reality. IEEE, 247--248.

Digital Library

[22]

Antonio Torralba and Alexei A. Efros. 2011. Unbiased look at dataset bias. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 1521--1528.

Digital Library

[23]

Luis Von Ahn and Laura Dabbish. 2004. Labeling images with a computer game. In Proceedings of the International Conference on Human Factors in Computing Systems. ACM, New York, NY, 319--326.

Digital Library

[24]

Luis Von Ahn, Ruoran Liu, and Manuel Blum. 2006. Peekaboom: a game for locating objects in images. In Proceedings of the International Conference on Human Factors in Computing Systems. ACM, New York, NY, 55--64.

Digital Library

[25]

Yi Yang and Deva Ramanan. 2011. Articulated pose estimation with flexible mixtures-of-parts. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE.

Digital Library

Cited By

Zelinka IDas S(2022)Gamesourcing: an unconventional tool to assist the solution of the traveling salesman problemNatural Computing: an international journal10.1007/s11047-020-09817-z21:2(347-357)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/s11047-020-09817-z
Xie LTao DWei H(2016)Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression RecognitionACM Transactions on Intelligent Systems and Technology10.1145/29565568:2(1-21)Online publication date: 25-Oct-2016
https://dl.acm.org/doi/10.1145/2956556

Index Terms

An Evaluation of Gamesourced Data for Human Pose Estimation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

Unsupervised Human Pose Estimation on Depth Images
Machine Learning and Knowledge Discovery in Databases: Applied Data Science Track
Abstract
Human pose estimation is a widely studied problem in the field of computer vision that consists in regressing body joints coordinates from an image. Most state-of-the-art techniques rely on RGB or RGB-D data, but driven by an industrial use-case ...
3D Human Postures Recognition Using Kinect
IHMSC '12: Proceedings of the 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 01

In many application cases, 2D human postures display haven't been able to meet people's requirements which is failure to show human motions comprehensive, image and vivid. However, 3D human Postures display could restore and show human motions well, ...
Kinect-supported dataset creation for human pose estimation
SCCG '14: Proceedings of the 30th Spring Conference on Computer Graphics

Training and evaluation datasets for specific tasks of human pose estimation are hard to find. This paper presents an approach for rapid construction of a precisely annotated training dataset for human pose estimation of a sitting subject, intended ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 6, Issue 2

Special Section on Visual Understanding with RGB-D Sensors

May 2015

381 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/2753829

Editor:
Huan Liu
Arizona State University

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 March 2015

Accepted: 01 March 2014

Revised: 01 January 2014

Received: 01 June 2013

Published in TIST Volume 6, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
184
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zelinka IDas S(2022)Gamesourcing: an unconventional tool to assist the solution of the traveling salesman problemNatural Computing: an international journal10.1007/s11047-020-09817-z21:2(347-357)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/s11047-020-09817-z
Xie LTao DWei H(2016)Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression RecognitionACM Transactions on Intelligent Systems and Technology10.1145/29565568:2(1-21)Online publication date: 25-Oct-2016
https://dl.acm.org/doi/10.1145/2956556

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents