Lasantha Seneviratne
ABSTRACT
Image indexing is one of the most difficult challenges facing the computer vision community. Addressing this issue, we designed an innovative approach to obtain an accurate label for images by taking into account the social aspects of human-based computation. The proposed approach is highly discriminative in comparison to an ordinary content-based image retrieval (CBIR) paradigm. It aims at what millions of individual gamers are enthusiastic to do, to enjoy themselves within a social competitive environment. It is achieved by setting the focus of the system on the social aspects of the gaming environment, which involves a widely distributed network of human players. Furthermore, this framework integrates a number of different algorithms that are commonly found in image processing and game theoretic approaches to obtain an accurate label. As a result, the framework is able to assign (or derive) accurate tags for images by eliminating annotations made by a less-rational (cheater) player. The performance analysis of this framework has been evaluated with a group of 10 game players. The result shows that the proposed approach is capable of obtaining a good annotation through a small number of game players.
- Keysers, D., Breuel, T., Renn, M. and Beusekom, J. 2008. Automatic Image Tagging using Community-Driven Online Image Databases, 6th International Workshop on Adaptive Multimedia Retrieval.Google Scholar
- Tuulos, V., Scheible, J. and Nyholm, H. 2007. Combining Web, Mobile Phones and Public Displays in Large-Scale: Manhattan Story Mashup. LNCS, Volume 4480, pp 37--54. Google ScholarDigital Library
- Foto tagger, A collaborative framework for image tagging, Cogitum co. http://www.fototagger.com/biz_ftonlineGoogle Scholar
- {Online}. Available : http://www.xmlweb.info:8080/Collimator3_1/Google Scholar
- Von Ahn, L. and Dabbish., L. 2004. Labeling images with a computer game. ACM Conference on Human Factors in Computing Systems (CHI). Google ScholarDigital Library
- Jesus, R., Goncalves, D., Abrantes, A., Correia, N. 2008. Playing Games as a Way to Improve Automatic Image Annotation, Computer Vision and Pattern Recognition Workshops (CVPRW).Google ScholarCross Ref
- {Online}. Available : http://www.youtube.com/watch?v=l0wLQJsgTgk&feature=related.Google Scholar
- Puterman, M. L. 1994. Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc. Google ScholarDigital Library
- Nasr, A., Bechet, F., Volanschi, A. 2004. Tagging with hidden Markov models using ambiguous tags. Proceedings of the 20th international conference on Computational Linguistics. Google ScholarDigital Library
- Weber, I., Robertson, S. and Vojnovic, M. 2008. Rethinking the ESP Game. Technical Report, MSR-TR-2008-132, Microsoft Research.Google Scholar
- Von Ahn, L., Liu, R. and Blum, M. 2006. A Game for Locating Objects in Images. ACM Conference on Human Factors in Computing Systems (CHI). Google ScholarDigital Library
- Ho, C., Chang, T., Lee, J., Hsu, J.Y. And Chen, K. 2009. KissKissBan: A Competitive Human Computation Game for Image Annotation. KDD-HCOMP'09. Google ScholarDigital Library
- Von Ahn, L., Kedia, M. and Blum, M. 2006. Verbosity: A Game for Collecting Common-Sense Facts. ACM Conference on Human Factors in Computing Systems (CHI). Google ScholarDigital Library
- Von Ahn, L., Ginosar, S., Kedia, M. and Blum, M. 2007. Improving Image Search with PHETCH. Acoustics, Speech and Signal Processing, ICASSP 2007. IEEE International Conference on, Volume 4, Issue , pp.15--20.Google Scholar
- {Online}. Available : http://www.hotornot.com/.Google Scholar
- {Online}. Available : http://images.google.com/imagelabeler/.Google Scholar
- Lin, W. S., Zhao, H. V. and Liu, K. J. R. 2009. Incentive Cooperation Strategies for Peer-to-Peer Live Multimedia Streaming Social Networks. IEEE Transactions on Multimedia, Volume.11, No.3, pp.396--412. Google ScholarDigital Library
- Manjunath, B. S., Ohm, J. R., Vasudevan, V. V. and Yamada, A. 2001. Colour and Texture Descriptors. Circuits and Systems for Video Technology. IEEE Transactions on Volume 11, Issue 6 (Jun 2001), pp703--715 Google ScholarDigital Library
- Won, C. S., Park, D. K. and Park, S. "Efficient Use of MPG-7 Edge Histogram Descriptor", ETRI Journal, Volume 24, Number 1, pp23--30, Feb 2002.Google Scholar
- Evaggelos, S., Borgne, H. L., Mailis, T., Cooke, E., Avrithis, Y. and Connor, N. 2005. Fusing MPEG-7 Visual Descriptors for Image Classification, Artificial Neural Networks: Formal Models and Their Applications (ICANN).Google Scholar
- Gunn. S. R. 1998. Support Vector Machines for Classification and Regression. Technical report, University of Southampton.Google Scholar
- Mendelson, E. 2004. Introducing Game Theory and Its Applications, Taylor & Francis Ltd. Google ScholarDigital Library
Index Terms
- An interactive framework for image annotation through gaming
Recommendations
Image annotation through gaming (TAG4FUN)
DSP'09: Proceedings of the 16th international conference on Digital Signal ProcessingThis paper introduces a new technique for image annotation in which social aspects of human-based computation are exploited. The proposed approach aims at exploiting what millions of single, online and cooperative gamers are keen to do, (in some cases ...
To Three or not to Three: Improving Human Computation Game Onboarding with a Three-Star System
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsWhile many popular casual games use three-star systems, which give players up to three stars based on their performance in a level, this technique has seen limited application in human computation games (HCGs). This gives rise to the question of what ...
Imaginary reality gaming: ball games without a ball
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technologyWe present imaginary reality games, i.e., games that mimic the respective real world sport, such as basketball or soccer, except that there is no visible ball. The ball is virtual and players learn about its position only from watching each other act ...
Comments