Shaowei Chu
Jiro Tanaka
ABSTRACT
Taking self-portraits with a digital camera is a popular way to present oneself through photography. Traditional techniques for taking self-portraits, such as use of self-timers or face detection, provide only a modest degree of interaction between the user and camera. In this paper, we present an interaction technique that make novel use of image-processing algorithm to recognize hand motion gestures and provides user a natural way to interact with camera for taking self-portraits. User can perform nature gestures to control essential functions of camera and take self-portraits effectively. Three types of gesture (i.e., waving, eight-direction selection, and circling were identified and applied to develop a gesture user interface for controlling a Digital Single-Lens Reflex (DSLR) camera. Two experiments were conducted to evaluate the usability and performance of the gesture interface. The results confirmed that the usability of the gesture interface is superior to a self-timer and the proposed technique achieved about 80% accurate recognition of motion gestures.
- Huang, L., Xia, T., Wan, J., Zhang, Y., and Lin, S. Personalized portraits ranking. In Proceedings of the 19th ACM international conference on Multimedia, ACM Press (2011), 1277--1280. Google Scholar
Digital Library
- Okabe, D., Ito, M., Chipchase, J., and Shimizu, A. The social uses of purikura: photographing, modding, archiving, and sharing. In Pervasive Image Capture and Sharing Workshop, Ubiquitous Computing Conference (2006), 2--5.Google Scholar
- 4 tips for taking gorgeous self-portrait and outfit photos. http://www.shrimpsaladcircus.com/2012/01/self-portrait-outfit-photography-guide.html.Google Scholar
- Taking a great self portrait with your camera. http://www.squidoo.com/self-portrait-tips.Google Scholar
- Adams, A., Talvala, E.-V., Park, S. H., Jacobs, D. E., Ajdin, B., Gelfand, N., Dolson, J., Vaquero, D., Baek, J., Tico, M., Lensch, H. P. A., Matusik, W., Pulli, K., Horowitz, M., and Levoy, M. The frankencamera: an experimental platform for computational photography. ACM Transactions on Graphics 29, 4 (2010), 29:1--29:12. Google ScholarDigital Library
- Gomez, S. R. Interacting with live preview frames: in-picture cues for a digital camera interface. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology (2010), 419--420. Google ScholarDigital Library
- Chu, S., and Tanaka, J. Hand gesture for taking self portrait. In Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II (2011), 238--247. Google ScholarDigital Library
- Chu, S., and Tanaka, J. Head nod and shake gesture interface for a self-portrait camera. In ACHI 2012, The Fifth International Conference on Advances in Computer-Human Interactions (2012), 112--117.Google Scholar
- Nikon coolpix s1200pj camera. http://www.nikonusa.com/en/Learn-And-Explore/Article/g022fmeg/Built-in-Projector.html.Google Scholar
- Bayazit, M., Couture-beil, A., and Mori, G. Real-time motion-based gesture recognition using the GPU. In IAPR Conference on Machine Vision Applications (MVA) (2009), 9--12.Google Scholar
- Wachs, J. P., Kolsch, M., Stern, H., and Edan, Y. Vision-based hand-gesture applications. Communications of the ACM 54, 2 (2011), 60--71. Google ScholarDigital Library
- Moeslund, T. B., Hilton, A., and Kruger, V. A survey of advances in vision-based human motion capture and analysis. Journal of Computer Vision and Image Understanding 104, 2 (2006), 90--126. Google ScholarDigital Library
- Wilson, A. D. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proceedings of the 19th annual ACM symposium on User interface software and technology (2006), 255--258. Google ScholarDigital Library
- Mistry, P., and Maes, P. Sixthsense: a wearable gestural interface. In ACM SIGGRAPH ASIA 2009 Sketches (2009), 11:1--11:1. Google ScholarDigital Library
- Lee, T., and Hollerer, T. Handy AR: Markerless inspection of augmented reality objects using fingertip tracking. In Wearable Computers, 2007 11th IEEE International Symposium on (2007), 1--8. Google ScholarDigital Library
- Wang, R., Paris, S., and Popovic, J. 6D hands: markerless hand-tracking for computer aided design. In Proceedings of the 24th annual ACM symposium on User interface software and technology (2011), 549--558. Google ScholarDigital Library
- Wang, R. Y., and Popovic, J. Real-time hand-tracking with a color glove. ACM Transactions on Graphics 28, 3 (2012), 63:1--63:8. Google ScholarDigital Library
- Stenger, B., Woodley, T., and Cipolla, R. A vision-based remote control. In Studies in Computational Intelligence, vol. 285 (2010), 233--262.Google Scholar
- Baker, S., and Matthews, I. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision 56, 3 (2004), 221--255. Google ScholarDigital Library
- Bruhn, A., Weickert, J., and Schnorr, C. Lucas/kanade meets horn/schunck: combining local and global optic flow methods. International Journal of Computer Vision 61, 3 (2005), 211--231. Google ScholarDigital Library
- Chen, M., Mummert, L., Pillai, P., Hauptmann, A., and Sukthankar, R. Controlling your TV with gestures. In MIR 2010: 11th ACM SIGMM International Conference on Multimedia Information Retrieval (2010), 405--408. Google ScholarDigital Library
- Fathi, A., and Mori, G. Action recognition by learning mid-level motion features. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2008) (2008), 1--8.Google ScholarCross Ref
- Takahashi, M., Fujii, M., Naemura, M., and Satoh, S. Human gesture recognition using 3.5-dimensional trajectory features for hands-free user interface. In Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams (2010), 3--8. Google ScholarDigital Library
- Hardy, J., Rukzio, E., and Davies, N. Real world responses to interactive gesture based public displays. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia (2011), 33--39. Google ScholarDigital Library
- Kim, J., Mastnik, S., and Andre, E. EMG-based hand gesture recognition for realtime biosignal interfacing. In Proceedings of the 13th international conference on Intelligent user interfaces (2008), 30--39. Google ScholarDigital Library
- Atia, A., and Tanaka, J. Interaction with tilting gestures in ubiquitous environments. International Journal of UbiComp 1, 3 (2010), 1--13.Google Scholar
- Eisenstein, J., and Mackay, W. E. Interacting with communication appliances: an evaluation of two computer vision-based selection techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2006), 1111--1114. Google ScholarDigital Library
- Open source computer vision library (OpenCV). http://opencv.org/.Google Scholar
- Canon digital camera software developers kit. http://usa.canon.com/cusa/consumer/standard_display/sdk_homepage.Google Scholar
- Fiss, J., Agarwala, A., and Curless, B. Candid portrait selection from video. ACM Transactions on Graphics 30, 6 (2011), 128:1--128:8. Google ScholarDigital Library
Index Terms
- Interacting with a self-portrait camera using motion-based hand gestures
Recommendations
Design of a motion-based gestural menu-selection interface for a self-portrait camera
Self-portraits allow users to capture memories, create art, and advance their photography skills. However, most existing camera interfaces are limited in that they do not support life-size previews, deviceless remote control, and real-time control over ...
Leap gestures for TV: insights from an elicitation study
TVX '14: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online VideoWe present insights from a gesture elicitation study in the context of interacting with TV, during which 18 participants contributed and rated the execution difficulty and recall likeliness of free-hand gestures for 21 distinct TV tasks. Our study ...
Recognition of hand gestures from cyclic hand movements using spatial-temporal features
SoICT '15: Proceedings of the 6th International Symposium on Information and Communication TechnologyDynamic hand gesture recognition is a challenge field evenly this topic has been studied for a long time because of lack of feasible techniques deployed for Human-Computer Interaction (HCI) applications. In this paper, we propose a new type of gestures ...
Comments