Anthony Santella
ABSTRACT
We present an interactive method for cropping photographs given minimal information about important content location, provided by eye tracking. Cropping is formulated in a general optimization framework that facilitates adding new composition rules, and adapting the system to particular applications. Our system uses fixation data</ to identify important image content and compute the best crop for any given aspect ratio or size, enabling applications such as automatic snapshot recomposition, adaptive documents, and thumbnailing. We validate our approach with studies in which users compare our crops to ones produced by hand and by a completely automatic approach. Experiments show that viewers prefer our gaze-based crops to uncropped images and fully automatic crops.
- Arnheim, R. Art and Visual Perception. University of California Press, 1974.Google Scholar
- Arnheim, R. The Power of the Center. University of California Press, 1988.Google Scholar
- Banerjee, S. Composition Guided Image Aquisition. PhD thesis, University of Texas at Austin, 2004.Google Scholar
- Byers, Z., Dixon, M., Smart, W. D., and Grimm, C. M. Say cheese!: Experiences with a robot photographer. Proceedings of the Fifteenth Innovative Applications of Artificial Intelligence Conference (IAAI-03), Acapulco, Mexico.Google Scholar
- Chen, L., Xie, X., Fan, X., Ma, W., Shang, H., and Zhou, H. A visual attention mode for adapting images on small displays. MSR-TR-2002-125 Microsoft Research, Redmond, WA (2002).Google Scholar
- Christoudias, C., Georgescu, B., and Meer, P. Synergism in low level vision. Proceedings ICPR 2002. Google ScholarDigital Library
- Crow, F. Summed-area tables for texture mapping. Siggraph '84. 207--2 12. Google ScholarDigital Library
- David, H. A. The method of paired comparisons. Charles Griffin and Company, London, 1969.Google Scholar
- DeCarlo, D., and Santella, A. Stylization and abstraction of photographs. Proceedings of ACM SIGGRAPH 2002. 769--776. Google ScholarDigital Library
- Duchowski, A. Acuity-matching resolution degradation through wavelet coefficient scaling. IEEE Trans. on Image Processing 9, 8 (2000), 1437--1440. Google ScholarDigital Library
- Foley, J., van Dam, A., Feiner, S., and Hughes, J. Computer Graphics: Principles and Practice, 2nd edition. Addison Wesley, 1997. Google ScholarDigital Library
- Gooch, B., Reinhard, E., Moulding, C., and Shirley, P. Artistic composition for image creation. Proceedings of the 12th Eurographics workshop on Rendering Technique. 83--88. Google ScholarDigital Library
- Graham, D. Composing Pictures. Van Nostrand Reinhold, 1970.Google Scholar
- Grill, T., and Scanlon, M. Photographic Composition Guidelines for Total image control through effective design. AMPHOTO, 1988.Google Scholar
- Itti, L., and Koch, C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40 (2000), 1489--1506.Google ScholarCross Ref
- Itti, L., Koch, C., and Niebur, E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1998), 1254--1259. Google ScholarDigital Library
- Jacob, R. J. Eye-movement-based human-computer interaction techniques: Toward non-command interfaces. 151--190.Google Scholar
- Jacobs, C., Li, W., Schrier, E., Bargeron, D., and Salesin, D. Adaptive grid-based document layout. ACM Trans. Graph. 22, 3 (2003), 838--847. Google ScholarDigital Library
- Kendall, M. G. On the method of paired comparisons. Biometrika 31 (1940), 324 --345.Google ScholarCross Ref
- Li, S. Z., Zhu, L., Zhang, Z. Q., Blake, A., Zhang, H. J., and Shum, H. Statistical learning of multi-view face detection. Proceedings 7th European Conference on Computer Vision(ECCV 2002) 4 (2002), 67 --81. Google ScholarDigital Library
- Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. Lazy snapping. ACM Trans. Graph. 23, 3 (2004), 303--308. Google ScholarDigital Library
- Locher, P. J. The contribution of eye-movement research to an understanding of the nature of pictorial balance perception: a review of the literature. Empirical Studies of the Arts 14, 2 (1996), 146--163.Google ScholarCross Ref
- Locher, P. J., Stappers, P. J., and Overbeeke, K. The role of balance as an organizing design principle underlying adults' compositional strategies for creating visual displays. Acta Psychologica 99 (1998), 141--161.Google ScholarCross Ref
- Locher, P. J., Stappers, P. J., and Overbeeke, K. An empirical evaluation of the visual rightness theory of pictorial composition. Acta Psychologica 103 (1999), 261--280.Google ScholarCross Ref
- Lok, S., Feiner, S., and Ngai, G. Evaluation of visual balance for automated layout. Proceedings of the 9th international conference on Intelligent user interface. 101--106. Google ScholarDigital Library
- McManus, I., Edmondson, D., and Rodgers, J. Balance in pictures. British Journal of Psychology 76 (1985), 73--94.Google ScholarCross Ref
- Peterson, B. Learning to see Creatively: How to compose great photographs. AMPHOTO, 1988.Google Scholar
- Setlur, V., Takagi, S., Raskar, R., Gleicher, M., and Gooch, B. Automatic image retargeting. ACM SIGGRAPH Technical Sketch. Google ScholarDigital Library
- Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. Automatic thumbnail cropping and it's effectivness. ACM Conference on User Interface and Software Technolgy (UIST 2003) (2003), 95--104. Google ScholarDigital Library
- Vertegaal, R. The gaze groupware system: Mediating joint attention in mutiparty communication and collaboration. Proceedings CHI '99. 294--301. Google ScholarDigital Library
- Vertegaal, R. Designing attentive interfaces. Proceedings of the Eye Tracking Research and Applications (ETRA) Symposium 2002. 23--30. Google ScholarDigital Library
Index Terms
- Gaze-based interaction for semi-automatic photo cropping
Recommendations
Evaluation of eye gaze interaction
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing SystemsEye gaze interaction can provide a convenient and natural addition to user-computer dialogues. We have previously reported on our interaction techniques using eye gaze [10]. While our techniques seemed useful in demonstration, we now investigate their ...
Sensation-based photo cropping
MM '09: Proceedings of the 17th ACM international conference on MultimediaThis paper proposes a novel method for automatically cropping a photo using a quality classifier that assesses whether the cropped region is agreeable to users. We statistically build this quality classifier using large photo collections available on ...
Gaze gestures or dwell-based interaction?
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsThe two cardinal problems recognized with gaze-based interaction techniques are: how to avoid unintentional commands, and how to overcome the limited accuracy of eye tracking. Gaze gestures are a relatively new technique for giving commands, which has ...
Comments