Skip to main content
SpringerLink
Log in

Tracking Eye Movement for Controlling Real-Time Image-Abstraction Techniques

  • Conference paper
  • First Online:
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1474))

  • 825 Accesses

Abstract

Acquisition and consumption of visual media such as digital image and videos is becoming one of the most important forms of modern communication. However, since the creation and sharing of images is increasing exponentially, images as a media form suffer from being devalued, as the quality of single images are getting less and less important, and the frequency of the shared content turns to be the focus. In this work, an interactive system which allows users to interact with volatile and diverting artwork based on their eye movement only is presented. The system uses real-time image-abstraction techniques to create an artwork unique to each situation. It supports multiple, distinct interaction modes, which share common design principles, enabling users to experience game-like interactions focusing on eye-movement and the diverting image content itself. This approach hints at possible future research in the field of relaxation exercises and casual art consumption and creation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alonso, R., Causse, M., Vachon, F., Parise, R., Dehais, F., Terrier, P.: Evaluation of head-free eye tracking as an input device for air traffic control. Ergonomics 56, 246–255 (2013). https://doi.org/10.1080/00140139.2012.744473

    Article  Google Scholar 

  2. Anapur, E., Fink, G.: Drawing with his eyes - graham fink in an interview (2017). https://www.widewalls.ch/magazine/interview-graham-fink

  3. Blascheck, T., Kurzhals, K., Raschke, M., Burch, M., Weiskopf, D., Ertl, T.: State-of-the-art of visualization for eye tracking data. In: EuroVis (2014)

    Google Scholar 

  4. DiVerdi, S., Krishnaswamy, A., Mech, R., Ito, D.: Painting with polygons: a procedural watercolor engine. IEEE Trans. Vis. Comput. Graph. 19, 723–735 (2013)

    Article  Google Scholar 

  5. Dürschmid, T., Söchting, M., Semmo, A., Trapp, M., Döllner, J.: ProsumerFX: mobile design of image stylization components. In: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, SA 2017, pp. 1:1–1:8. ACM, New York (2017). https://doi.org/10.1145/3132787.3139208. http://doi.acm.org/10.1145/3132787.3139208

  6. Fink, G.: Drawing with my eyes (2015). https://grahamfink.com/eye-drawings

  7. Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Longman Publishing Co., Inc., Boston (1995)

    MATH  Google Scholar 

  8. Isenberg, T.: Interactive NPAR: What type of tools should we create? In: Proceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Expresive 2016, pp. 89–96. Eurographics Association, Aire-la-Ville (2016). http://dl.acm.org/citation.cfm?id=2981324.2981337

  9. Kasprowski, P., Harezlak, K., Niezabitowski, M.: Eye movement tracking as a new promising modality for human computer interaction. In: 2016 17th International Carpathian Control Conference (ICCC), pp. 314–318, May 2016. https://doi.org/10.1109/CarpathianCC.2016.7501115

  10. Kiefer, P., Giannopoulos, I., Raubal, M., Duchowski, A.: Eye tracking for spatial research: cognition, computation, challenges. Spat. Cogn. Comput. 17(1–2), 1–19 (2017). https://doi.org/10.1080/13875868.2016.1254634

    Article  Google Scholar 

  11. Kiili, K., Ketamo, H., Kickmeier-Rust, M.: Evaluating the usefulness of eye tracking in game-based learning. Int. J. Serious Games 1(2) (2014). https://doi.org/10.17083/ijsg.v1i2.15. http://journal.seriousgamessociety.org/index.php/IJSG/article/view/15

  12. Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the ‘art’: a taxonomy of artistic stylization techniques for images and video. IEEE Trans. Vis. Comput. Graph. 19(5), 866–885 (2013). https://doi.org/10.1109/TVCG.2012.160

    Article  Google Scholar 

  13. Majaranta, P., Bulling, A.: Eye tracking and eye-based human–computer interaction. In: Fairclough, S.H., Gilleade, K. (eds.) Advances in Physiological Computing. HIS, pp. 39–65. Springer, London (2014). https://doi.org/10.1007/978-1-4471-6392-3_3

    Chapter  Google Scholar 

  14. Mikami, S.: Molecular informatics. morphogenic substance via eye tracking (1996). https://bit.ly/2oezCZv

  15. Mishra, U.: Inventions on GUI for eye cursor controls systems. CoRR abs/1404.6765 (2014). http://arxiv.org/abs/1404.6765

  16. Quian Quiroga, R., Pedreira, C.: How do we see art: an eye-tracker study. Front. Hum. Neurosci. 5, 98 (2011). https://doi.org/10.3389/fnhum.2011.00098

    Article  Google Scholar 

  17. Schwarz, M., Isenberg, T., Mason, K., Carpendale, S.: Modeling with rendering primitives: an interactive non-photorealistic canvas. In: Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, NPAR 2007, pp. 15–22. ACM, New York (2007). https://doi.org/10.1145/1274871.1274874. http://doi.acm.org/10.1145/1274871.1274874

  18. Semmo, A., Dürschmid, T., Trapp, M., Klingbeil, M., Döllner, J., Pasewaldt, S.: Interactive image filtering with multiple levels-of-control on mobile devices. In: Proceedings SIGGRAPH ASIA Mobile Graphics and Interactive Applications (MGIA), pp. 2:1–2:8. ACM, New York (2016). https://doi.org/10.1145/2999508.2999521

  19. Söchting, M., Trapp, M.: Controlling image-stylization techniques using eye tracking. In: Chessa, M., Paljic, A., Braz, J. (eds.) Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020, Volume 2: HUCAPP, Valletta, Malta, 27–29 February 2020, pp. 25–34. SCITEPRESS (2020). https://doi.org/10.5220/0008964500250034

  20. Vandoren, P., Van Laerhoven, T., Claesen, L., Taelman, J., Raymaekers, C., Van Reeth, F.: IntuPaint: bridging the gap between physical and digital painting. In: 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems, pp. 65–72, October 2008. https://doi.org/10.1109/TABLETOP.2008.4660185

  21. Vaughan, K., Armstrong, M.S., Gold, R., O’Connor, N., Jenneke, W., Tarrier, N.: A trial of eye movement desensitization compared to image habituation training and applied muscle relaxation in post-traumatic stress disorder. J. Behav. Ther. Exp. Psychiatry 25(4), 283–291 (1994). https://doi.org/10.1016/0005-7916(94)90036-1. http://www.sciencedirect.com/science/article/pii/0005791694900361

  22. Zhai, S., Morimoto, C., Ihde, S.: Manual and gaze input cascaded (magic) pointing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1999, pp. 246–253. ACM, New York (1999). https://doi.org/10.1145/302979.303053. http://doi.acm.org/10.1145/302979.303053

Download references

Author information

Authors and Affiliations

  1. Hasso Plattner Institute, Faculty of Digital Engineering, University of Potsdam, Potsdam, Germany

    Maximilian Söchting & Matthias Trapp

Authors
  1. Maximilian Söchting
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias Trapp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maximilian Söchting .

Editor information

Editors and Affiliations

  1. IRISA, University of Rennes 1, Rennes, France

    Kadi Bouatouch

  2. Universidade do Porto, Porto, Portugal

    A. Augusto de Sousa

  3. University of Genova, Genova, Italy

    Manuela Chessa

  4. Mines ParisTech, Paris, France

    Alexis Paljic

  5. Linnaeus University, Växjö, Sweden

    Andreas Kerren

  6. French Civil Aviation University (ENAC), Toulouse, France

    Christophe Hurter

  7. Università di Catania, Catania, Italy

    Giovanni Maria Farinella

  8. Universitat de Barcelona, Barcelona, Spain

    Petia Radeva

  9. Escola Superior de Tecnologia de Setúbal, Setúbal, Portugal

    Jose Braz

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Söchting, M., Trapp, M. (2022). Tracking Eye Movement for Controlling Real-Time Image-Abstraction Techniques. In: Bouatouch, K., et al. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2020. Communications in Computer and Information Science, vol 1474. Springer, Cham. https://doi.org/10.1007/978-3-030-94893-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-94893-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-94892-4

  • Online ISBN: 978-3-030-94893-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation