skip to main content
10.1145/1978942.1979158acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Directing attention and influencing memory with visual saliency modulation

Published: 07 May 2011 Publication History

Abstract

In augmented reality, it is often necessary to draw the user's attention to particular objects in the real world without distracting her from her task. We explore the effectiveness of directing a user's attention by imperceptibly modifying existing features of a video. We present three user studies of the effects of applying a saliency modulation technique to video; evaluating modulation awareness, attention, and memory. Our results validate the saliency modulation technique as an alternative means to convey information to the user, suggesting attention shifts and influencing recall of selected regions without perceptible changes to visual input.

Supplementary Material

AVI File (paper948.avi)

References

[1]
Awh, E., Vogel, E., and Oh, S. Interactions between attention and working memory. Neuroscience 139, 1 (2006), 201--208.
[2]
Bailey, R., McNamara, A., Sudarsanam, N., and Grimm, C. Subtle gaze direction. ACM TOG 28, 4 (2009), 1--14.
[3]
Berg, D. and Itti, L. Memory, eye position and computed saliency. Journal of Vision 8, 6 (2008), 1164.
[4]
Chun, M.M. and Turk-Browne, N.B. Interactions between attention and memory. Current opinion in neurobiology 17, 2 (2007), 177--184.
[5]
Fine, M.S. and Minnery, B.S. Visual salience affects performance in a working memory task. Journal of Neuroscience 29, 25 (2009), 8016--21.
[6]
Itti, L., Koch, C., and Niebur, E. A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (1998), 1254--1259.
[7]
Itti, L. Models of bottom-up attention and saliency. Neurobiology of attention 582, 1980 (2005), 576--582.
[8]
Itti, L. Visual salience. Scholarpedia 2, 9 (2007), 3327.
[9]
Kim, Y. and Varshney, A. Saliency-guided Enhancement for Volume Visualization. IEEE TVCG 12, 5 (2006), 925--932.
[10]
Kim, Y. and Varshney, A. Persuading Visual Attention through Geometry. IEEE TVCG 14, 4 (2008), 772--782.
[11]
1Koch, C. and Ullman, S. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4, 4 (1985), 219--227.
[12]
Lee, S., Kim, G.J., and Choi, S. Real-time tracking of visually attended objects in interactive virtual environments. ACM VRST, (2007), 15--24.
[13]
Mendez, E., Feiner, S.K., and Schmalstieg, D. Focus and Con-text in Mixed Reality by Modulating First Order Salient Features. Int. Symp. on Smart Graphics, (2010), 232--243.
[14]
Ouerhani, N., Wartburg, R.V., Hugli, H., and Muri, R. Empirical validation of the saliency-based model of visual attention. Electronic Letters on Computer Vision and Image Analysis 3, 1 (2004), 13--24.
[15]
Rensink, R.A., O'Regan, J.K., and Clark, J.J. On the Failure to Detect Changes in Scenes Across Brief Interruptions. Visual Cognition 7, 1--3 (2000), 127--145.
[16]
Santella, A. and DeCarlo, D. Visual interest and NPR: an evaluation and manifesto. NPAR, (2004), 150.
[17]
Su, S.L., Durand, F., and Agrawala, M. De-emphasis of distracting image regions using texture power maps. Texture 2005: Proc. 4th ICCV Workshop on Texture Analysis and Synthesis, (2005), 119--124.
[18]
Treisman, A.M. and Gelade, G. A feature-integration theory of attention. Cognitive psychology 12, 1 (1980), 97--136.
[19]
Veas, E., Mulloni, A., Kruijff, E., and Schmalstieg, D. Techniques for View Transition in Multi-Camera Outdoor Environments. Graphics Interface 2010 (GI2010), (2010), 193--200.
[20]
Wolfe, J.M. and Horowitz, T.S. What attributes guide the deployment of visual attention and how do they do it? Nature reviews. Neuroscience 5, 6 (2004), 495--501.

Cited By

View all
  • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
  • (2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
  • (2024)Spatial Gaze Markers: Supporting Effective Task Switching in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642811(1-11)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Directing attention and influencing memory with visual saliency modulation
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
          May 2011
          3530 pages
          ISBN:9781450302289
          DOI:10.1145/1978942
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 07 May 2011

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. augmented reality
          2. saliency
          3. visual attention

          Qualifiers

          • Research-article

          Conference

          CHI '11
          Sponsor:

          Acceptance Rates

          CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;
          Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

          Upcoming Conference

          CHI 2025
          ACM CHI Conference on Human Factors in Computing Systems
          April 26 - May 1, 2025
          Yokohama , Japan

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)107
          • Downloads (Last 6 weeks)13
          Reflects downloads up to 17 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
          • (2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
          • (2024)Spatial Gaze Markers: Supporting Effective Task Switching in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642811(1-11)Online publication date: 11-May-2024
          • (2024)An AI-Resilient Text Rendering Technique for Reading and Skimming DocumentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642699(1-22)Online publication date: 11-May-2024
          • (2024)MOSion: Gaze Guidance with Motion-triggered Visual Cues by Mosaic PatternsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642577(1-11)Online publication date: 11-May-2024
          • (2024)Predicting the Noticeability of Dynamic Virtual Elements in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642399(1-17)Online publication date: 11-May-2024
          • (2024)Flicker Augmentations: Rapid Brightness Modulation for Real-World Visual Guidance using Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642085(1-19)Online publication date: 11-May-2024
          • (2024)Visual Highlighting for Situated Brushing and LinkingComputer Graphics Forum10.1111/cgf.1510543:3Online publication date: 10-Jun-2024
          • (2024)The Impact of Variable Focal Lengths in Head Mounted Display2024 International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI)10.1109/RAEEUCCI61380.2024.10547764(1-7)Online publication date: 17-Apr-2024
          • (2024)Visual memory for natural scenesReference Module in Neuroscience and Biobehavioral Psychology10.1016/B978-0-443-15754-7.00042-0Online publication date: 2024
          • Show More Cited By

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media