skip to main content
10.1145/3613905.3651064acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

BiasBuzz: Combining Visual Guidance with Haptic Feedback to Increase Awareness of Analytic Behavior during Visual Data Analysis

Published: 11 May 2024 Publication History

Abstract

During visual data analysis, users may inadvertently focus more on certain aspects of data, affecting analysis outcome(s). Existing tools primarily rely on visual cues (e.g., highlight already visited data) to increase user awareness of such analytic behaviors. We believe this single, visual modality is a passive form of guidance that adds to users’ cognitive load already engaged in analysis. We investigate how a dual modality (visual guidance and haptic feedback) can capture users’ attention and more actively guide them in their pursuits. We interface an existing visual data analysis tool with a gaming mouse. This enhanced system tracks user interactions and communicates biases by vibrating the mouse (haptic) and simultaneously displaying contextual information in the tool (visual). A formative study with nine users revealed that this dual modality increased analytical awareness in some cases but some users found the haptic mouse vibrations to be distracting and disturbing, informing the design of future multimodal user interfaces.

Supplemental Material

MP4 File
Talk Video
Transcript for: Talk Video
ZIP File - Supplemental Material
- Interaction Logs - Temporal Evolution of AD, (Un)Tracked and Muted Attributes, and Mouse Vibrations for each Attribute for each Participant - Attribute Tracking Stats - Complete Interaction Summary - Final AD vs Vibration - Muted Attributes Per Participant - Tracked Attributes By Participant - Usefulness Scores - Vibrations Per Participant and Attribute

References

[1]
Motoyuki Akamatsu, Sigeru Sato, and I. Scott MacKenzie. 1994. Multimodal mouse: A mouse-type device with tactile and force display. Presence: Teleoperators and Virtual Environments 3, 1 (1994), 73–80. https://doi.org/10.1162/pres.1994.3.1.73
[2]
Matthew A Baumann, Karon E MacLean, Thomas W Hazelton, and Ashley McKay. 2010. Emulating human attention-getting practices with wearable haptics. In 2010 IEEE Haptics Symposium. IEEE, 149–156. https://doi.org/10.1109/HAPTIC.2010.5444662
[3]
Leonardo Bonanni and Cati Vaucelle. 2006. A framework for haptic psycho-therapy. depression and anxiety 12 (2006), 24.
[4]
Richard E Boyatzis. 1998. Transforming Qualitative Information: Thematic Analysis and Code Development.Sage Publications.
[5]
Gwénaël Changeon, Delphine Graeff, Margarita Anastassova, and José Lozada. 2012. Tactile emotions: A vibrotactile tactile gamepad for transmitting emotional messages to children with autism. In Haptics: Perception, Devices, Mobility, and Communication: International Conference, EuroHaptics 2012, Tampere, Finland, June 13-15, 2012. Proceedings, Part I. Springer, 79–90.
[6]
Inga Chira, Michael Adams, and Barry Thornton. 2008. Behavioral Bias Within The Decision Making Process. Journal of Business & Economics Research 6, 8 (2008), 11–20. https://doi.org/10.19030/jber.v6i8.2456
[7]
Isaac Cho, Ryan Wesslen, Alireza Karduni, Sashank Santhanam, Samira Shaikh, and Wenwen Dou. 2017. The anchoring effect in decision-making with visual analytics. In 2017 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE, 116–126. https://doi.org/10.1109/VAST.2017.8585665
[8]
Evanthia Dimara, Giles Bailey, Anastasia Bezerianos, and Steven Franconeri. 2018. Mitigating the attraction effect with visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2018), 850–860. https://doi.org/10.1109/TVCG.2018.2865233
[9]
Youngwook Do, Linh Thi Hoang, Jung Wook Park, Gregory Abowd, and Sauvik Das. 2021. Spidey Sense: Designing Wrist-Mounted Affective Haptics for Communicating Cybersecurity Warnings. In Designing Interactive Systems Conference 2021. ACM. https://doi.org/10.1145/3461778.3462027
[10]
Mi Feng, Cheng Deng, Evan M Peck, and Lane Harrison. 2016. Hindsight: Encouraging exploration through direct encoding of personal interaction history. IEEE transactions on visualization and computer graphics 23, 1 (2016), 351–360.
[11]
Sunwoo Ha, Shayan Monadjemi, Roman Garnett, and Alvitta Ottley. 2022. A unified comparison of user modeling techniques for predicting data interaction and detecting exploration bias. IEEE Transactions on Visualization and Computer Graphics 29, 1 (2022), 483–492. https://doi.org/10.48550/arXiv.2208.05021
[12]
Wenkai Han and Hans-Jorg Schulz. 2020. Exploring vibrotactile cues for interactive guidance in data visualization. In 2020 International Symposium on Visual Information Communication and Interaction (VINCI). ACM, 1–10. https://doi.org/10.1145/3430036.3430042
[13]
Vincent Hayward, Oliver R Astley, Manuel Cruz-Hernandez, Danny Grant, and Gabriel Robles-De-La-Torre. 2004. Haptic interfaces and devices. Sensor review 24, 1 (2004), 16–29. https://doi.org/10.1108/02602280410515770
[14]
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems. 234–241. https://doi.org/10.1145/258549.258715
[15]
Ki-Uk Kyung, Heejin Choi, Kwon Dong-Soo, and Son Seung-Woo. 2004. Interactive mouse systems providing haptic feedback during the exploration in virtual environment. In 2004 International Symposium on Computer and Information Sciences. ACM, 136–146.
[16]
Qianyu Liu, Haoran Jiang, Zihao Pan, Qiushi Han, Zhenhui Peng, and Quan Li. 2024. BiasEye: A Bias-Aware Real-time Interactive Material Screening System for Impartial Candidate Assessment. arXiv preprint arXiv:2402.09148 (2024). https://doi.org/10.48550/arXiv.2402.09148
[17]
Arpit Narechania, Surya Chakraborty, Shivam Agarwal, Atanu R Sinha, Ryan A Rossi, Fan Du, Jane Hoffswell, Shunan Guo, Eunyee Koh, Alex Endert, 2023. DataCockpit: A Toolkit for Data Lake Navigation and Monitoring Utilizing Quality and Usage Information. In 2023 IEEE International Conference on Big Data (BigData). IEEE, 5305–5310. https://doi.org/10.1109/BigData59044.2023.10386133
[18]
Arpit Narechania, Adam Coscia, Emily Wall, and Alex Endert. 2021. Lumos: Increasing awareness of analytic behavior during visual data analysis. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2021), 1009–1018. https://doi.org/10.1109/TVCG.2021.3114827
[19]
Arpit Narechania, Fan Du, Atanu R Sinha, Ryan Rossi, Jane Hoffswell, Shunan Guo, Eunyee Koh, Shamkant B Navathe, and Alex Endert. 2023. Datapilot: Utilizing quality and usage information for subset selection during visual data preparation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18. https://doi.org/10.1145/3544548.3581509
[20]
Arpit Narechania, Adam Fourney, Bongshin Lee, and Gonzalo Ramos. 2021. DIY: Assessing the correctness of natural language to sql systems. In 26th International Conference on Intelligent User Interfaces. 597–607. https://doi.org/10.1145/3397481.3450667
[21]
Marianna Obrist, Sriram Subramanian, Elia Gatti, Benjamin Long, and Thomas Carter. 2015. Emotions mediated through mid-air haptics. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 2053–2062.
[22]
Simone Ooms, Minha Lee, Pablo Ceasar, and Abdallah Ali. 2023. FeelTheNews: Augmenting Affective Perceptions of News Videos with Thermal and Vibrotactile Stimulation. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3544549.3585638
[23]
Sabrina Paneels and Jonathan C Roberts. 2009. Review of designs for haptic data visualization. IEEE Transactions on Haptics 3, 2 (2009), 119–137. https://doi.org/10.1109/TOH.2009.44
[24]
Bahador Saket, Chrisnawan Prasojo, Yongfeng Huang, and Shengdong Zhao. 2013. Designing an effective vibration-based notification interface for mobile phones. In Proceedings of the 2013 conference on Computer supported cooperative work. 149–1504. https://doi.org/10.1145/2441776.2441946
[25]
Stefano Scheggi, A. Talarico, and Domenico Prattichizzo. 2014. A remote guidance system for blind and visually impaired people via vibrotactile haptic feedback. In 22nd Mediterranean Conference on Control and Automation. IEEE. https://doi.org/10.1109/MED.2014.6961320
[26]
SteelSeries. 2015. SteelSeries Gamesense SDK. https://github.com/SteelSeries/gamesense-sdk
[27]
J.A. Terry and H. S. Hsiao. 1988. Tactile feedback in a computer mouse. In 14th Annual Northeast Bioengineering Conference. IEEE. https://doi.org/10.1109/NEBC.1988.19369
[28]
Emily Wall, Leslie M Blaha, Lyndsey Franklin, and Alex Endert. 2017. Warning, bias may occur: A proposed approach to detecting cognitive bias in interactive visual analytics. In 2017 IEEE conference on visual analytics science and technology (VAST). IEEE, 104–115. https://doi.org/10.1109/VAST.2017.8585669
[29]
Emily Wall, Leslie M Blaha, Celeste Lyn Paul, Kristin Cook, and Alex Endert. 2018. Four perspectives on human bias in visual analytics. Cognitive biases in visualizations (2018), 29–42.
[30]
Emily Wall, Arpit Narechania, Adam Coscia, Jamal Paden, and Alex Endert. 2021. Left, right, and gender: Exploring interaction traces to mitigate human biases. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2021), 966–975. https://doi.org/10.1109/TVCG.2021.3114862
[31]
Dangxiao Wang, Kouhei Ohnishi, and Weiliang Xu. 2019. Multimodal haptic display for virtual reality: A survey. IEEE Transactions on Industrial Electronics 67, 1 (2019), 610–623. https://doi.org/10.1109/TIE.2019.2920602
[32]
Gyeore Yun, Minjae Mun, Jungeun Lee, Dong-Geun Kim, Hong Z Tan, and Seungmoon Choi. 2023. Generating Real-Time, Selective, and Multimodal Haptic Effects from Sound for Gaming Experience Enhancement. In ACM CHI. https://doi.org/10.1145/3544548.3580787

Cited By

View all
  • (2024)ProvenanceWidgets: A Library of UI Control Elements to Track and Dynamically Overlay Analytic ProvenanceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345614431:1(1235-1245)Online publication date: 9-Sep-2024

Index Terms

  1. BiasBuzz: Combining Visual Guidance with Haptic Feedback to Increase Awareness of Analytic Behavior during Visual Data Analysis

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
      May 2024
      4761 pages
      ISBN:9798400703317
      DOI:10.1145/3613905
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 May 2024

      Check for updates

      Author Tags

      1. guidance
      2. haptic
      3. visual data analysis
      4. visualization

      Qualifiers

      • Work in progress
      • Research
      • Refereed limited

      Funding Sources

      Conference

      CHI '24

      Acceptance Rates

      Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)288
      • Downloads (Last 6 weeks)29
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)ProvenanceWidgets: A Library of UI Control Elements to Track and Dynamically Overlay Analytic ProvenanceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345614431:1(1235-1245)Online publication date: 9-Sep-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media