skip to main content
10.1145/3477495.3532082acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article
Open access

Why Don't You Click: Understanding Non-Click Results in Web Search with Brain Signals

Published: 07 July 2022 Publication History

Abstract

Web search heavily relies on click-through behavior as an essential feedback signal for performance evaluation and improvement. Traditionally, click is usually treated as a positive implicit feedback signal of relevance or usefulness, while non-click is regarded as a signal of irrelevance or uselessness. However, there are many cases where users satisfy their information need with the contents shown on the Search Engine Result Page (SERP). This raises the problem of measuring the usefulness of non-click results and modeling user satisfaction in such circumstances.
For a long period, understanding non-click results is challenging owing to the lack of user interactions. In recent years, the rapid development of neuroimaging technologies constitutes a paradigm shift in various industries, e.g., search, entertainment, and education. Therefore, we benefit from these technologies and apply them to bridge the gap between the human mind and the external search system in non-click situations. To this end, we analyze the differences in brain signals between the examination of non-click search results in different usefulness levels. Inspired by these findings, we conduct supervised learning tasks to estimate the usefulness of non-click results with brain signals and conventional information (i.e., content and context factors). Furthermore, we devise two re-ranking methods, i.e., a Personalized Method (PM) and a Generalized Intent modeling Method (GIM), for search result re-ranking with the estimated usefulness. Results show that it is feasible to utilize brain signals to improve usefulness estimation performance and enhance human-computer interactions by search result re-ranking.

Supplementary Material

MP4 File (SIGIR22-fp0455.mp4)
Presentation video.

References

[1]
Marco Allegretti, Yashar Moshfeghi, Maria Hadjigeorgieva, Frank E Pollick, Joe- mon M Jose, and Gabriella Pasi. 2015. When relevance judgement is happening? An EEG-based study. In Proceedings of the 38th international acm sigir conference on research and development in information retrieval. 719--722.
[2]
F Amzica and M Steriade. 1998. Electrophysiological correlates of sleep delta waves. Electroencephalography and clinical neurophysiology 107, 2 (1998), 69--83.
[3]
Pia Borlund. 2003. The concept of relevance in IR. Journal of the American Society for information Science and Technology 54, 10 (2003), 913--925.
[4]
Xuesong Chen, Ziyi Ye, Xiaohui Xie, Yiqun Liu, Weihang Su, Shuqi Zhu, Min Zhang, and Shaoping Ma. 2021. Web Search via an Efficient and Effective Brain- Machine Interface. arXiv:arXiv:2110.07225
[5]
Keith M Davis III, Michiel Spapé, and Tuukka Ruotsalo. 2021. Collaborative filtering with preferences inferred from brain signals. In Proceedings of the Web Conference 2021. 602--611.
[6]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[7]
Abdigani Diriye, Ryen White, Georg Buscher, and Susan Dumais. 2012. Leaving so soon? Understanding and predicting web search abandonment rationales. In Proceedings of the 21st ACM international conference on Information and knowledge management. 1025--1034.
[8]
Ruo-Nan Duan, Jia-Yi Zhu, and Bao-Liang Lu. 2013. Differential entropy feature for EEG-based emotion classification. In 6th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 81--84.
[9]
Manuel JA Eugster, Tuukka Ruotsalo, Michiel M Spapé, Ilkka Kosunen, Oswald Barral, Niklas Ravaja, Giulio Jacucci, and Samuel Kaski. 2014. Predicting term- relevance from brain signals. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval. 425--434.
[10]
Jacek Gwizdka, Rahilsadat Hosseini, Michael Cole, and Shouyi Wang. 2017. Tem- poral dynamics of eye-tracking and EEG during reading and relevance decisions. Journal of the Association for Information Science and Technology 68, 10 (2017), 2299--2312.
[11]
Richard W Homan, John Herman, and Phillip Purdy. 1987. Cerebral location of international 10-20 system electrode placement. Electroencephalography and clinical neurophysiology 66, 4 (1987), 376--382.
[12]
Hilde M Huizenga, Jan C De Munck, Lourens J Waldorp, and Raoul PPP Grasman. 2002. Spatiotemporal EEG/MEG source analysis based on a parametric noise covariance model. IEEE Transactions on Biomedical Engineering 49, 6 (2002), 533--539.
[13]
A Hyvärinen. 1998. New approximations of differential entropy for independent component analysis and projection pursuit. Advances in neural information processing systems 10 (1998), 273.
[14]
Kalervo Järvelin and Jaana Kekäläinen. 2017. IR evaluation methods for retrieving highly relevant documents. In ACM SIGIR Forum, Vol. 51. ACM New York, NY, USA, 243--250.
[15]
Ziyu Jia, Youfang Lin, Xiyang Cai, Haobin Chen, Haijun Gou, and Jing Wang. 2020. Sst-emotionnet: Spatial-spectral-temporal based attention 3d dense network for eeg emotion recognition. In Proceedings of the 28th ACM International Conference on Multimedia. 2909--2917.
[16]
Thorsten Joachims et al. 2003. Evaluating Retrieval Performance Using Click- through Data.
[17]
Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2017. Accurately interpreting clickthrough data as implicit feedback. In ACM SIGIR Forum, Vol. 51. Acm New York, NY, USA, 4--11.
[18]
Hyun Hee Kim and Yong Ho Kim. 2019. ERP/MMR algorithm for classifying topic-relevant and topic-irrelevant visual shots of documentary videos. Journal of the Association for Information Science and Technology 70, 9 (2019), 931--941.
[19]
Wolfgang Klimesch. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain research reviews 29, 2--3 (1999), 169--195.
[20]
Sander Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, and Ioannis Patras. 2011. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing 3, 1 (2011), 18--31.
[21]
Jane Li, Scott Huffman, and Akihito Tokuda. 2009. Good abandonment in mobile and PC internet search. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval. 43--50.
[22]
Jinpeng Li, Zhaoxiang Zhang, and Huiguang He. 2018. Hierarchical convolutional neural networks for EEG-based emotion recognition. Cognitive Computation 10, 2 (2018), 368--380.
[23]
Jimmy Lin, Rodrigo Nogueira, and Andrew Yates. 2021. Pretrained transform- ers for text ranking: Bert and beyond. Synthesis Lectures on Human Language Technologies 14, 4 (2021), 1--325.
[24]
Yiqun Liu, Jiaxin Mao, Xiaohui Xie, Min Zhang, and Shaoping Ma. 2021. Challenges in designing a brain-machine search interface. In ACM SIGIR Forum, Vol. 54. ACM New York, NY, USA, 1--13.
[25]
Jiaxin Mao, Yiqun Liu, Noriko Kando, Cheng Luo, Min Zhang, and Shaoping Ma. 2018. Investigating result usefulness in mobile search. In European Conference on Information Retrieval. Springer, 223--236.
[26]
Jiaxin Mao, Yiqun Liu, Huanbo Luan, Min Zhang, Shaoping Ma, Hengliang Luo, and Yuntao Zhang. 2017. Understanding and predicting usefulness judgment in web search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1169--1172.
[27]
Jiaxin Mao, Yiqun Liu, Ke Zhou, Jian-Yun Nie, Jingtao Song, Min Zhang, Shaoping Ma, Jiashen Sun, and Hengliang Luo. 2016. When does relevance mean usefulness and user satisfaction in web search?. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 463--472.
[28]
Yashar Moshfeghi, Luisa R Pinto, Frank E Pollick, and Joemon M Jose. 2013. Understanding relevance: An fMRI study. In European conference on information retrieval. Springer, 14--25.
[29]
Yashar Moshfeghi, Peter Triantafillou, and Frank Pollick. 2019. Towards predict- ing a realisation of an information need based on brain signals. In The World Wide Web Conference. 1300--1309.
[30]
Yashar Moshfeghi, Peter Triantafillou, and Frank E Pollick. 2016. Understanding information need: An fMRI study. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 335--344.
[31]
Gert Pfurtscheller and FH Lopes Da Silva. 1999. Event-related EEG/MEG syn- chronization and desynchronization: basic principles. Clinical neurophysiology 110, 11 (1999), 1842--1857.
[32]
Zuzana Pinkosova, William J McGeown, and Yashar Moshfeghi. 2020. The cortical activity of graded relevance. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 299--308.
[33]
Dragomir R Radev, Hong Qi, Harris Wu, and Weiguo Fan. 2002. Evaluating Web-based Question Answering Systems. In LREC. Citeseer.
[34]
Filip Radlinski and Thorsten Joachims. 2005. Query chains: learning to rank from implicit feedback. In Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining. 239--248.
[35]
Brian J Roach and Daniel H Mathalon. 2008. Event-related EEG time-frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. Schizophrenia bulletin 34, 5 (2008), 907--926.
[36]
Stephen E Robertson and Steve Walker. 1994. Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In SIGIR'94. Springer, 232--241.
[37]
Ian Ruthven. 2021. Resonance and the experience of relevance. Journal of the Association for Information Science and Technology 72, 5 (2021), 554--569.
[38]
Tengfei Song, Wenming Zheng, Peng Song, and Zhen Cui. 2018. EEG emotion recognition using dynamical graph convolutional neural networks. IEEE Transactions on Affective Computing 11, 3 (2018), 532--541.
[39]
Ellen M Voorhees. 2001. The philosophy of information retrieval evaluation. In Workshop of the cross-language evaluation forum for european languages. Springer, 355--370.
[40]
Zhe Wang, Yongxiong Wang, Chuanfei Hu, Zhong Yin, and Yu Song. 2022. Trans- formers for EEG-based emotion recognition: A hierarchical spatial information learning model. IEEE Sensors Journal (2022).
[41]
Zhihua Wang, Yang Yu, Ming Xu, Yadong Liu, Erwei Yin, and Zongtan Zhou. 2019. Towards a hybrid BCI gaming paradigm based on motor imagery and SSVEP. International Journal of Human--Computer Interaction 35, 3 (2019), 197--205.
[42]
Kyle Williams, Julia Kiseleva, Aidan C Crook, Imed Zitouni, Ahmed Hassan Awadallah, and Madian Khabsa. 2016. Detecting good abandonment in mobile search. In Proceedings of the 25th International Conference on World Wide Web. 495--505.
[43]
Dan Wu, Jing Dong, Li Shi, Chunxiang Liu, and Jiangyun Ding. 2020. Credibility assessment of good abandonment results in mobile search. Information Processing & Management 57, 6 (2020), 102350.
[44]
Ziyi Ye, Xiaohui Xie, Yiqun Liu, Zhihong Wang, Xuesong Chen, Min Zhang, and Shaoping Ma. 2021. Understanding Human Reading Comprehension with brain signals. arXiv:arXiv:2108.01360
[45]
Junqi Zhang, Yiqun Liu, Shaoping Ma, and Qi Tian. 2018. Relevance estimation with multiple information sources on search engine result pages. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 627--636.
[46]
Wei-Long Zheng and Bao-Liang Lu. 2016. Personalizing EEG-based affective models with transfer learning. In Proceedings of the twenty-fifth international joint conference on artificial intelligence. 2732--2738.

Cited By

View all
  • (2024)Brain-Computer Interface Meets Information Retrieval: Perspective on Next-generation Information SystemProceedings of the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding10.1145/3688862.3689114(61-65)Online publication date: 28-Oct-2024
  • (2024)GNN4EEG: A Benchmark and Toolkit for Electroencephalography Classification with Graph Neural NetworkCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678475(612-617)Online publication date: 5-Oct-2024
  • (2024)Query Augmentation with Brain SignalsProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681658(7561-7570)Online publication date: 28-Oct-2024
  • Show More Cited By

Index Terms

  1. Why Don't You Click: Understanding Non-Click Results in Web Search with Brain Signals

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
    July 2022
    3569 pages
    ISBN:9781450387323
    DOI:10.1145/3477495
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 July 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. brain signals
    2. click necessity
    3. eeg
    4. good abandonment
    5. usefulness
    6. zero-click search

    Qualifiers

    • Research-article

    Funding Sources

    • the Natural Science Foundation of China (Grant No. U21B2026)
    • Tsinghua University Guoqiang Research Institute

    Conference

    SIGIR '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)341
    • Downloads (Last 6 weeks)38
    Reflects downloads up to 27 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Brain-Computer Interface Meets Information Retrieval: Perspective on Next-generation Information SystemProceedings of the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding10.1145/3688862.3689114(61-65)Online publication date: 28-Oct-2024
    • (2024)GNN4EEG: A Benchmark and Toolkit for Electroencephalography Classification with Graph Neural NetworkCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678475(612-617)Online publication date: 5-Oct-2024
    • (2024)Query Augmentation with Brain SignalsProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681658(7561-7570)Online publication date: 28-Oct-2024
    • (2024)Identifying Hand-based Input Preference Based on Wearable EEGProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653028(102-118)Online publication date: 4-Apr-2024
    • (2024)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 9-Feb-2024
    • (2024)EEG-SVRec: An EEG Dataset with User Multidimensional Affective Engagement Labels in Short Video RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657890(698-708)Online publication date: 10-Jul-2024
    • (2024)Understanding Feeling-of-Knowing in Information Search: An EEG StudyACM Transactions on Information Systems10.1145/361138442:3(1-30)Online publication date: 22-Jan-2024
    • (2023)Query-dominant User Interest Network for Large-Scale Search RankingProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615022(629-638)Online publication date: 21-Oct-2023
    • (2022)Brain Topography Adaptive Network for Satisfaction Modeling in Interactive Information Access SystemProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548258(90-100)Online publication date: 10-Oct-2022

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media