skip to main content
10.1145/3020165.3020184acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Investigating Users' Time Perception during Web Search

Published: 07 March 2017 Publication History

Abstract

Due to the tremendous economic value of search result pages, search engine companies have invested a lot to improve their quality. Recently, much effort has been made to directly model key aspects of users' interactions with search system, for example, Benefit and Cost. Time has been widely adopted in both of the two aspects since benefit and cost must be expressed in meaningful units in practical application. Psychological studies have demonstrated that the subjectively perceived time might be different from the objective time measured by timing device and the time perception process of human beings is affected by some psychological factors, such as motivation and interest, which are closely related to the search process. Considering that time is usually used to describe the subject experience of search users, it is necessary to investigate the difference between perceived time and objective time in search process. In psychology, there is a temporal illusion effect named Vierordt's law, i.e. shorter intervals tend to be overestimated while longer intervals tend to be underestimated. In this work, we carefully designed a lab-study to examine the impact of duration length on user's time perception in the context of search. Experimental results show that Vierordt's law is consistently observed in Web search environment. This work could help us to correct the estimation of users' perceived time and provide insights about the mechanism of satisfaction.

References

[1]
L. Anderson, D. Krathwohl, and B. Bloom. A taxonomy for learning, teaching, and assessing: a revision of Bloom's taxonomy of educational objectives. Longman, 2001.
[2]
I. Arapakis, X. Bai, and B. B. Cambazoglu. Impact of response latency on user behavior in web search. In SIGIR '14.
[3]
J. A. Aslam, M. Ekstrand-Abueg, V. Pavlu, F. Diaz, and T. Sakai. Trec 2013 temporal summarization. In TREC '13.
[4]
L. Azzopardi. The economics in interactive information retrieval. In SIGIR '11.
[5]
L. Azzopardi and G. Zuccon. An analysis of theories of search and search behavior. In ICTIR '15, pages 81--90. ACM, 2015.
[6]
K. Berberich, S. Bedathur, O. Alonso, and G. Weikum. A language modeling approach for temporal information needs. In ECIR '10.
[7]
R. A. Block and D. Zakay. Prospective and retrospective duration judgments: A meta-analytic review. Psychonomic bulletin & review, 4(2):184--197, 1997.
[8]
R. A. Block and D. Zakay. Psychological time at the millennium: Some past, present, future, and interdisciplinary issues. Time: Perspectives at the millennium (The study of time X), 2001.
[9]
A. Borisov, I. Markov, M. de Rijke, and P. Serdyukov. A context-aware time model for web search.
[10]
R. Capra, J. Arguello, A. Crescenzi, and E. Vardell. Differences in the use of search assistance for tasks of varying complexity. In SIGIR '15.
[11]
S. Cheng, A. Arvanitis, and V. Hristidis. How fresh do you want your search results? In CIKM'2013.
[12]
C. L. Clarke, M. D. Smucker, and E. Yilmaz. Ir evaluation: Modeling user behavior for measuring effectiveness. In SIGIR '15.
[13]
C. L. A. Clarke and M. D. Smucker. Time well spent. In IIiX '14.
[14]
C. W. Cleverdon and M. Keen. Aslib cranfield research project-factors determining the performance of indexing systems; volume 2, test results. 1966.
[15]
A. Crescenzi, R. Capra, and J. Arguello. Time pressure, user satisfaction and task difficulty. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries, ASIST '13, pages 122:1--122:4, Silver Springs, MD, USA, 2013. American Society for Information Science.
[16]
A. Crescenzi, D. Kelly, and L. Azzopardi. Impacts of time constraints and system delays on user experience. In CHIIR'2016.
[17]
A. Crescenzi, D. Kelly, and L. Azzopardi. Time pressure and system delays in information search. In SIGIR'2015.
[18]
M. Czerwinski, E. Horvitz, and E. Cutrell. Subjective duration assessment: An implicit probe for software usability. In IHM-HCI'2001.
[19]
N. Dai, M. Shokouhi, and B. D. Davison. Learning to rank for freshness and relevance. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, pages 95--104. ACM, 2011.
[20]
W. Dakka, L. Gravano, and P. G. Ipeirotis. Answering general time sensitive queries. In Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM '08, pages 1437--1438, New York, NY, USA, 2008. ACM.
[21]
J.-C. Dreher, A. Meyer-Lindenberg, P. Kohn, and K. F. Berman. Age-related changes in midbrain dopaminergic regulation of the human reward system. Proceedings of the National Academy of Sciences, 105(39):15106--15111, 2008.
[22]
S. Droit-Volet, S. L. Fayolle, and S. Gil. Emotion and time perception: effects of film-induced mood. Frontiers in integrative neuroscience, 5, 2011.
[23]
A. Edwards and D. Kelly. How does interest in a work task impact search behavior and engagement? In CHIIR '16, pages 249--252. ACM, 2016.
[24]
M. Efron and G. Golovchinsky. Estimation methods for ranking recent information. In SIGIR '11.
[25]
C. Fortin and R. Rousseau. Interference from short-term memory processing on encoding and reproducing brief durations. Psychological Research, 61(4):269--276, 1998.
[26]
S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM Transactions on Information Systems (TOIS), 23(2):147--168, 2005.
[27]
P. Fraisse. Perception and estimation of time. Annual review of psychology, 35(1):1--37, 1984.
[28]
N. Fuhr. A probability ranking principle for interactive information retrieval. Information Retrieval, 11(3):251--265, 2008.
[29]
P. A. Gable and B. D. Poole. Time flies when you're having approach-motivated fun effects of motivational intensity on time perception. Psychological science, page 0956797611435817, 2012.
[30]
S. Grondin. Psychology of time. Emerald Group Publishing, 2008.
[31]
S. Grondin and M. Plourde. Judging multi-minute intervals retrospectively. The Quarterly Journal of Experimental Psychology, 60(9):1303--1312, 2007.
[32]
D. Gupta and K. Berberich. Identifying time intervals of interest to queries. In CIKM '14.
[33]
A. Hassan. A semi-supervised approach to modeling web search satisfaction. In SIGIR '12.
[34]
A. Hassan and R. W. White. Personalized models of search satisfaction. In CIKM'13.
[35]
R. E. Hicks, G. W. Miller, G. Gaes, and K. Bierman. Concurrent processing demands and the experience of time-in-passing. The American Journal of Psychology, pages 431--446, 1977.
[36]
B. J. Jansen, D. Booth, and B. Smith. Using the taxonomy of cognitive learning to model online searching. Information Processing & Management, 45(6):643--663, 2009.
[37]
K. Järvelin, P. Vakkari, P. Arvola, F. Baskaya, A. Järvelin, J. Kekäläinen, H. Keskustalo, S. Kumpulainen, M. Saastamoinen, R. Savolainen, et al. Task-based information interaction evaluation: The viewpoint of program theory. ACM Trans. Inf. Syst., 33(1):3:1--3:30, Mar. 2015.
[38]
J. Jiang, A. Hassan Awadallah, X. Shi, and R. W. White. Understanding and predicting graded search satisfaction. In WSDM '15.
[39]
J. Jiang and C. Ni. What affects word changes in query reformulation during a task-based search session? In CHIIR '16.
[40]
N. Kanhabua and K. Nørvåg. Learning to rank search results for time-sensitive queries. In CIKM'2012.
[41]
D. Kelly, J. Arguello, A. Edwards, and W.-c. Wu. Development and evaluation of search tasks for iir experiments using a cognitive complexity framework. In ICTIR '15.
[42]
Y. Kim, A. Hassan, R. W. White, and I. Zitouni. Modeling dwell time to predict click-level satisfaction. In WSDM '14.
[43]
Y. Li and N. J. Belkin. A faceted approach to conceptualizing tasks in information seeking. Information Processing & Management, 44(6):1822--1837, 2008.
[44]
C. Liu, J. Liu, N. Belkin, M. Cole, and J. Gwizdka. Using dwell time as an implicit measure of usefulness in different task types. Proceedings of the American Society for Information Science and Technology, 48(1):1--4, 2011.
[45]
J. Liu, C. Liu, M. Cole, N. J. Belkin, and X. Zhang. Exploring and predicting search task difficulty. In CIKM '12.
[46]
C. Luo, Y. Liu, T. Sakai, K. Zhou, F. Zhang, X. Li, and S. Ma. Does document relevance affect the searcher's perception of time? In WSDM'17.
[47]
C. Luo, F. Zhang, X. Li, Y. Liu, M. Zhang, S. Ma, and D. Yang. Manipulating time perception of web search users. In CHIIR '16.
[48]
J. Mao, Y. Liu, K. Zhou, J.-Y. Nie, J. Song, M. Zhang, S. Ma, J. Sun, and H. Luo. When does relevance mean usefulness and user satisfaction in web search?
[49]
D. Metzler, R. Jones, F. Peng, and R. Zhang. Improving search relevance for implicitly temporal queries. In SIGIR'09.
[50]
N. Mishra, R. W. White, S. Ieong, and E. Horvitz. Time-critical search. In SIGIR'2014.
[51]
M.-H. Peetz, E. Meij, and M. de Rijke. Using temporal bursts for query modeling. Information Retrieval, 17(1):74--108, 2014.
[52]
P. Pirolli and S. Card. Information foraging. Psychological review, 106(4):643, 1999.
[53]
T. Sakai and Z. Dou. Summaries, ranked retrieval and sessions: A unified framework for information access evaluation. In SIGIR '13.
[54]
M. D. Smucker and C. L. Clarke. Time-based calibration of effectiveness measures. In SIGIR '12.
[55]
M. Sucala, B. Scheckner, and D. David. Psychological time: interval length judgments and subjective passage of time judgments. Current psychology letters. Behaviour, brain & cognition, 26(2, 2010), 2011.
[56]
J. Teevan, K. Collins-Thompson, R. W. White, S. T. Dumais, and Y. Kim. Slow search: Information retrieval without time constraints. In HCIR'2013.
[57]
D. K. Tse and P. C. Wilton. Models of consumer satisfaction formation: An extension. Journal of marketing research, pages 204--212, 1988.
[58]
J. H. Wearden and I. S. Penton-Voak. Feeling the heat: Body temperature and the rate of subjective time, revisited. The Quarterly Journal of Experimental Psychology, 48(2):129--141, 1995.
[59]
B. B. Weybrew. The zeigarnik phenomenon revisited: Implications for enhancement of morale. Perceptual and Motor Skills, 58(1):223--226, 1984.
[60]
D. Zakay. Relative and absolute duration judgments under prospective and retrospective paradigms. Perception & psychophysics, 54(5):656--664, 1993.

Cited By

View all
  • (2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 1-Jun-2024
  • (2023)A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972–2020ACM Transactions on Information Systems10.1145/358306942:1(1-39)Online publication date: 9-Feb-2023
  • (2023)The effects of mobile applications’ passive and interactive loading screen types on waiting experienceBehaviour & Information Technology10.1080/0144929X.2023.222490143:8(1652-1663)Online publication date: 26-Jun-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval
March 2017
454 pages
ISBN:9781450346771
DOI:10.1145/3020165
  • Conference Chairs:
  • Ragnar Nordlie,
  • Nils Pharo,
  • Program Chairs:
  • Luanne Freund,
  • Birger Larsen,
  • Dan Russel
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. interactive information retrieval
  2. search evaluation
  3. time perception

Qualifiers

  • Research-article

Funding Sources

Conference

CHIIR '17
Sponsor:

Acceptance Rates

CHIIR '17 Paper Acceptance Rate 10 of 48 submissions, 21%;
Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 1-Jun-2024
  • (2023)A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972–2020ACM Transactions on Information Systems10.1145/358306942:1(1-39)Online publication date: 9-Feb-2023
  • (2023)The effects of mobile applications’ passive and interactive loading screen types on waiting experienceBehaviour & Information Technology10.1080/0144929X.2023.222490143:8(1652-1663)Online publication date: 26-Jun-2023
  • (2021)Untangling Cost, Effort, and Load in Information Seeking and RetrievalProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446026(151-161)Online publication date: 14-Mar-2021
  • (2021)The effect of mobile applications’ initial loading pages on users’ mental state and behaviorDisplays10.1016/j.displa.2021.10200768(102007)Online publication date: Jul-2021
  • (2020)Perception of Time in the Product Configuration Process: An Empirical Study2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC42975.2020.9283032(4340-4345)Online publication date: 11-Oct-2020
  • (2017)Tianji: Implementation of an Efficient Tracking Engine in the Mobile Internet EraIEEE Access10.1109/ACCESS.2017.27360645(16592-16600)Online publication date: 2017

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media