ABSTRACT
Hiring and engaging real users for conducting user studies is costly and time consuming. Therefore, simulating users has been proposed as a resource saving solution. Simulation helps to predict users' performance with retrieval systems and could provide researchers with much needed insights. There is a growing body of research in simulating users but most of the research conducted in the field is based only on data about how real users interact with the Information Retrieval System (IRS) leaving out aspects describing information seeking behaviours and individual differences. Consequently, essential data about users is not accounted thus the models are less realistic. To overcome this issue, an alternative approach is proposed. It concerns looking at user behaviour and analysing all the influencing factors that contribute to the user profile in order to produce representative user models. Thus, the aim of this research is to build real user profiles in order to produce more realistic user simulation. We will achieve that by capturing information seeking behaviour through user studies and selecting those factors and attributes that make our user models more realistic and operational at the same time. Furthermore, the proposed approach will allow to reduce the number of real users needed to evaluate the system.
- R. Arezki, P. Poncelet, G. Dray, and D. W. Pearson. Information retrieval model based on user profile. In Artificial Intelligence: Methodology, Systems, and Applications, pages 490--499. Springer, 2004.Google ScholarCross Ref
- L. Azzopardi. Modelling interaction with economic models of search. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, pages 3--12. ACM, 2014. Google ScholarDigital Library
- L. Azzopardi and G. Zuccon. Building and using models of information seeking, search and retrieval. In SIGIR 2015: 38th Annual ACM SIGIR Conference, pages 1107--1110, 2015. Google ScholarDigital Library
- M. J. Bates. The design of browsing and berrypicking techniques for the online search interface. Online review, 13(5):407--424, 1989.Google ScholarCross Ref
- T. Bond and C. M. Fox. Applying the Rasch model: Fundamental measurement in the human sciences. Lawrence Erlbaum, 2007.Google Scholar
- P. Borlund. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation, 59(1):71--90, 2000.Google ScholarCross Ref
- T. Catarci and S. Kimani. Human-computer interaction view on information retrieval evaluation. In Information Retrieval Meets Information Visualization, pages 48--75. Springer, 2012. Google ScholarDigital Library
- M. J. Cole. Simulation of the iir user: Beyond the automagic. Simulation of Interaction, page 1, 2010.Google Scholar
- C. Courage and K. Baxter. Understanding Your Users: A practical guide to user requirements Methods. Elsevier, 2005. Google ScholarDigital Library
- N. Fuhr. A probability ranking principle for interactive information retrieval. Information Retrieval, 11(3):251--265, 2008. Google ScholarDigital Library
- S. Jones, S. J. Cunningham, R. McNab, and S. Boddie. A transaction log analysis of a digital library. International Journal on Digital Libraries, 3(2):152--169, 2000.Google ScholarCross Ref
- S. Lainé-Cruzel, T. Lafouge, J.-P. Lardy, and N. B. Abdallah. Improving information retrieval by combining user profile and document segmentation. Information Processing & Management, 32(3):305--315, 1996. Google ScholarDigital Library
- Y. Li and D. Hu. Interactive retrieval using simulated versus real work task situations: Differences in sub-facets of tasks and interaction performance. Proceedings of the American Society for Information Science and Technology, 50(1):1--10, 2013. Google ScholarDigital Library
- B. Mianowska and N. T. Nguyen. A method for collaborative recommendation in document retrieval systems. In Intelligent Information and Database Systems, pages 168--177. Springer, 2013. Google ScholarDigital Library
- D. Nicholas, P. Huntington, H. R. Jamali, I. Rowlands, and M. Fieldhouse. Student digital information-seeking behaviour in context. Journal of Documentation, 65(1):106--132, 2009.Google ScholarCross Ref
- O. Pietquin and H. Hastie. A survey on metrics for the evaluation of user simulatinons. Knowledge Engineering Review, 28(01):59--73, 2013.Google ScholarCross Ref
- P. Pirolli and S. Card. Information foraging. Psychological review, 106(4):643, 1999.Google ScholarCross Ref
- D. Sawadogo, R. Champagnat, and P. Estraillier. User profile modelling for digital resource management systems. In The 22nd Conference on User Modeling, Adaptation and Personalization, 2014.Google Scholar
- S. Schiaffino and A. Amandi. Intelligent user profiling. In Artificial Intelligence An International Perspective, pages 193--216. Springer, 2009. Google ScholarDigital Library
- M. D. Smucker and C. L. Clarke. Modeling user variance in time-biased gain. In Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval, page 3. ACM, 2012. Google ScholarDigital Library
- V. Snášel, A. Abraham, S. Owais, J. Platoš, and P. Krömer. User profiles modeling in information retrieval systems. In Emergent Web Intelligence: Advanced Information Retrieval, pages 169--198. Springer, 2010.Google ScholarCross Ref
Index Terms
- Automatic Simulation of Users for Interactive Information Retrieval
Recommendations
System And User Centered Evaluation Approaches in Interactive Information Retrieval (SAUCE 2016)
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and RetrievalThe purpose of this half-day workshop is to bring together academic and industry interactive information retrieval (IIR) researchers with an interest in evaluation methodologies. The workshop articulates contemporary challenges in the investigation of ...
Personalised Information Retrieval: survey and classification
Information Retrieval (IR) systems assist users in finding information from the myriad of information resources available on the Web. A traditional characteristic of IR systems is that if different users submit the same query, the system would yield the ...
Contextual information search based on ontological user profile
ICCCI'10: Proceedings of the Second international conference on Computational collective intelligence: technologies and applications - Volume Part IIInternet users use the web to search for information they need. Every user has some particular interests and preferences when he/she searches information on the web. It is challenging to trace the exact interests of a user by a system to provide the ...
Comments