skip to main content
10.1145/3020165.3022168acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
abstract

Automatic Simulation of Users for Interactive Information Retrieval

Published:07 March 2017Publication History

ABSTRACT

Hiring and engaging real users for conducting user studies is costly and time consuming. Therefore, simulating users has been proposed as a resource saving solution. Simulation helps to predict users' performance with retrieval systems and could provide researchers with much needed insights. There is a growing body of research in simulating users but most of the research conducted in the field is based only on data about how real users interact with the Information Retrieval System (IRS) leaving out aspects describing information seeking behaviours and individual differences. Consequently, essential data about users is not accounted thus the models are less realistic. To overcome this issue, an alternative approach is proposed. It concerns looking at user behaviour and analysing all the influencing factors that contribute to the user profile in order to produce representative user models. Thus, the aim of this research is to build real user profiles in order to produce more realistic user simulation. We will achieve that by capturing information seeking behaviour through user studies and selecting those factors and attributes that make our user models more realistic and operational at the same time. Furthermore, the proposed approach will allow to reduce the number of real users needed to evaluate the system.

References

  1. R. Arezki, P. Poncelet, G. Dray, and D. W. Pearson. Information retrieval model based on user profile. In Artificial Intelligence: Methodology, Systems, and Applications, pages 490--499. Springer, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  2. L. Azzopardi. Modelling interaction with economic models of search. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval, pages 3--12. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. L. Azzopardi and G. Zuccon. Building and using models of information seeking, search and retrieval. In SIGIR 2015: 38th Annual ACM SIGIR Conference, pages 1107--1110, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. J. Bates. The design of browsing and berrypicking techniques for the online search interface. Online review, 13(5):407--424, 1989.Google ScholarGoogle ScholarCross RefCross Ref
  5. T. Bond and C. M. Fox. Applying the Rasch model: Fundamental measurement in the human sciences. Lawrence Erlbaum, 2007.Google ScholarGoogle Scholar
  6. P. Borlund. Experimental components for the evaluation of interactive information retrieval systems. Journal of Documentation, 59(1):71--90, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  7. T. Catarci and S. Kimani. Human-computer interaction view on information retrieval evaluation. In Information Retrieval Meets Information Visualization, pages 48--75. Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. J. Cole. Simulation of the iir user: Beyond the automagic. Simulation of Interaction, page 1, 2010.Google ScholarGoogle Scholar
  9. C. Courage and K. Baxter. Understanding Your Users: A practical guide to user requirements Methods. Elsevier, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. N. Fuhr. A probability ranking principle for interactive information retrieval. Information Retrieval, 11(3):251--265, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. S. Jones, S. J. Cunningham, R. McNab, and S. Boddie. A transaction log analysis of a digital library. International Journal on Digital Libraries, 3(2):152--169, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  12. S. Lainé-Cruzel, T. Lafouge, J.-P. Lardy, and N. B. Abdallah. Improving information retrieval by combining user profile and document segmentation. Information Processing & Management, 32(3):305--315, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Y. Li and D. Hu. Interactive retrieval using simulated versus real work task situations: Differences in sub-facets of tasks and interaction performance. Proceedings of the American Society for Information Science and Technology, 50(1):1--10, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. B. Mianowska and N. T. Nguyen. A method for collaborative recommendation in document retrieval systems. In Intelligent Information and Database Systems, pages 168--177. Springer, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D. Nicholas, P. Huntington, H. R. Jamali, I. Rowlands, and M. Fieldhouse. Student digital information-seeking behaviour in context. Journal of Documentation, 65(1):106--132, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  16. O. Pietquin and H. Hastie. A survey on metrics for the evaluation of user simulatinons. Knowledge Engineering Review, 28(01):59--73, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  17. P. Pirolli and S. Card. Information foraging. Psychological review, 106(4):643, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  18. D. Sawadogo, R. Champagnat, and P. Estraillier. User profile modelling for digital resource management systems. In The 22nd Conference on User Modeling, Adaptation and Personalization, 2014.Google ScholarGoogle Scholar
  19. S. Schiaffino and A. Amandi. Intelligent user profiling. In Artificial Intelligence An International Perspective, pages 193--216. Springer, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. M. D. Smucker and C. L. Clarke. Modeling user variance in time-biased gain. In Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval, page 3. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. V. Snášel, A. Abraham, S. Owais, J. Platoš, and P. Krömer. User profiles modeling in information retrieval systems. In Emergent Web Intelligence: Advanced Information Retrieval, pages 169--198. Springer, 2010.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Automatic Simulation of Users for Interactive Information Retrieval

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHIIR '17: Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval
        March 2017
        454 pages
        ISBN:9781450346771
        DOI:10.1145/3020165
        • Conference Chairs:
        • Ragnar Nordlie,
        • Nils Pharo,
        • Program Chairs:
        • Luanne Freund,
        • Birger Larsen,
        • Dan Russel

        Copyright © 2017 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 7 March 2017

        Check for updates

        Qualifiers

        • abstract

        Acceptance Rates

        CHIIR '17 Paper Acceptance Rate10of48submissions,21%Overall Acceptance Rate55of163submissions,34%
      • Article Metrics

        • Downloads (Last 12 months)7
        • Downloads (Last 6 weeks)0

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader