Abstract
Subjective relevance (SR) is defined as usefulness of documents for tasks. This paper enhances objective relevance and tackles its limitations by conducting a quantitative study to understand students’ perceptions of features for supporting evaluations of subjective relevance of documents. Data was analyzed by factor analysis to identify groups of features that supported students’ document evaluations during IR interaction stages and provide design guidelines for an IR interface supporting students’ document evaluations. Findings suggested an implied order of importance amongst groups of features for each interaction stage. The paper concludes by discussing groups of features, its implied order of importance, and support for information seeking activities to provide design implications for IR interfaces supporting SR.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Balabanovic, M., Shoham, Y.: Fab: Content-based, collaborative recommendation. Communications of the ACM 40(3), 66–72 (1997)
Barry, C.L.: User-defined relevance criteria: an exploratory study. Journal of the American Society for Information Science 45(3), 149–159 (1994)
Belkin, N.J., Oddy, R.N., Brooks, H.: ASK for information retrieval: Part I. background and theory. The Journal of Documentation 38(2), 61–71 (1982)
Borlund, P., Ingwersen, P.: Measures for relative relevance and ranked half-life: Performance indicators for interactive IR. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 324–331. ACM Press, New York (1998)
Carroll, J.M.: Making use: Scenario-based design of human-computer interactions. The MIT Press, California (2000)
Cosijin, E., Ingwersen, P.: Dimensions of relevance. Information Processing and Management 63, 533–550 (2000)
Costello, A.B., Osborne, J.W.: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation: A Peer-reviewed Electronic Journal 10(7) (2005), http://pareonline.net/pdf/v10n7.pdf
Cronbach, L.J.: Coefficient alpha and the internal structure of tests. Psychometrika 16, 297–334 (1951)
Druin, A., et al.: Designing a digital library for young children: An intergenerational partnership. In: Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 398–401. ACM Press, New York (2001)
Ellis, D.: A behavioural approach to information retrieval system design. Journal of Documentation 45(3), 171–212 (1989)
Fischer, G., Henninger, S., Redmiles, D.: Cognitive tools for locating and comprehending software objects for reuse. In: Proceedings of 13th International Conference on Software Engineering, pp. 318–328. IEEE Computer Society Press, Los Alamitos (1991)
Ingwersen, P., Borlund, P.: Information transfer viewed as interactive cognitive processes. In: Ingwersen, P., Pors, N.O. (eds.) Information Science: Integration in Perspective, pp. 219–232. Royal School of Librarianship, Denmark (1996)
Kim, J.-O., Mueller, C.W.: Factor analysis: statistical methods and practical issues. Sage Publications, Inc., California (1978)
Lattin, J., Carroll, J.D., Green, P.E.: Analyzing multivariate data. Brooks/Cole, Nelson (2003)
Lee, S.S., Theng, Y.L., Goh, D.H.L., Foo, S.S.B.: Subjective relevance: Implications on interface design for information retrieval systems. In: Fox, E.A., Neuhold, E.J., Premsmit, P., Wuwongse, V. (eds.) ICADL 2005. LNCS, vol. 3815, pp. 424–434. Springer, Heidelberg (2005)
Lieberman, H.: An agent for web browsing. In: Proc. International Conference on Artificial Intelligence, pp. 924–929 (1995)
Marchionini, G.: Information seeking in electronic environments. Cambridge University Press, Cambridge (1995)
Meyyapan, N., Chowdhury, G.G., Foo, S.: Use of a digital work environment prototype to create a user-centered university library. Journal of Information Science 27(4), 249–264 (2001)
Mizzaro, S.: How many relevances in information retrieval? Interacting with Computers 10, 303–320 (1998)
Netemeyer, R.G., Bearden, W.O., Sharma, S.: Scaling procedures: issues and applications. Sage Publications, California (2003)
Norman, D.A.: The psychology of everyday things. Basic Books, New York (1998)
Nunnally, J.C.: Psychometric Theory, 2nd edn. MacGraw-Hill, New York (1978)
Resnick, P., Iacovou, N., Mitesh, S., Bergstron, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of Netnews. In: Proc. ACM Conference on Computer Supported Cooperative Work, pp. 175–186. ACM Press, New York (1994)
Tang, R., Soloman, P.: Toward an understanding of the dynamics of relevance judgment: An analysis of one person’s search behavior. Information Process and Management 34, 237–256 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, SS., Theng, YL., Goh, D.HL., Foo, S.SB. (2006). An Exploratory Factor Analytic Approach to Understand Design Features for Academic Learning Environments. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2006. Lecture Notes in Computer Science, vol 4172. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11863878_27
Download citation
DOI: https://doi.org/10.1007/11863878_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44636-1
Online ISBN: 978-3-540-44638-5
eBook Packages: Computer ScienceComputer Science (R0)