Abstract
Along with single word query, phrase query is frequently used in digital library. This paper proposes a new partition based hierarchical index structure for efficient phrase query and a parallel algorithm based on the index structure. In this scheme, a document is divided into several elements. The elements are distributed on several processors. In each processor, a hierarchical inverted index is built, by which single word and phrase queries can be answered efficiently. This index structure and the partition make the postings lists shorter. At the same time, integer compression technique is used more efficiently. Experiments and analysis show that query evaluation time is significantly reduced.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zobel, J., Moffat, A., Ramamohanarao, K.: Inverted files versus signature files for text indexing. ACM Transactions on Database Systems (1998)
Harman, D., Fox, E., Baeza-Yates, R., Lee, W.: Inverted files. In: Frakes, W., Baeza- Yates, R. (eds.) Information Retrieval: Data Structure and Algorithms. ch. 3, pp. 28–43. Prentice-Hall, Englewood Cliffs (1992)
Paynter, G.W., Witten, I.H., Cunningham, S.J., Buchanan, G.: Scalable browsing for large collections: A case study. In: Proc. of the 5th ACM International Conference on Digital Libraries, San Antonio, pp. 215–223 (2000)
Hugh, E., Williams, H.E., Zobel, J.: Compressing Integers for Fast File Access. The computer Journal 42(3) (1999)
Navarro, G., de Moura, E.S., Neubert, M., Ziviani, N., Baeza-Yates, R.: Adding Compression to Block Addressing Inverted Indexes. Kluwer Academic publishs, Dordrecht (2000)
Moffat, A., Zobel, J.: Self Indexing Inverted Files for Fast Text Retrieval. ACM Transactions on Information Systems 14(4), 349–379 (1996)
Scholer, F., Williams, H.E., Yiannis, J., Zobel, J.: Compression of Inverted Indexes for Fast Query Evaluation. In: Annual ACM Conference on Research and Development in Information Retrieval (2002)
Ribeiro-Neto, B., Moura, E.S., Neubert, M.S., Ziviani, N.: Efficient Distributed Algorithms to Build Inverted Files. In: Annual ACM Conference on Research and Development in Information Retrieval (1999)
Williams, H.E., Zobel, J., Anderson, P.: What’s Next? Index Structures for Efficient Phrase Querying. In: Proceedings of the Tenth Australasian Database Conference (1999)
Bahle, D., Williams, H.E., Zobel, J.: Optimized Phrase Querying and Browsing of Large Text Databases. In: Proc. Of Australasian Computer Science Conference (2001)
Bahle, D., Williams, H.E., Zobel, J.: Compaction Techniques for Nextword Indexes. In: Proc. 8th International Symposium on String Processing and Information Retrieval (SPIRE2001), San Rafael, Chile, pp. 33–45 (2001)
Bahle, D., Williams, H.E., Zobel, J.: Efficient Phrase Querying with an Auxiliary Index. In: Annual ACM Conference on Research and Development in Information Retrieval (2002)
Zobel, J., Moffat, A.: Exploring the similarity space. SIGIR Forum 32(1), 18–34 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, Y., Liu, B., Zhang, Z. (2003). Partition Based Hierarchical Index for Text Retrieval. In: Dong, G., Tang, C., Wang, W. (eds) Advances in Web-Age Information Management. WAIM 2003. Lecture Notes in Computer Science, vol 2762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45160-0_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-45160-0_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40715-7
Online ISBN: 978-3-540-45160-0
eBook Packages: Springer Book Archive