Abstract
We have developed distributed search engine, called Cooperative Search Engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a meta search server integrates these local search engines in order to realize a global search engine. However, in such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search fast. However, we have developed several speedup techniques in order to realize real time retrieval. By the way, distributed search engines such as CSE are essentially fault tolerant. However, the meta server is single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper, we describe reliability of CSE and their evaluations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yamana, H., Kondo, H., “Search Engine Google,” IPSJ MAGAZINE, Vol.42, No.8, pp.775–780 (2001)
Google, “Google Information for Webmasters,” http://www.google.com/webmasters/
Sato, N., Uehara, M., Sakai, Y., Mori, H., “Distributed Information Retrieval by using Cooperative Meta Search Engines,” in proc. of the 21st IEEE International Conference on Distributed Computing Systems Workshops (Multimedia Network Systems, MNS2001), pp.345–350, (2001)
Sato, N., Uehara, M., Sakai, Y., Mori, H., “Fresh Information Retrieval using Cooperative Meta Search Engines,” in proc. of the 16th International Conference on Information Networking (ICOIN-16), Vol.2, 7A-2, pp.1–7, (2002)
The Namazu Project, “Namazu,” http://www.namazu.org/
Sakai, Y., Sato, N., Uehara, M., Mori, H., “The Optimal Monotonization for Search Queries in Cooperative Search Engine,” in proc. of DICOMO2001, IPSJ Symposium Series, Vol.2001, No.7, pp.453–458 (2001) (in Japanese)
Sato, N., Uehara, M., Sakai, M., Mori, H., “Fresh Information Retrieval in Cooperative Search Engine,” in proc. of 2nd International Conference on Software Engineering, Artificial Intelligence, Networking & Parallel/Distributed Computing 2001 (SNPD’01), pp.104–111, Nagoya Japan (2001)
Sato, N., Uehara, N., Sakai, Y., Mori, H., “Score Based Site Selection in Cooperative Search Engine,” in proc. of DICOMO’2001 IPSJ Symposium Series, Vol.2001, No.7, pp.465–470 (2001) (in Japanese)
Sato, N., Uehara, M., Sakai, Y., Mori, H., “Global Shared Cache in Cooperative Search Engine,” in proc. of DPSWS 2001, IPSJ Symposium Series, Vol.2001, No.13, pp.219–224 (2001) (in Japanese)
Sato, N., Uehara, M., Sakai, Y., Mori, H., “Persistent Cache in Cooperative Search Engine,” MNSA’02 (to appear)
Weider. C., Fullton, J., Spero, S., “Architecture of the Whois++ Index Service”, RFC1913 (1996)
Bowman, C.M., Danzig, P.B., Hardy, D.R., Manber, U., Schwartz, M.F., “The Harvest Information Discovery and Access System,” 2nd WWW Conference, http://www.ncsa.uiuc.edu/SDG/IT94/Proceedings/Searching/schwartz.harvest/schwartz.harvest.html
Nippon Telegraph and Telephone Corp., “Ingrid”, http://www.ingrid.org/
Fischer, M.J., Lynch, N.A., and Paterson, M.S., “Impossibility of distributed consensus with one fault process,” Journal of ACM Vol.32, No.2, pp.3740–382 (1985)
Perry, K.J., “Randomized Byzantine agreements,” IEEE Transaction of Software Engineering SE-11, No.6, pp.539–546 (1985)
Uehara, M., Mori, H., “Fault Tolerant Computing in Computational Field Model,” in proc. of IEEE Conf. ECBS’97, pp.34–37 (1997)
Birman, K.P. “The Process Group Approach to Reliable Distributed Computing,” Commun. of the ACM, vol.36, pp.36–53, Dec. (1993)
Clarke, I., Miller, S.G, Theodore W. Hong, Oskar Sandberg, Brandon Wiley, “Protecting Free Expression Online with Freenet,” IEEE Internet Computing, Jan./Feb. pp.40–49 (2002)
Project JXTA, “JXTA,” http://www.jxta.org/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sato, N., Udagawa, M., Uehara, M., Sakai, Y. (2003). Reliability of a Distributed Search Engine for Fresh Information Retrieval in Large-Scale Intranet. In: Guo, M., Yang, L.T. (eds) Parallel and Distributed Processing and Applications. ISPA 2003. Lecture Notes in Computer Science, vol 2745. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-37619-4_5
Download citation
DOI: https://doi.org/10.1007/3-540-37619-4_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40523-8
Online ISBN: 978-3-540-37619-4
eBook Packages: Springer Book Archive