Skip to main content

Abstract

The Data-Intensive Web Sites provide access to a large number of Web pages whose content is dynamically extracted from structured databases. They may be used for shopping or paying in e-commerce, for reading news in a newspaper site or to consult digital library. In this context, users often need rich content and fresh data. Several techniques have been developed to meet the demand for faster and more efficient access to the DIWS. Among them a main role is acquired by the replication, the caching, the materialization, and the refreshing of data. Software agents have proved to be a good tool that may give a high performance results on the Web. In this paper, we address their cases of use in the DIWS. We discuss cases in which agents can be used to improve the data management performance. The aim is to specify tasks that may profit from the increase development in agent technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Iyengar, Rosu, D.: Architecting Web sites for high performance. Scientific Programming 10(1), 75–89 (2002)

    Google Scholar 

  2. Labrinidis, Roussopoulos, N.: Adaptive WebView Materialization. In: WebDB 2001, pp. 85–90 (2001)

    Google Scholar 

  3. Labrinidis, Roussopoulos, N.: Balancing Performance and Data Freshness in Web Database Servers. In: VLDB 2003, pp. 393–404 (2003)

    Google Scholar 

  4. Labrinidis, Roussopoulos, N.: Online View Selection for the Web (2002), http://citeseer.ist.psu.edu/cache/papers/cs/25933/http:zSzzSzwww.cs.umd.eduzSzLibraryzSzTRszSzCS-TR-4343zSzCS-TR-4343.pdf/labrinidis02online.pdf

  5. Labrinidis, Roussopoulos, N.: On the Materialization of WebViews. In: ACM SIGMOD Workshop on the Web and Databases (WebDB 1999), pp. 79–84 (1999)

    Google Scholar 

  6. Labrinidis, Roussopoulos, N.: Update Propagation Strategies for Improving the Quality of Data on the Web. In: VLDB 2001, pp. 391–400 (2001)

    Google Scholar 

  7. Labrinidis, Roussopoulos, N.: WebView Materialization. In: Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, Texas, United States, May 15-18, pp. 367–378 (2000)

    Google Scholar 

  8. Labrinidis: Web-Aware Database Servers - I (2002), http://www.cs.pitt.edu/~labrinid/courses/cs2001/webdb-12nov2002.pdf

  9. Christos, Agisilaos, K.: Efficient Materialization of Dynamic Web Data to Improve Web Performance. In: 15th International Conference on Computer Communication (ICCC 2002), Mumbai, India, August 11-14 (2002)

    Google Scholar 

  10. Edgar, Susan, G.: Intelligent Information Agents for the World Wide Web. Technical Report ITTC-FY97-TR-11100-1, Information and Telecommunication Technology Center, The University of Kansas, Lawrence, KS (May 1997)

    Google Scholar 

  11. Mohan: Caching Technologies for Web Applications. In: Proceedings of the 2001 VLDB Conference, Roma, Italy (September 2001)

    Google Scholar 

  12. Johnson, A., Shoja, G.C.: Request Routing Architecture in Content delivery Networks. In: Proceedings of 2003 International Conference on Internet Computing, Las Vegas, USA, June 23-26 (2003)

    Google Scholar 

  13. Gilbert, D., Aparicio, M., Atkinson, B., Brady, S., Ciccarino, J., Grosof, B., O’Connor, P., Osisek, D., Pritko, S., Spagna, R., Wilson, L.: The role of intelligent agents in the information infrastructure. IBM Report (1995)

    Google Scholar 

  14. Katsaros, D., Manolopoulos, Y.: Cache management for Web-powered databases. In: Web-Powered Databases, pp. 201–242. IDEA Group Publishing, USA (2002)

    Google Scholar 

  15. Scilla, Huhns, M.N.: Making Agents Secure on the Semantic Web. IEEE Internet Computing, 76-93 (November/December 2002)

    Google Scholar 

  16. Fischer, Thomas, C.G.: Using Agents to improve the Usability and Usefulness of the World-Wide Web. In: Proceedings UM 1996, Fifth International Conference on User Modeling, Hawaii, pp. 5–12. User Modeling, Inc. (1996)

    Google Scholar 

  17. Mecca, G., Mendelzon, A.O., Merialdo, P.: Efficient Queries over Web Views. In: Schek, H.-J., Saltor, F., Ramos, I., Alonso, G. (eds.) EDBT 1998. LNCS, vol. 1377, pp. 72–78. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  18. Pierre, G., van Steen, M., Tannenbaum, A.S.: Dynamically Selecting Optimal Distribution Strategies for Web Documents. IEEE Transactions on Computers 51(6), 637–651 (2002)

    Article  Google Scholar 

  19. Kabir, Manning, E.G., Shoja, G.C.: Request-Routing Trends and Techniques in Content Distribution Network. In: Proc ICCIT 2002, Dhaka, Bangladesh, December 2002, pp. 315–320 (2002) ISBN 984-32-0450-6

    Google Scholar 

  20. Gupta, H., Mumick, I.S.: Selection of Views to Materialize Under a Maintenance-Time Constraint. In: Beeri, C., Bruneman, P. (eds.) ICDT 1999. LNCS, vol. 1540, pp. 453–470. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  21. Gupta, H.: Selection of Views to Materialize in a Data Warehouse. In: Afrati, F.N., Kolaitis, P.G. (eds.) ICDT 1997. LNCS, vol. 1186, Springer, Heidelberg (1997)

    Google Scholar 

  22. Liebermann, H.: Letizia: An agent that assists Web browsing. In: Proc. Intl. Conf. on AI, Montréal, Canada (August 1995)

    Google Scholar 

  23. Lieberman, H., van Dyke, N., Vivacqua, A.: Let’s browse: a collaborative Web browsing agent. In: Proc. Intl. Conf. on Intelligent User Interfaces (January 1999)

    Google Scholar 

  24. Ari, Miller, E.L.: Caching support for push-pull data dissemination using data snooping routers. In: Proceedings of the 10th International Conference on Parallel and Distributed Systems, ICPADS 2004 (2004)

    Google Scholar 

  25. Wang: A Survey of Web Caching Schemes for the Internet. ACM Computer Communication Review 29(5) (1999)

    Google Scholar 

  26. Watts, Taylor, S.: A Practical Approach to Dynamic Load Balancing. IEEE Trans. on Parallel and Distributed Systems 9(3), 235–248 (1998)

    Article  Google Scholar 

  27. Amiri, Park, S., Tewari, R., Padmanabhan, S.: DBProxy: A Dynamic Data Cache for Web Applications. In: ICDE Conference 2003, pp. 821–831 (2003)

    Google Scholar 

  28. Yagoub, Florescu, D., Issarny, V., Valduriez, P.: Caching strategies for data intensive web sites. In: Proceedings of the VLDB 2000 Conference, pp. 188–199 (2000)

    Google Scholar 

  29. Gao, L., Dahlin, M., Nayate, A., Zheng, J., Iyengar, A.: Improving Availability and Performance with Application-Specific Data Replication. IEEE Trans. Knowl. Data Eng. 17(1), 106–120 (2005)

    Article  Google Scholar 

  30. Bhide, Ramamritham, K., Shenoy, P.: Efficiently Maintaining Stock Portfoilis Up-To-Date On The Web. In: IEEE Reasearch Issues In Data Engineering (RIDE 2002) Workshop (March 2002)

    Google Scholar 

  31. Bouzeghoub, Peralta, V.: A Framework for Analysis of Data Freshness. In: IQIS 2004, pp. 59–67 (2004)

    Google Scholar 

  32. Conti, Gregori, E., Panzieri, F.: Load distribution among replicated web servers: A QOS based approach. In: Second Workshop on Internet Server Performance (May 1999)

    Google Scholar 

  33. Côté, M., Troudi, N.: NetSA: Une Architecture Multiagent pour la Recherche sur Internet. Expertise Informatique 3(3) (1998)

    Google Scholar 

  34. Karlsson, M., Karamanolis, C.: Choosing Replica Placement Heuristics for Wide-Area Systems. In: Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS 2004), March 24-26, pp. 350–359 (2004)

    Google Scholar 

  35. Ashish, Kulkarni, D., Wang, Y.: Source Update Capture in Information Agents. In: Proceedings of IJCAI 2003 Workshop on Information Integration on the Web (IIWeb 2003), Acapulco, Mexico, August 9-10 (2003)

    Google Scholar 

  36. John, N.A.: A Study of Replicated and Distributed Web Content. Thesis, Departement of Computer Science, Worcester Polytechnic Institute (August 2002)

    Google Scholar 

  37. http://www.wpi.edu/Pubs/ETD/Available/etd-0810102-160719/unrestricted/john.pdf

  38. Jennings, N., Wooldridge, M.: Applications of intelligent agents. In: Agent Technology: Foundations, Applications, and Markets. ch. 1, Springer, Heidelberg (1998)

    Google Scholar 

  39. Gibbins, N., Harris, S., Shadbolt, N.: Agent-based Semantic Web Services. In: WWW 2003 (May 2003)

    Google Scholar 

  40. Jennings, N.R., Wooldrige, M., Sycara, K.: A Roadmap of agent research and development. Int Journal of Autonomous Agents and Multi-Agent Systems 1(1), 7–38 (1998)

    Article  Google Scholar 

  41. Jennings, N.R.: An Agent-based approach for building complex software systems. Communications of the ACM 44(4) (April 2001)

    Google Scholar 

  42. Dikenelli, Topaloglu, N.Y., Erdur, C., Ünalir, O.: An Agent-Mediated E-Commerce Framework For Tourism Domain, http://www.srdc.metu.edu.tr/webpage/projects/hermesproject/documents/agent-tourism.pdf

  43. Deolasee, Katkar, A., Panchbudhe, A., Ramamritham, K., Shenoy, P.: Adaptive pushpull: Disseminating dynamic web data. In: Proceedings of the 10th International World Wide Web Conference, Hong Kong, China, May 2001, pp. 265–274 (2001)

    Google Scholar 

  44. Fraternali, P.: Tools and Approaches for Developing Data-Intensive Web Applications: A Survey. ACM Computing Surveys 31(3), 227–263 (1999)

    Article  Google Scholar 

  45. Luo, Q., Naughton, J.F., Krishnamurthy, R., Cao, P., Li, Y.: Active Query Caching for Database Web Servers. In: Suciu, D., Vossen, G. (eds.) WebDB 2000. LNCS, vol. 1997, pp. 29–34. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  46. Luo, Q., Naughton, J.: Form-based proxy caching for database-backed web sites. In: Proceedings of the 2001 VLDB Conference, September 2001, pp. 191–200 (2001)

    Google Scholar 

  47. Luo, Q., Naughton, J., Krishnamurthy, R., Cao, P., Li, Y.: Active Query Caching for Database Web Servers. In: Suciu, D., Vossen, G. (eds.) WebDB 2000. LNCS, vol. 1997, p. 92. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  48. Chirkova, Halevy, A., Suciu, D.: Formal Perspective on the View Selection Problem. In: Proc. VLDB, Roma, Italy, pp. 59–68 (2001)

    Google Scholar 

  49. Guttman, R., Moukas, A., Maes, P.: Agent-mediated electronic commerce: A survey. Knowledge Engineering Review 13(2), 147–159 (1998)

    Article  Google Scholar 

  50. Bayardo, R.J., Bohrer, W., Brice, R., Cichocki, A., Fowler, J., Helal, A., Kashyap, V., Ksiezyk, T., Martin, G., Nodine, M., Rashid, M., Rusinkiewicz, M., Shea, R., Unnikrishnan, C., Unruh, A., WoelkEdgar, D.: Infosleuth: agent-based semantic integration of information in open and dynamic environments. In: Huhns, M.N., Singh, M.P. (eds.) Reading in Agents, pp. 205–216. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

  51. Bergamaschi, Cabri, G., Guerra, F., Leonardi, L., Vincini, M., Zambonelli, F.: Mobile Agents for Information Integration (2001), http://dbgroup.unimo.it/Miks/publications/papers/cia2001.pdf

  52. Green, S., Hurst, L., Nangle, B., Cunningham, P., Somers, F., Evans, R.: Software Agents: A Review. Intelligent Agents Group (IAG) report TCD-CS-1997-06, Trinity College Dublin (May 1997)

    Google Scholar 

  53. Sivasubramanian, S., Szymaniak, M., Pierre, G., van Steen, M.: Web Replica Hosting Systems Design. Internal Report IR-CS-001, June 14 (2004), http://www.cs.vu.nl/pub/papers/globe/IR-CS-001.03.pdf

  54. Rotaru, Nägeli, H.: Dynamic load balancing by diffusion in heterogeneous systems. Journal of Parallel and Distributed Computing 64(4), 481–497 (2004)

    Article  MATH  Google Scholar 

  55. Cardellini, Colajanni, M., Yu, P.S.: Dynamic Load Balancing on Web-Server Systems. IEEE Internet Computing 3(3), 28–39 (1999)

    Article  Google Scholar 

  56. Cardellini, V., Colajanni, M., Yu, P.S.: Request Redirection Algorithms for Distributed Web Systems. IEEE Transactions on Parallel and Distributed Systems 14(4), 355–368 (2003)

    Article  Google Scholar 

  57. Ghini, Panzieri, F., Roccetti, M.: Client-centered Load Distribution: A Mechanism for Constructing Responsive Web Services. In: Proceedings of the 34th Hawaii International Conference on System Sciences (2001)

    Google Scholar 

  58. Robles, V., Menasalvas, E., Millán, S., Pérez, M., Hochsztain, E., Marbán, O., Peña, J., Tasistro, A.: Beyond user clicks: an algorithm and an agent-based architecture to discover user behaviour. In: Proceedings of the ECML/PKDD, Cavtat, Dubrovnik, Croatia, September 22-26 (2003)

    Google Scholar 

  59. Jirapanthong, Sunetnanta, T.T.: An XML-Based Multi-Agents Model for Information Retrieval on WWW. In: Proceedings of the 4th National Computer Science and Engineering Conference (NCSEC 2000), November 16-17, Queen Sirikit National Convention Center, Bangkok (2000)

    Google Scholar 

  60. Li, W., Hsiung, W., Kalashnikov, D.V., Sion, R., Po, O., Agrawal, D., Candan, K.S.: Issues and Evaluations of Caching Solutions for Web Application Acceleration. In: Proceedings of the 28th Very Large Data Bases Conference, Hong Kong, China (August 2002)

    Google Scholar 

  61. Zhu, Gauch, S., Gerhard, L., Kral, N., Pretschner, A.: Ontology-Based Web Site Mapping for Information Exploration. In: Proc. 8th Intl. Conf. on Information and Knowledge Management (CIKM 1999), Kansas City, MO, November 1999, pp. 188–194 (1999)

    Google Scholar 

  62. Chen, Qiu, L., Chen, W., Nguyen, L., Katz, R.H.: Efficient and adaptive web replication using content clustering. IEEE J. Sel. Areas Commun. 21(6), 979–994 (2003)

    Article  Google Scholar 

  63. Kotidis, Y., Roussopoulos, N.: DynaMat: a dynamic view management system for data warehouses. ACM SIGMOD Record 28(2), 371–382 (1999)

    Article  Google Scholar 

  64. Xirouhakis, Y., Votsis, G., Karpouzis, K., Kollias, S.: Efficient Browsing in Multimedia Databases using Intelligent Agents and Content-Based Retrieval Schemes. In: IEEE International Workshop on Multimedia Signal Processing (MMSP 1998), Los Angeles, California, USA (1998)

    Google Scholar 

  65. Zhang, Y., Krishnamurthy, B., Wills, C.: On the Use and Performance of Content Distribution Networks. In: ACM SIGCOMM Internet Measurement Workshop (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ammar, A.B., Abdellatif, A., Ghezala, H.B. (2005). Roles of Agents in Data-Intensive Web Sites. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2005. Lecture Notes in Computer Science(), vol 3683. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11553939_6

Download citation

  • DOI: https://doi.org/10.1007/11553939_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28896-1

  • Online ISBN: 978-3-540-31990-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics