Skip to main content
SpringerLink
Log in

A Scalable Cluster-based Infrastructure for Edge-computing Services

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

In this paper we present a scalable and dynamic intermediary infrastructure, SEcS (acronym of “Scalable Edge computing Services”), for developing and deploying advanced Edge computing services, by using a cluster of heterogeneous machines. Our goal is to address the challenges of the next-generation Internet services: scalability, high availability, fault-tolerance and robustness, as well as programmability and quick prototyping. The system is written in Java and is based on IBM's Web Based Intermediaries (WBI) [71] developed at IBM Almaden Research Center.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Akamai, Inc. http://www.akamai.com

  2. Almeida, V., Bestavros, A., Crovella, M., de Oliveira, A.: Characterizing Reference Locality in the WWW. In: Proceedings of the International Conference on Parallel and Distributed Information Systems (PDIS'96)., pp. 92–103. (December 1996)

  3. Anderson, C., Domingos, P., Weld, D.: Personalizing Web Sites for Mobile Users. In: Proceedings of the \(10^{th}\) International World Wide Web Conference. ACM, Hong Kong, (2001)

  4. Andreolini, M., Cardellini, V., Colajanni, M.: Benchmarking models and tools for distributed web-server systems. In: Performance Evaluation of Complex Systems: Techniques and Tools, Performance 2002, Tutorial Lectures, pp. 208–235. Springer, Berlin Heidelberg New York (2002)

  5. Ardon, S., Gunningberg, P., LandFeldt, B., Ismailov, Y., Portmann, M., Seneviratne, A.: Mobile Aware Server Architecture: A distributed proxy architecture for content adaptation. In: INET 2001 Proceedings. ISOC (June 2001)

  6. Ardon, S., Gunningberg, P., LandFeldt, B., Ismailov, M.P.Y., Seneviratne, A.: MARCH: a distributed content adaptation architecture. International Journal of Communication Systems, Special Issue: Wireless Access to the Global Internet: Mobile Radio Networks and Satellite Systems. 16(1), (2003)

  7. Arlitt, M.: A performance study of Web servers. Master's thesis, University of Saskatchevan (1996)

  8. Arlitt, M.F., Williamson, C.L.: Internet Web servers: workload characterization and performance implications. IEEE/ACM Trans. Netw. 5(5), 631–645 (1997)

    Article  Google Scholar 

  9. Arlitt, M., Friedrich, R., Jin, T.: Workload characterization of a Web proxy in a cable modem environment. SIGMETRICS Perform. Eval. Rev. 27(2), 25–36 (1999)

    Google Scholar 

  10. AT&T Labs-Research. iProxy: a Programmable Proxy. http://www.research.att.com/sw/tools/iproxy/

  11. Balachander, K., Rexford, J.: Web Protocol and Practice. HTTP/1.1, Networking Protocol, Caching, and Traffic Measurements (July 2001)

  12. Barbir, A., Chen, R., Hofmann, M., Orman, H., Penno, R.: An Architecture for Open Pluggable Edge services (OPES). http://www.ietf.org/internet-drafts/draft-ietf-opes-architecture-04.txt (June 11 2003)

  13. Barbir, A., Burger, E., Chen, R., McHenry, S., Orman, H., Penno, R.: Open Pluggable Edge services (OPES) Use Cases and Deployment Scenarios (April 2004). http://www.ietf.org/rfc/rfc3752.txt

  14. Barford, P., Crovella, M.: Generating representative Web workloads for network and server performance evaluation. In: Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, pp. 151–160. ACM (1998)

  15. Barra, M., Negro, A., Scarano, V.: Distributed Systems for Group Adaptivity on the Web. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH 2000). ACM (August 2000)

  16. Barra, M., Maglio, P., Negro, A., Scarano, V.: GAS: Group Adaptive System. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH 2002). ACM (May 2002)

  17. Barra, M., Grieco, R., Malandrino, D., Negro, A., Scarano, V.: TextToSpeech: a heavy-weight Edge computing Service. In: Poster Proc. of \(12^{th}\) International World Wide Web Conference. ACM (May 2003)

  18. Barrett, R., Maglio, P.P.: Adaptive Communities and Web Places. In: Proceedings of \(2^{th}\) Workshop on Adaptive Hypertext and Hypermedia, HYPERTEXT 98. ACM, Pittsburgh (USA) (1998a)

  19. Barrett, R., Maglio, P.P.: Intermediaries: new places for producing and manipulating web content. Comput. Netw. ISDN Syst. 30(4), 509–518 (1998b)

    Article  Google Scholar 

  20. Barrett, R., Maglio P.P.: Intermediaries: an approach to manipulating information streams. IBM Syst. J. 38(4), 629–641 (1999a)

    Article  Google Scholar 

  21. Barrett, R., Maglio, P.P.: WebPlaces: Adding people to the Web. In: Proceedings of \(8^{th}\) International World Wide Web Conference. ACM, Toronto (Canada) (1999b)

  22. Beck, A.: IRML: A Rule Specification Language for Intermediary Services. Internet Draft

  23. Beck, A., Hofmann, M., Orman, H., Penno, R., Terzis, A.: Requirements for OPES Callout Protocols An Architecture for Open Pluggable Edge Services (OPES). (August 2nd 2002). http://www.faqs.org/ftp/internet-drafts/draft-ietf-opes-protocol-reqs-02.txt

  24. Breslau, L., Cao, P., Fan, L., Phillips, G., Shenker, S.: Web caching and Zipf-like Distributions: Evidence and Implications. In: Proceedings of IEEE Infocom Conference, pp. 126–134. IEEE Computer Society (March 1999)

  25. Brewer, E., Katz, R., Amir, E., Balakrishnan, H., Chawathe, Y., Fox, A., Gribble, S., Hode, T., Nguyen, G., Padmanabhan, V., Stemm, M., Seshan, S., Henderson, T.: A Network Architecture for Heterogeneous Mobile Computing. In IEEE Personal Communication Magazine 5(5), 8–24 (October 1998)

    Article  Google Scholar 

  26. Brisco, T.: Dns Support for Load Balancing. Technical report, Network Working Group, (April 1995). Technical Report RFC 1794

  27. Busari, M.: ProWGen. Technical report, University of Saskatchewan (2000)

  28. Calabrò, M.G., Malandrino, D., Scarano, V.: Group Recording of Web Navigation. In: Proceedings of the HYPERTEXT'03. ACM (August 2003)

  29. Canali, C., Cardellini, V., Colajanni, M., Lancellotti, R., Yu, P.: Cooperative Architectures and Algorithms for Discovery and Transcoding of Multi-version Content. In: Proceedings of the 8\(^{th}\) Web Caching Workshop (WCW 2003) (September 2003)

  30. CAST: eReader. http://www.cast.org/tools/teachingtoolsreader.html

  31. Cisco systems: localdirector. http://www.cisco.com/warp/public/751/lodir/index.html

  32. Cooper, I., Melve, I., Tomlinson, G.: Internet Web Replication and Caching Taxonomy (January 2001). RFC 3040

  33. Crovella, A.B.M.: Self-similarity in World Wide Web Traffic: Evidence and Possible Cause. In: Proceedings of the DSIGMETRICS Conference on Measurements and Modeling of Computer Systems (May 1996)

  34. Crovella, M., Lipsky, L.: Long-Lasting Transient Conditions in Simulations with Heavy-tailed Workloads. In: Proceedings of the 1997 Winter Simulation Conference (1997)

  35. Dahlin, M.: Interpreting Stale Load Information. In: Proceedings of the 19th IEEE International Conference on Distributed Computing Systems, pp. 285. IEEE Computer Society (1999)

  36. Dikaiakos, M.: Intermediary infrastructures for the world-wide web. Comput. Netw. ISDN Syst. 45(4), 421–447 (July 2004)

    Google Scholar 

  37. Dikaiakos, M., Zeinalipour-Yiazti, D.: A distributed middleware infrastructure for personalized services. Technical Report TR-2001-4, University of Cyprus (December 2001a)

  38. Dikaiakos, M., Zeinalipour-Yiazti, D.: WebRACE: A Distributed WWW Retrieval, Annotation, and Caching Engine. In: Proceedings of PADDA01: International Workshop on Performance-oriented Application Development for Distributed Architectures (April 2001b)

  39. Eslon J., et al.: Internet Content Adaptation Protocol (ICAP). (April 2003). RFC 3507. http://www.ietf.org/rfc/rfc3507.txt

  40. Fielding, R., Gettys, J., Mogul, J., Nielsen, H.F., Berners-Lee, T.: HTTP version 1.1, (January 1997). RFC 2616

  41. Fox, A., Brewer, E.A.: Reducing WWW latency and bandwidth requirements by real-time distillation. In: Proceedings of the 5\(^{th}\) International World-Wide Web Conference. ACM (May 1996)

  42. Fox, A., Gribble, S., Brewer, E.A., Amir, E.: Adapting to Network and Client Variability via On-demand Dynamic Distillation. In: the 7\(^{th}\) International Conference On Arch. Support for Prog. Lang. And Operating Systems. (ASPLOS-VII). ACM (October 1996)

  43. Fox, A., Gribble, S., Chawathe, Y., Brewer, E.A., Gauthier P.: Cluster-based scalable network services. In: Proceedings of the sixteenth ACM symposium on Operating systems principles, pp. 78–91. ACM (1997)

  44. Fox, A., Chawathe, Y., Brewer, E.A.: Adapting to network and client variation using active proxies: lessons and perspectives. IEEE Pers. Commun. 5(4), 10–19 (1998)

    Article  Google Scholar 

  45. Franks, J., Hallam-Baker, P., Hostetler, J., Lawrence, S., Peach, P., Luotonen, A., Stewart, L.: HTTP Authentication: Basic and Digest Access Authentication, (June 1999). RFC 2617

  46. Fry, M., Ghosh, A.: Application level active networking. Comput. Networks 31(7), 655–667 (1999)

    Article  Google Scholar 

  47. Gribble, S.D., Welsh, M., von Behren, R., Brewer, E.A., Culler, D., Borisov, N., Czerwinski, S., Gummadi, R., Hill, J., Joseph, R.H.K.A.: The Ninja architecture for robust internet-scale systems and services. Comput. Networks 35(4), 473–497 (March 2001). http://ninja.cs.berkeley.edu/

    Article  Google Scholar 

  48. Hori, M., Kondoh, G., Ono, K., Hirose, S., Singhal, S.: Annotation-Based Web Content Transcoding. In: Proceedings of the \(9^{th}\) International World Wide Web Conference. ACM, Amsterdam (The Netherlands) (2000)

  49. IBM.: Home Page Reader. http://www.austin.ibm.com/sns/hpr.html

  50. IBM Websphere Transcoding Publisher.: http://www-3.ibm.com/software/webservers/transcoding

  51. ImageMagick 5.5.7 (2003). http://www.imagemagick.org

  52. JavaSoft.: The Java Remote Method Invocation (RMI) specification. Technical report, Sun Microsystems Incorporated (2001). http://java.sun.com/j2se/1.4/docs/guide/rmi/spec/

  53. JMagick 5.5.6-0 (2003). http://www.yeo.id.au/jmagick/

  54. KaRMI. Efficient RMI for Java. http://www.ipd.uka.de/JavaParty/KaRMI

  55. Katz, R.H., Brewer, E.A., Amir, E., Balakrishnan, H., Fox, A., Gribble, S., Hodes, T., Jiang, D., Nguyen, G.T., Padmanabhan, V., Stemm, M.: The bay area research wireless access network (BARWAN). In: Proceedings of the 41st IEEE International Computer Conference, pp. 15. IEEE Computer Society (1996)

  56. Luotonen, A., Altis, K.: World-wide web proxies. Comput. Netw. ISDN Syst. 27(2), 147–154 (1994)

    Article  Google Scholar 

  57. MacLarty, G., Fry, M.: Policy-based content delivery: an active network approach. Comput. Commun. 24(2), 241–248 (2001)

    Article  Google Scholar 

  58. Mahanti, A., Williamson, C., Eager, D.: Web Proxy Workload Characterization. Technical report, Department of Computer Science, University of Saskatchewan (February 1999)

  59. Mahanti, A., Williamson, C., Eager, D.: Characterization of a web caching hierarchy. In: Mobile Networks and Applications (2000)

  60. Mitzenmacher, M.: How useful is old information? In: Proceedings of the sixteenth annual ACM symposium on Principles of distributed computing, pp. 83–91. ACM (1997)

  61. Mitzenmacher, M.: How useful is old information? IEEE Trans. Parallel Distrib. Syst. 11(1), 6–20 (2000)

    Article  MathSciNet  Google Scholar 

  62. Mosberger, D., Jin, T.: httperf, A Tool for Measuring Web Server Performance

  63. Netscape.: Navigator Proxy Auto-Configuration File Format, (March 1996). http://www.netscape. com/eng/mozilla/2.0/relnotes/demo/proxy-live.html

  64. Open Pluggable Edge services (OPES) Working Group. http://standards.nortelnetworks.com/opes/index.htm

  65. Pitkow, J.E., Crovella, M.E.: Summary of WWW characterization. In: Proceedings of International World Wide Web Conference. ACM (1999)

  66. RabbIT proxy. http://rabbit-proxy.sourceforge.net/

  67. Rao, C., Chen, Y., Chang, D.-F., Chen, M.-F.: imobile: A proxy-based platform for mobile services. In: Proceedings of the First ACM Workshop on Wireless Mobile Internet (WMI 2001). ACM (2001)

  68. Stardust.com. Content Networking and Edge Services: Leveraging the internet for profit (September 2001). http://www.speakerforums.com/Uploads/Stardust/pdfs/CDN\_whitepaper.PDF

  69. SuperProxy Script. http://naragw.sharp.co.jp/sps

  70. Tanenbaum, A.S.: Modern operating systems (1992)

  71. Web Based Intermediaries (WBI). http://www.almaden.ibm.com/cs/wbi/

  72. Web Content Accessibility Guidelines 1.0, W3C Recommendation (May 1999). http://www.w3.org/TR/WCAG10/

  73. Weinreich, H., Lamersdorf, W.: Concepts for improved visualization of Web link attributes. In: Proceedings of the \(9^{th}\) International World Wide Web Conference. ACM, Amsterdam (The Netherlands), (2000)

  74. Zipf, G.K.: Human Behaviour and the Principle of Least Effort. Addison Wesley (1999)

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Informatica ed Applicazioni “R.M. Capocelli”, Università di Salerno, via Ponte don Melillo, 84084, Fisciano, SA, Italy

    Raffaella Grieco, Delfina Malandrino & Vittorio Scarano

Authors
  1. Raffaella Grieco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Delfina Malandrino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vittorio Scarano
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vittorio Scarano.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grieco, R., Malandrino, D. & Scarano, V. A Scalable Cluster-based Infrastructure for Edge-computing Services. World Wide Web 9, 317–341 (2006). https://doi.org/10.1007/s11280-006-8559-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-006-8559-x

Keywords

Search

Navigation