Abstract
In this paper we present a scalable and dynamic intermediary infrastructure, SEcS (acronym of “Scalable Edge computing Services”), for developing and deploying advanced Edge computing services, by using a cluster of heterogeneous machines. Our goal is to address the challenges of the next-generation Internet services: scalability, high availability, fault-tolerance and robustness, as well as programmability and quick prototyping. The system is written in Java and is based on IBM's Web Based Intermediaries (WBI) [71] developed at IBM Almaden Research Center.
Similar content being viewed by others
References
Akamai, Inc. http://www.akamai.com
Almeida, V., Bestavros, A., Crovella, M., de Oliveira, A.: Characterizing Reference Locality in the WWW. In: Proceedings of the International Conference on Parallel and Distributed Information Systems (PDIS'96)., pp. 92–103. (December 1996)
Anderson, C., Domingos, P., Weld, D.: Personalizing Web Sites for Mobile Users. In: Proceedings of the \(10^{th}\) International World Wide Web Conference. ACM, Hong Kong, (2001)
Andreolini, M., Cardellini, V., Colajanni, M.: Benchmarking models and tools for distributed web-server systems. In: Performance Evaluation of Complex Systems: Techniques and Tools, Performance 2002, Tutorial Lectures, pp. 208–235. Springer, Berlin Heidelberg New York (2002)
Ardon, S., Gunningberg, P., LandFeldt, B., Ismailov, Y., Portmann, M., Seneviratne, A.: Mobile Aware Server Architecture: A distributed proxy architecture for content adaptation. In: INET 2001 Proceedings. ISOC (June 2001)
Ardon, S., Gunningberg, P., LandFeldt, B., Ismailov, M.P.Y., Seneviratne, A.: MARCH: a distributed content adaptation architecture. International Journal of Communication Systems, Special Issue: Wireless Access to the Global Internet: Mobile Radio Networks and Satellite Systems. 16(1), (2003)
Arlitt, M.: A performance study of Web servers. Master's thesis, University of Saskatchevan (1996)
Arlitt, M.F., Williamson, C.L.: Internet Web servers: workload characterization and performance implications. IEEE/ACM Trans. Netw. 5(5), 631–645 (1997)
Arlitt, M., Friedrich, R., Jin, T.: Workload characterization of a Web proxy in a cable modem environment. SIGMETRICS Perform. Eval. Rev. 27(2), 25–36 (1999)
AT&T Labs-Research. iProxy: a Programmable Proxy. http://www.research.att.com/sw/tools/iproxy/
Balachander, K., Rexford, J.: Web Protocol and Practice. HTTP/1.1, Networking Protocol, Caching, and Traffic Measurements (July 2001)
Barbir, A., Chen, R., Hofmann, M., Orman, H., Penno, R.: An Architecture for Open Pluggable Edge services (OPES). http://www.ietf.org/internet-drafts/draft-ietf-opes-architecture-04.txt (June 11 2003)
Barbir, A., Burger, E., Chen, R., McHenry, S., Orman, H., Penno, R.: Open Pluggable Edge services (OPES) Use Cases and Deployment Scenarios (April 2004). http://www.ietf.org/rfc/rfc3752.txt
Barford, P., Crovella, M.: Generating representative Web workloads for network and server performance evaluation. In: Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, pp. 151–160. ACM (1998)
Barra, M., Negro, A., Scarano, V.: Distributed Systems for Group Adaptivity on the Web. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH 2000). ACM (August 2000)
Barra, M., Maglio, P., Negro, A., Scarano, V.: GAS: Group Adaptive System. In: Proceedings of International Conference on Adaptive Hypermedia and Adaptive Web-based Systems (AH 2002). ACM (May 2002)
Barra, M., Grieco, R., Malandrino, D., Negro, A., Scarano, V.: TextToSpeech: a heavy-weight Edge computing Service. In: Poster Proc. of \(12^{th}\) International World Wide Web Conference. ACM (May 2003)
Barrett, R., Maglio, P.P.: Adaptive Communities and Web Places. In: Proceedings of \(2^{th}\) Workshop on Adaptive Hypertext and Hypermedia, HYPERTEXT 98. ACM, Pittsburgh (USA) (1998a)
Barrett, R., Maglio, P.P.: Intermediaries: new places for producing and manipulating web content. Comput. Netw. ISDN Syst. 30(4), 509–518 (1998b)
Barrett, R., Maglio P.P.: Intermediaries: an approach to manipulating information streams. IBM Syst. J. 38(4), 629–641 (1999a)
Barrett, R., Maglio, P.P.: WebPlaces: Adding people to the Web. In: Proceedings of \(8^{th}\) International World Wide Web Conference. ACM, Toronto (Canada) (1999b)
Beck, A.: IRML: A Rule Specification Language for Intermediary Services. Internet Draft
Beck, A., Hofmann, M., Orman, H., Penno, R., Terzis, A.: Requirements for OPES Callout Protocols An Architecture for Open Pluggable Edge Services (OPES). (August 2nd 2002). http://www.faqs.org/ftp/internet-drafts/draft-ietf-opes-protocol-reqs-02.txt
Breslau, L., Cao, P., Fan, L., Phillips, G., Shenker, S.: Web caching and Zipf-like Distributions: Evidence and Implications. In: Proceedings of IEEE Infocom Conference, pp. 126–134. IEEE Computer Society (March 1999)
Brewer, E., Katz, R., Amir, E., Balakrishnan, H., Chawathe, Y., Fox, A., Gribble, S., Hode, T., Nguyen, G., Padmanabhan, V., Stemm, M., Seshan, S., Henderson, T.: A Network Architecture for Heterogeneous Mobile Computing. In IEEE Personal Communication Magazine 5(5), 8–24 (October 1998)
Brisco, T.: Dns Support for Load Balancing. Technical report, Network Working Group, (April 1995). Technical Report RFC 1794
Busari, M.: ProWGen. Technical report, University of Saskatchewan (2000)
Calabrò, M.G., Malandrino, D., Scarano, V.: Group Recording of Web Navigation. In: Proceedings of the HYPERTEXT'03. ACM (August 2003)
Canali, C., Cardellini, V., Colajanni, M., Lancellotti, R., Yu, P.: Cooperative Architectures and Algorithms for Discovery and Transcoding of Multi-version Content. In: Proceedings of the 8\(^{th}\) Web Caching Workshop (WCW 2003) (September 2003)
CAST: eReader. http://www.cast.org/tools/teachingtoolsreader.html
Cisco systems: localdirector. http://www.cisco.com/warp/public/751/lodir/index.html
Cooper, I., Melve, I., Tomlinson, G.: Internet Web Replication and Caching Taxonomy (January 2001). RFC 3040
Crovella, A.B.M.: Self-similarity in World Wide Web Traffic: Evidence and Possible Cause. In: Proceedings of the DSIGMETRICS Conference on Measurements and Modeling of Computer Systems (May 1996)
Crovella, M., Lipsky, L.: Long-Lasting Transient Conditions in Simulations with Heavy-tailed Workloads. In: Proceedings of the 1997 Winter Simulation Conference (1997)
Dahlin, M.: Interpreting Stale Load Information. In: Proceedings of the 19th IEEE International Conference on Distributed Computing Systems, pp. 285. IEEE Computer Society (1999)
Dikaiakos, M.: Intermediary infrastructures for the world-wide web. Comput. Netw. ISDN Syst. 45(4), 421–447 (July 2004)
Dikaiakos, M., Zeinalipour-Yiazti, D.: A distributed middleware infrastructure for personalized services. Technical Report TR-2001-4, University of Cyprus (December 2001a)
Dikaiakos, M., Zeinalipour-Yiazti, D.: WebRACE: A Distributed WWW Retrieval, Annotation, and Caching Engine. In: Proceedings of PADDA01: International Workshop on Performance-oriented Application Development for Distributed Architectures (April 2001b)
Eslon J., et al.: Internet Content Adaptation Protocol (ICAP). (April 2003). RFC 3507. http://www.ietf.org/rfc/rfc3507.txt
Fielding, R., Gettys, J., Mogul, J., Nielsen, H.F., Berners-Lee, T.: HTTP version 1.1, (January 1997). RFC 2616
Fox, A., Brewer, E.A.: Reducing WWW latency and bandwidth requirements by real-time distillation. In: Proceedings of the 5\(^{th}\) International World-Wide Web Conference. ACM (May 1996)
Fox, A., Gribble, S., Brewer, E.A., Amir, E.: Adapting to Network and Client Variability via On-demand Dynamic Distillation. In: the 7\(^{th}\) International Conference On Arch. Support for Prog. Lang. And Operating Systems. (ASPLOS-VII). ACM (October 1996)
Fox, A., Gribble, S., Chawathe, Y., Brewer, E.A., Gauthier P.: Cluster-based scalable network services. In: Proceedings of the sixteenth ACM symposium on Operating systems principles, pp. 78–91. ACM (1997)
Fox, A., Chawathe, Y., Brewer, E.A.: Adapting to network and client variation using active proxies: lessons and perspectives. IEEE Pers. Commun. 5(4), 10–19 (1998)
Franks, J., Hallam-Baker, P., Hostetler, J., Lawrence, S., Peach, P., Luotonen, A., Stewart, L.: HTTP Authentication: Basic and Digest Access Authentication, (June 1999). RFC 2617
Fry, M., Ghosh, A.: Application level active networking. Comput. Networks 31(7), 655–667 (1999)
Gribble, S.D., Welsh, M., von Behren, R., Brewer, E.A., Culler, D., Borisov, N., Czerwinski, S., Gummadi, R., Hill, J., Joseph, R.H.K.A.: The Ninja architecture for robust internet-scale systems and services. Comput. Networks 35(4), 473–497 (March 2001). http://ninja.cs.berkeley.edu/
Hori, M., Kondoh, G., Ono, K., Hirose, S., Singhal, S.: Annotation-Based Web Content Transcoding. In: Proceedings of the \(9^{th}\) International World Wide Web Conference. ACM, Amsterdam (The Netherlands) (2000)
IBM.: Home Page Reader. http://www.austin.ibm.com/sns/hpr.html
IBM Websphere Transcoding Publisher.: http://www-3.ibm.com/software/webservers/transcoding
ImageMagick 5.5.7 (2003). http://www.imagemagick.org
JavaSoft.: The Java Remote Method Invocation (RMI) specification. Technical report, Sun Microsystems Incorporated (2001). http://java.sun.com/j2se/1.4/docs/guide/rmi/spec/
JMagick 5.5.6-0 (2003). http://www.yeo.id.au/jmagick/
KaRMI. Efficient RMI for Java. http://www.ipd.uka.de/JavaParty/KaRMI
Katz, R.H., Brewer, E.A., Amir, E., Balakrishnan, H., Fox, A., Gribble, S., Hodes, T., Jiang, D., Nguyen, G.T., Padmanabhan, V., Stemm, M.: The bay area research wireless access network (BARWAN). In: Proceedings of the 41st IEEE International Computer Conference, pp. 15. IEEE Computer Society (1996)
Luotonen, A., Altis, K.: World-wide web proxies. Comput. Netw. ISDN Syst. 27(2), 147–154 (1994)
MacLarty, G., Fry, M.: Policy-based content delivery: an active network approach. Comput. Commun. 24(2), 241–248 (2001)
Mahanti, A., Williamson, C., Eager, D.: Web Proxy Workload Characterization. Technical report, Department of Computer Science, University of Saskatchewan (February 1999)
Mahanti, A., Williamson, C., Eager, D.: Characterization of a web caching hierarchy. In: Mobile Networks and Applications (2000)
Mitzenmacher, M.: How useful is old information? In: Proceedings of the sixteenth annual ACM symposium on Principles of distributed computing, pp. 83–91. ACM (1997)
Mitzenmacher, M.: How useful is old information? IEEE Trans. Parallel Distrib. Syst. 11(1), 6–20 (2000)
Mosberger, D., Jin, T.: httperf, A Tool for Measuring Web Server Performance
Netscape.: Navigator Proxy Auto-Configuration File Format, (March 1996). http://www.netscape. com/eng/mozilla/2.0/relnotes/demo/proxy-live.html
Open Pluggable Edge services (OPES) Working Group. http://standards.nortelnetworks.com/opes/index.htm
Pitkow, J.E., Crovella, M.E.: Summary of WWW characterization. In: Proceedings of International World Wide Web Conference. ACM (1999)
RabbIT proxy. http://rabbit-proxy.sourceforge.net/
Rao, C., Chen, Y., Chang, D.-F., Chen, M.-F.: imobile: A proxy-based platform for mobile services. In: Proceedings of the First ACM Workshop on Wireless Mobile Internet (WMI 2001). ACM (2001)
Stardust.com. Content Networking and Edge Services: Leveraging the internet for profit (September 2001). http://www.speakerforums.com/Uploads/Stardust/pdfs/CDN\_whitepaper.PDF
SuperProxy Script. http://naragw.sharp.co.jp/sps
Tanenbaum, A.S.: Modern operating systems (1992)
Web Based Intermediaries (WBI). http://www.almaden.ibm.com/cs/wbi/
Web Content Accessibility Guidelines 1.0, W3C Recommendation (May 1999). http://www.w3.org/TR/WCAG10/
Weinreich, H., Lamersdorf, W.: Concepts for improved visualization of Web link attributes. In: Proceedings of the \(9^{th}\) International World Wide Web Conference. ACM, Amsterdam (The Netherlands), (2000)
Zipf, G.K.: Human Behaviour and the Principle of Least Effort. Addison Wesley (1999)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Grieco, R., Malandrino, D. & Scarano, V. A Scalable Cluster-based Infrastructure for Edge-computing Services. World Wide Web 9, 317–341 (2006). https://doi.org/10.1007/s11280-006-8559-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-006-8559-x