Skip to main content
Log in

A Two-level distributed architecture for the support of content adaptation and delivery services

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

The growing demand for Web and multimedia content accessed through heterogeneous devices requires the providers to tailor resources to the device capabilities on-the-fly. Providing services for content adaptation and delivery opens two novel challenges to the present and future content provider architectures: content adaptation services are computationally expensive; the global storage requirements increase because multiple versions of the same resource may be generated for different client devices. We propose a novel two-level distributed architecture for the support of efficient content adaptation and delivery services. The nodes of the architecture are organized in two levels: thin edge nodes on the first level act as simple request gateways towards the nodes of the second level; fat interior clusters perform all the other tasks, such as content adaptation, caching and fetching. Several experimental results show that the Two-level architecture achieves better performance and scalability than that of existing flat or no cooperative architectures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ahmad, I., Wei, X., Sun, Y., Zhang, Y.Q.: Video transcoding: an overview of various techniques and research issues. IEEE Trans. Multimed. 7(5), 793–804 (2005)

    Article  Google Scholar 

  2. Bhuyan, L.N., Guo, J.: Load balancing in a cluster-based web server for multimedia applications. IEEE Trans. Parallel Distrib. Syst. 17(11), 1321–1334 (2006)

    Article  Google Scholar 

  3. Bunt, R.B., Eager, D.L., Oster, G.M., Williamson, C.L.: Achieving load balance and effective caching in clustered Web servers. In: Proceedings of the 4th International Web Caching Workshop, San Diego, CA, 1999

  4. Butler, M., Giannetti, F., Gimson, R., Wiley, T.: Device independence and the Web. IEEE Internet Comput. 6(5), 81–86 (2002)

    Article  Google Scholar 

  5. Canali, C., Cardellini, V., Lancellotti, R.: Content adaptation architectures based on squid proxy server. World Wide Web J. 9(1), 63–92 (2006)

    Article  Google Scholar 

  6. Chandra, S.: Content adaptation and transcoding. In: Singh, M.P. (ed.) Practical Handbook of Internet Computing. Chapman Hall & CRC Press, London, Boca Raton (2004)

    Google Scholar 

  7. Chang, C.Y., Chen, M.S.: On exploring aggregate effect for efficient cache replacement in transcoding proxies. IEEE Trans. Parallel Distrib. Syst. 14(6), 611–624 (2003)

    Article  Google Scholar 

  8. Chang, S.F., Vetro, A.: Video adaptation: concepts, technologies, and open issues. Proc. IEEE 93(1), 148–158 (2005)

    Article  Google Scholar 

  9. Chen, J., Zhou, B., Shi, J., Zhang, H., Fengwu, Q.: Function-based object model towards Website adaptation. In: Proceeding of the 10th World Wide Web Conference (WWW’01), Hong Kong, 2001

  10. Chen, Y., Xie, X., Ma, W.Y., Zhang, H.J.: Adapting Web pages for small-screen devices. IEEE Internet Comput. 9(1), 50–56 (2005)

    Article  Google Scholar 

  11. Chen, Y.F., Huang, H., Jana, R., Jim, T., Hiltunen, M., John, S., Jora, S., Muthumanickam, R., Wei, B.: Imobile ee: an enterprise mobile service platform. ACM J. Wirel. Netw. 9(4), 283–297 (2003)

    Article  Google Scholar 

  12. Crovella, M.: Performance evaluation with heavy tailed distributions. In: Proceedings of the 7th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP’01), 2001

  13. Davis, A., Parikh, J., Weihl, W.E.: EdgeComputing: extending enterprise applications to the edge of the Internet. In: WWW Alt. ’04: Proceedings of the 13th international World Wide Web Conference on Alternate Track Papers & Posters, pp. 180–187, 2004

  14. Dykes, S., Robbins, K.: A viability analysis of cooperative proxy caching. In: Proc. of IEEE Infocom 2001, Anchorage, AK, 2001

  15. Edge Side Includes. http://www.esi.org (2002)

  16. Fan, L., Cao, P., Almeida, J., Broder, A.Z.: Summary cache: a scalable wide-area Web cache sharing protocol. IEEE/ACM Trans. Netw. 8(3), 281–293 (2000)

    Article  Google Scholar 

  17. Fox, A., Gribble, S.D., Chawathe, Y., Brewer, E.A., Gauthier, P.: Cluster-based scalable network services. In: Proc. of 16th ACM SOSP, pp. 78–91, 1997

  18. Gadde, S., Chase, J., Rabinovich, M.: A taste of crispy squid. In: Proc. of Workshop on Internet Server Performance, 1998

  19. Grieco, R., Malandrino, D., Scarano, V.: A scalable cluster-based infrastructure for edge-computing services. World Wide Web 9(3), 317–341 (2006)

    Article  Google Scholar 

  20. Gruhl, D., Guha, R., Liben-Nowell, D., Tomkins, A.: Information diffusion through blogspace. In: WWW ’04: Proceedings of the 13th International Conference on World Wide Web, 2004

  21. Guo, L., Chen, S., Xiao, Z., Zhang, X.: Analysis of multimedia workloads with implications for Internet streaming. In: WWW ’05: Proceedings of the 14th International Conference on World Wide Web, 2005

  22. He, J., Gao, T., Hao, W., Yen, I.L.: A flexible content adaptation system using a rule-based approach. IEEE Trans. Knowl. Data Eng. 19(1), 127–140 (2007). Member-Farokh Bastani

    Article  Google Scholar 

  23. Hwang, Y., Kim, J., Seo, E.: Structure-aware Web transcoding for mobile devices. IEEE Internet Comput. 7(5), 14–21 (2003)

    Article  Google Scholar 

  24. Ihde, S., Maglio, P.P., Meyer, J., Barrett, R.: Intermediary-based transcoding framework. IBM Syst. J. 40(1), 179–192 (2001)

    Article  Google Scholar 

  25. Lancellotti, R., Mazzoni, F., Colajanni, M.: Hybrid cooperative schemes for scalable and stable performance of Web content delivery. Comput. Netw. J. 49(4) (2005)

  26. Li, M., Claypool, M., Kinicki, R., Nichols, J.: Characteristics of streaming media stored on the Web. ACM Trans. Internet Technol. 5(4), 601–626 (2005)

    Article  Google Scholar 

  27. Lum, W.Y., Lau, F.C.: On balancing between transcoding overhead and spatial consumption in content adaptation. In: MobiCom ’02: Proceedings of the 8th annual International Conference on Mobile Computing and Networking, 2002

  28. Maglio, P., Barrett, R.: Intermediaries personalize information streams. Commun. ACM 43(8) (2000)

  29. MagnaTune: Magnatune—music downloads and licensing. http://www.magnatune.com/ (2007)

  30. Marriott, K., Meyer, B., Tardif, L.: Fast and efficient client-side adaptivity for SVG. In: WWW ’02: Proceedings of the 11th International Conference on World Wide Web, pp. 496–507, 2002

  31. MediaLab: Web content adaptation. Tech. rep., TeliaSonera (2004)

  32. Oracle Application Server Wireless. http://www.oracle.com/technology/tech/wireless/ (2008)

  33. Parker, C., Pfeiffer, S.: Video blogging: content to the max. IEEE MultiMed. 12(2), 4–8 (2005)

    Article  Google Scholar 

  34. Pashtan, A., Kollipara, S., Pearce, M.: Adapting content for wireless Web services. IEEE Internet Comput. 7(5), 79–85 (2003)

    Article  Google Scholar 

  35. Rabinovich, M., Spatscheck, O.: Web Caching and Replication. Addison-Wesley, Reading (2002)

    Google Scholar 

  36. Rabinovich, M., Xiao, Z., Aggarwal, A.: Computing on the edge: A platform for replicating Internet applications. In: Proc. of 8th Int’l Workshop on Web Content and Distribution, Hawthorne, NY, 2003

  37. Rabinovich, M., Xiao, Z., Douglis, F., Kamanek, C.: Moving edge side includes to the real edge—the clients. In: Proc. of USITS’03, 4th USENIX Symp. on Internet Technology and Systems, Seattle, WA, 2003

  38. Ross, K.: Hash-routing for collections of shared Web caches. IEEE Netw. 11(6), 37–44 (1997)

    Article  Google Scholar 

  39. Shen, B., Lee, S.J., Basu, S.: Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks. IEEE Trans. Multimed. 6(2), 375–386 (2004)

    Article  Google Scholar 

  40. Singh, A., Trivedi, A., Ramamritham, K., Shenoy, P.: PTC: Proxies that transcode and cache in heterogeneous Web client environments. World Wide Web 7(1), 7–28 (2004)

    Article  Google Scholar 

  41. Singh, G.: Guest editor’s introduction: content repurposing. IEEE Multimed. 11(1), 20–21 (2004)

    Article  Google Scholar 

  42. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proc. of the 2001 ACM SIGCOMM Conference, 2001

  43. Wang, B., Kurose, J., Shenoy, P., Towsley, D.: Multimedia streaming via TCP: An analytic performance study. In: MULTIMEDIA ’04: Proceedings of the 12th Annual ACM International Conference on Multimedia, 2004

  44. IBM WebSphere Transcoding Publisher. http://www.ibm.com/software/pervasive/transcoding_publisher/ (2008)

  45. Wessels, D., Claffy, K.: Internet Cache Protocol (ICP), version 2. RFC 2186 (1997)

  46. Williams, A., Arlitt, M., Williamson, C., Barker, K.: Web workload characterization: ten years later. In: Tang, X., Xu, J., Chanson, S.T. (eds.) Web Content Delivery. Springer, Berlin (2005)

    Google Scholar 

  47. YouTube: Youtube—broadcast yourself. http://www.youtube.com/ (2007)

  48. Zhang, R., Hu, C., Lin, X., Fahmy, S.: A hierarchical approach to Internet distance prediction. In: Proc. of the 26th IEEE Int’l Conf. on Distributed Computing Systems (ICDCS’06), Washington, DC, USA, 2006

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michele Colajanni.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Canali, C., Colajanni, M. & Lancellotti, R. A Two-level distributed architecture for the support of content adaptation and delivery services. Cluster Comput 13, 1–17 (2010). https://doi.org/10.1007/s10586-009-0094-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-009-0094-y

Keywords

Navigation