Skip to main content
SpringerLink
Log in

Video personalization in heterogeneous and resource-constrained environments

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Access to multimedia data and multimedia services is becoming increasingly common in networked mobile environments. In such environments, both the mobile client devices and multimedia servers are typically resource constrained. Moreover, the mobile client population is often heterogeneous in terms of the clients’ preferences with regard to multimedia content, the clients’ quality of service requirements and system-level resource constraints. In order to provide a resource-constrained mobile client with its desired video content, it is often necessary to personalize the requested multimedia content in a manner that satisfies simultaneously the various client-specified content preferences and the system-level resource constraints. Also, in order to simultaneously reduce the client-experienced latency, provide optimal quality of service to the clients and ensure efficient utilization of server and network resources, it is necessary to perform client request aggregation on the server end. To this end, a video personalization strategy is proposed to provide mobile, resource-constrained clients with personalized video content that is most relevant to the clients’ requests while satisfying simultaneously multiple client-side system-level resource constraints. A client request aggregation strategy is also proposed to cluster client requests with similar video content preferences and similar client-side resource constraints such that the number of requests the server needs to process and service, and the client-experienced latency are both reduced simultaneously. The primary contributions of the paper are: (1) the formulation and implementation of a Multiple-choice Multi-dimensional Knapsack Problem (MMKP)-based video personalization strategy; and (2) the design and implementation of a client request aggregation strategy based on a multi-stage clustering algorithm. Experimental results comparing the proposed MMKP-based video personalization strategy to existing 0/1 Knapsack Problem (0/1KP)-based and the Fractional Knapsack Problem (FKP)-based video personalization strategies are presented. It is observed that: (1) the proposed MMKP-based personalization strategy includes more relevant video content in response to the client’s request compared to the existing 0/1KP-based and FKP-based personalization strategies; and (2) in contrast to the 0/1KP-based and FKP-based personalization strategies which can satisfy only a single client-side resource constraint at a time, the proposed MMKP-based personalization strategy is capable of satisfying multiple client-side resource constraints simultaneously. Experimental results comparing the client-experienced latency with and without the proposed server-side client request aggregation strategy are also presented. It is shown that the proposed client request aggregation strategy reduces the mean client-experienced latency without significant reduction in the average relevance of the delivered video content and without significant deviation in the client-side resources actually consumed by the delivered video content from the client-specified resource constraints.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Mérialdo, B., Lee, K.T., Luparello, D., and Roudaire, J.: Automatic construction of personalized TV news programs. In: Proc. ACM Conf. Multimedia, pp. 323–331, Orlando, FL, September, (1999)

  2. Tseng, B.L., Smith, J.R.: Hierarchical video summarization based on context clustering. Proc. SPIE 5242, 14–25 (2003)

    Article  Google Scholar 

  3. Tseng, B.L., Lin, C.Y., Smith, J.R.: Video personalization and summarization system for usage environment. J. Vis. Commun. Image. Represent. 15, 370–392 (2004)

    Article  Google Scholar 

  4. Wei, Y., Bhandarkar, S.M., Li, K.: Client-centered multimedia content adaptation. In: ACM Trans. on Multimedia Computing, Communications and Applications (ACM TOMCCAP), 5(3):22:1–22:26, August (2009)

  5. Wei, Y., Bhandarkar, S.M., Li, K.: Semantics-based video indexing using a stochastic modeling approach. In: Proc. IEEE Intl. Conf. Image Processing (ICIP 2007), San Antonio, TX, Vol. IV, pp. 313–316, September (2007)

  6. Liu, L., Özsu, M.T. (eds): Encyclopedia of database systems. Springer (2009)

  7. Yahiaoui, I., Mérialdo, B., Huet, B.: Comparison of multi-episode video summarization algorithms. EURASIP J. Appl. Signal Process. Spec. Issue Multimed. Signal Process. 2003(1), 48–55 (2003)

    MATH  Google Scholar 

  8. Mérialdo, B., Huet, B.: Automatic video summarization. In: Hammoud, R.: (ed) Interactive Video, Algorithms and Technologies. pp. 27–41 (2006) ISBN: 3-540-33214-6

  9. Doulamis, N., Doulamis, A., Avrithis, Y., Ntalianis, K., Kollias, S.: Efficient summarization of stereoscopic video sequences. IEEE Trans. Circuits Syst. Video Technol. 10(4), 501–517 (2000)

    Article  Google Scholar 

  10. Kim, C., Hwang, J.: An integrated scheme for object-based video abstraction. In: Proc. ACM Conf. Multimedia, Los Angeles, CA, pp. 303–311 (2000)

  11. Bartoli, A., Dalal, N., Horaud, R.: Motion panoramas. Comput. Anim. Virtual Worlds 15, 501–517 (2004)

    Article  Google Scholar 

  12. Wei, Y., Wang, H., Bhandarkar, S.M., Li, K. Parallel algorithms for motion panorama construction. In: Proc. ICPP Workshop on Parallel and Distributed Multimedia, Columbus, Ohio, August (2006), pp. 82–92

  13. Jaimes, A., Chang, S.F.: A conceptual framework for indexing visual information at multiple levels. In: IS&T/SPIE Internet Imaging, Vol. 3964, San Jose, CA, pp. 2–15, January (2000)

  14. Khan, S., Li, K.F., Manning, E.G., Akbar, M.M.: Solving the Knapsack Problem for adaptive multimedia systems. Stud. Inform. Univers. 2(1), 61–82 (2002)

    Google Scholar 

  15. Akbar, M.D., Manning, E.G., Shoja, G.C., Khan, S. (2001) Heuristic solutions for the multiple-choice Multi-dimension Knapsack Problem. In: Proc. Intl. Conf. Computational Science, pp. 659–668

  16. Hernandez, R.P., Nikitas, N.J.: A new heuristic for solving the Multichoice Multidimensional Knapsack Problem. IEEE Trans. Syst. Man Cybernet. Part A 35(5), 708–717 (2005)

    Article  Google Scholar 

  17. Bommaiah, E., Guo, K., Hofmann, M., Paul, S.: Design and implementation of a caching system for streaming media over the internet. In: IEEE Real Time Technology and Applications Symposium (RATS, 2000), pp. 111–121 (2000)

  18. Bradshaw, M., Wang, B., Subhabrata Sen, S., Gao, L., Kurose, J., Shenoy, P., Towsley, D.: Periodic broadcast and patching services—implementation, measurement and analysis in an Internet streaming video testbed. Multimed. Syst. 9, 78–93 (2003)

    Article  Google Scholar 

  19. Venkatesh, D., Little, T.D.C.: Dynamic service aggregation for efficient use of resources in interactive video delivery. In: Lecture Notes in Computer Science, Springer, Vol. 1018, pp. 113–116, November (1995)

  20. Wu, S., Jin, H., Chu, J., Fan, K.: A novel cache scheme for cluster-based streaming proxy server. In: 25th IEEE Intl. Conf. Distributed Computing Systems Workshops, pp. 727–733, June (2005)

  21. Hua, K., Sheu, S.: Skyscraper broadcasting: a new broadcasting scheme for metropolitan video-on-demand systems. In: Proc. ACM SIGCOMM, Cannes, France, pp. 89–100 (1997)

  22. Oh, J.-H., Kein, A.H., Vu, K.: An adaptive video multicast scheme for varying workloads. Multimed. Syst. 8(4), 258–269 (2002)

    Article  Google Scholar 

  23. Sen, S., Gao, L., Rexford, J., Towsley D.: Optimal patching schemes for efficient multimedia streaming. In: Proc. 9th Int’l Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV’99), Basking Ridge, NJ, pp. 455–463, June (1999)

  24. Yu, H., Zheng, D., Zhao, B., Zheng, W.: Understanding user behavior in large scale video-on-demand systems. In: Proc. of the 1st EuroSys, Leuven, Belgium, April (2006)

  25. Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)

    Article  Google Scholar 

  26. Willett, P.: Recent trends in hierarchic document clustering: a critical review. Inform. Process. Manag 24(5), 577–597 (1988)

    Article  Google Scholar 

  27. Everitt, B.S., Landau, S., Leese, M.: Cluster Analysis, 4th edn. Arnold, London (2001)

    MATH  Google Scholar 

  28. Salton, G.: Automatic Text Processing: the Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, Reading, MA (1989)

    Google Scholar 

  29. Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. ACM Press/Addison-Wesley, New York, NY (1999)

    Google Scholar 

  30. Faber, V.: Clustering and the continuous K-means algorithm. Los Alamos Sci 22, 138–144 (1994)

    Google Scholar 

  31. Malioutov, I., Barzilay, R.: Minimum cut model for spoken lecture segmentation. In: Proc. of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the ACL, Sydney, Australia, , pp. 25–32, July (2006)

  32. Leacock, C., Chodorow, M.: Combining local context and WordNet similarity for word sense identification. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 265–283. MIT Press, Cambridge, MA (1998)

    Google Scholar 

  33. Wheeler, E.S.: Zipf’s law and why it works everywhere. Glottometrics 4, 45–48 (2002)

    Google Scholar 

  34. Vanderbei, R.J.: Linear programming: foundations and extensions. Kluwer Academic, London (1997)

    Google Scholar 

  35. van der Laan, M., Pollard, K., Bryan, J.: A new partitioning around medoids algorithm. In: Technical Report 105, Group in Biostatistics, University of California, February 2002 (revised for J. Stat. Comput. Simul.)

  36. Kawa, J., Pietka, E.: Image clustering with median and myriad spatial constraint enhanced FCM. In: Proc. Computer Recognition Systems, CORES 2005, Springer, pp. 211–218

  37. Kaufman, L., Rousseeuw, P.: Finding Groups in Data: An Introduction to Cluster Analysis. Wiley and Sons, New York, NY (1990)

    Google Scholar 

  38. Korenius, T., Juhola, M., Laurikkala, J.: On applying the principal components analysis and cosine similarity for information retrieval. Inf. Process. Manag. (submitted 2007, available from the authors by request)

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, North Georgia College and State University, Dahlonega, GA, 30597, USA

    Yong Wei

  2. Department of Computer Science, The University of Georgia, Athens, GA, 30602-7404, USA

    Suchendra M. Bhandarkar, Kang Li & Lakshmish Ramaswamy

Authors
  1. Yong Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Suchendra M. Bhandarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lakshmish Ramaswamy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yong Wei.

Additional information

Communicated by Wu-chi Feng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wei, Y., Bhandarkar, S.M., Li, K. et al. Video personalization in heterogeneous and resource-constrained environments. Multimedia Systems 17, 523–543 (2011). https://doi.org/10.1007/s00530-011-0232-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-011-0232-2

Keywords

Search

Navigation