Abstract
In network service systems, satisfying quality of service (QoS) is one of the main objectives. Admission control and resource allocation strategy can be used to guarantee the QoS requirement. Based on partially observable Markov decision processes (POMDPs), this paper proposes a novel admission control model for video on demand (VOD) service systems with elastic QoS. Elastic QoS is also considered in resource allocation strategy. Policy gradient algorithm is often available to find the solution of POMDP problems, with a satisfactory convergence rate. Through numerical examples, it can be shown that the proposed admission control strategy has better performance than complete admission control strategy.
Similar content being viewed by others
References
K. W. Ross, D. Tsang. The stochastic knapsack problem. IEEE Transactions on Communications, vol. 37, no. 7, pp. 740–747, 1989.
K. W. Ross, D. Tsang. Optimal circuit access policies in an ISDN environment: A Markov decision approach. IEEE Transactions on Communications, vol. 37, no. 9, pp. 934–939, 1989.
F. Ma, W. N. Zhou, J. D. Song, G. X. Xu. Research on admission control mechanism in heterogeneous network platform. In Proceedings of the 3rd International Symposium on Intelligence Information Technology Application, IEEE, Zhangjiajie, China, vol. 3, pp. 380–383, 2009.
H. Zhang, X. M. Fang. A pricing and game theory-based call admission control scheme for CDMA systems. In Proceedings of International Conference on Wireless Communications, Networking and Mobile Computing, IEEE, Shanghai, China, pp. 6493–6496, 2007.
K. Jong, G. S. Kang. Performance evaluation of dependable real-time communication with elastic QoS. In Proceedings of International Conference on Dependable Systems and Networks, IEEE, Goteborg, Sweden, pp. 295–303, 2001.
B. Praveen, J. Praveen, C. S. R. Murthy. On providing elastic QoS in optical burst switched networks. In Proceedings of the 2nd International Conference on Broadband Networks, IEEE, Boston, USA, vol. 1, pp. 268–275, 2005.
S. Shakya, J. McCall. Optimization by estimation of distribution with DEUM framework based on Markov random fields. International Journal of Automation and Computing, vol. 4, no. 3, pp. 262–272, 2007.
K. W. Ke, C. N. Tsai, H. T. Wu, C. H. Hsu. Adaptive call admission control with dynamic resource reallocation for cell-based multirate wireless systems. In Proceedings of IEEE Vehicular Technology Conference, IEEE, Marina Bay, Singapore, pp. 2243–2247, 2008.
J. Buhler, G. Wunder. Optimal dynamic admission control in heterogeneous networks. In Proceedings of International ITGWorkshop on Smart Antennas, IEEE, Darmstadt, Germany, pp. 217–224, 2008.
H. C. Tijms. Stochastic Modeling and Analysis: A Computational Approach, New York, USA: Wiley, 1986.
Y. Xiao, P. Yang, Y. Wang. Optimal admission control for multi-class of wireless adaptive multimedia services. IEICE Transactions on Communications, vol. E84-B, no. 4, pp. 795–804, 2001.
S. Lu, J. Huang, B. Q. Yin. Modeling and simulation of the admission control of VOD based on POMDP. Journal of University of Science and Technology of China, vol. 39, no. 9, pp. 984–989, 2009. (in Chinese)
B. Q. Yin, S. Lu, D. Guo. Analysis of admission control in P2P-based media delivery network based on POMDP. International Journal of Innovative Computing, Information and Control, vol. 7, no. 7(B), pp. 4411–4422, 2011.
H. F. Deng, W. Deng, H. Li, H. J. Yang. Authentication and access control in RFID based logistics-customs clearance service platform. International Journal of Automation and Computing, vol. 7, no. 2, pp. 180–189, 2010.
J. Huang, B. Q. Yin, J. Li. An observation-based optimization algorithm for POMDP and its simulation. Information and Control, vol. 37, no. 3, pp. 346–276, 2008. (in Chinese)
X. R. Cao. Stochastic Learning and Optimization: A Sensitivity-based Approach, New York, USA: Springer-Verlag, 2007.
Y. J. Li, B. Q. Yin, H. S. Xi. Partially observable Markov decision processes and performance sensitivity analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 6, pp. 1645–1651, 2008.
H. T. Fang, X. R. Cao. Potential-based online policy iteration algorithms for Markov decision processes. IEEE Transactions on Automatic Control, vol. 49, no. 4, pp. 493–505, 2004.
X. R. Cao. Basic ideas for event-based optimization of Markov systems. Discrete Event Dynamic Systems: Theory Applications, vol. 15, no. 2, pp. 169–197, 2005.
X. R. Cao. Single sample path based optimization of Markov chains. Journal of Optimization Theory and Application, vol. 100, no. 3, pp. 527–548, 1999.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by National Natural Science Foundation of China (Nos. 61174124, 61233003 and 60935001) and National High Technology Research and Development Program of China (863 Program) (No. 2011AA01A102).
Fu-Shou Lin received his B. Sc. degree in mathematics and applied mathematics from Xiamen University, Xiamen, China in 2009. He is currently M. Sc. candidate at the Department of Automation, University of Science and Technology of China (USTC), Hefei, China.
His research interests include Markov decision process, network system optimization and load balancing.
Bao-Qun Yin received his B. Sc. degree in fundamental mathematics from Sichuan University, Chengdu, China in 1985, M. Sc. degree in applied mathematics from the University of Science and Technology of China, Hefei, China in 1993, and Ph.D. degree in pattern recognition and intelligent system from the University of Science and Technology of China, Hefei, China in 1998. He is currently a professor of control science and engineering at Department of Automation, University of Science and Technology of China.
His research interests includeMarkov decision processes, queuing systems and networks.
Jing Huang received his B. Sc. degree in electronic engineering from Jilin University, Changchun, China in 2006. He is currently a Ph. D. candidate at the University of Science and Technology of China, Hefei, China.
His research interests include P2P networks, complex network, and network modeling.
Xu-Min Wu received his B. Sc. degree from the University of Science and Technology of China, Hefei, China in 2007. He is currently a Ph. D. candidate in the School of Information Science and Technology of USTC.
His research interests include P2P networking, CDN, and POMDP.
Rights and permissions
About this article
Cite this article
Lin, FS., Yin, BQ., Huang, J. et al. Admission control with elastic QoS for video on demand systems. Int. J. Autom. Comput. 9, 467–473 (2012). https://doi.org/10.1007/s11633-012-0668-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11633-012-0668-7