Abstract
Service Oriented Architecture (SOA) is a business-centric IT architectural approach for building distributed systems. Reliability of service-oriented systems heavily depends on the remote Web services as well as the unpredictable Internet connections. Designing efficient and effective reliability prediction approaches of Web services has become an important research issue. In this article, we propose two personalized reliability prediction approaches of Web services, that is, neighborhood-based approach and model-based approach. The neighborhood-based approach employs past failure data of similar neighbors (either service users or Web services) to predict the Web service reliability. On the other hand, the model-based approach fits a factor model based on the available Web service failure data and use this factor model to make further reliability prediction. Extensive experiments are conducted with our real-world Web service datasets, which include about 23 millions invocation results on more than 3,000 real-world Web services. The experimental results show that our proposed reliability prediction approaches obtain better reliability prediction accuracy than other competing approaches.
- ANSI/IEEE. 1991. Standard glossary of software engineering terminology. ANSI/IEEE STD-729-1991.Google Scholar
- Bertolino, A. and Polini, A. 2009. SOA test governance: Enabling service integration testing across organization and technology borders. In Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops. 277--286. Google ScholarDigital Library
- Breese, J. S., Heckerman, D., and Kadie, C. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence (UAI’98). 43--52. Google ScholarDigital Library
- Burke, R. 2002. Hybrid recommender systems: Survey and experiments. User Model. User-Adap. Interact. 12, 4, 331--370. Google ScholarDigital Library
- Cardoso, J., Miller, J., Sheth, A., and Arnold, J. 2002. Modeling quality of service for workflows and web service processes. J. Web Semant. 1, 281--308.Google ScholarCross Ref
- Cheung, L., Roshandel, R., Medvidovic, N., and Golubchik, L. 2008. Early prediction of software component reliability. In Proceedings of the 30th International Conference on Software Engineering (ICSE’08). 111--120. Google ScholarDigital Library
- Cheung, R. C. 1980. A user-oriented software reliability model. IEEE Trans. Softw. Eng. 6, 2, 118--125. Google ScholarDigital Library
- Cortellessa, V. and Grassi, V. 2007a. A modeling approach to analyze the impact of error propagation on reliability of component-based systems. In Proceedings of the 10th International Symposium on Component Based Software Engineering (CBSE’07). 140--156. Google ScholarDigital Library
- Cortellessa, V. and Grassi, V. 2007b. Reliability modeling and analysis of service-oriented architectures. In Test and Analysis of Web Services, 339--362.Google Scholar
- Filieri, A., Ghezzi, C., Grassi, V., and Mirandola, R. 2010. Reliability analysis of component-based systems with multiple failure modes. In Proceedings of the 13th International Symposium on Component Based Software Engineering (CBSE’10). 1--20. Google ScholarDigital Library
- Friedman, M., Tran, P., and Goddard, P. 1992. Reliability techniques for combined hardware and software systems. Tech. rep. RL-TR-92-15, Rome Laboratory.Google Scholar
- Gokhale, S. S. and Lyu, M. R.-T. 2005. A simulation approach to structure-based software reliability analysis. IEEE Trans. Softw. Eng. 31, 643--656. Google ScholarDigital Library
- Gokhale, S. S. and Trivedi, K. S. 2002. Reliability prediction and sensitivity analysis based on software architecture. In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE’02). 64--78. Google ScholarDigital Library
- Golub, G. H. and Loan, C. F. V. 1996. Matrix Computations 3rd Ed. The Johns Hopkins University Press. Google ScholarDigital Library
- Goseva-Popstojanova, K. and Trivedi, K. S. 2001. Architecture-based approach to reliability assessment of software systems. Perf. Eval. 45, 2--3, 179--204. Google ScholarDigital Library
- Goseva-Popstojanova, K., Hassan, A., Abdelmoez, W., Nassar, D. E. M., Ammar, H., and Mili, A. 2003. Architectural-level risk analysis using uml. IEEE Trans. Softw. Eng. 29, 10, 946--960. Google ScholarDigital Library
- Grassi, V. and Patella, S. 2006. Reliability prediction for service-oriented computing environments. IEEE Internet Comput. 10, 3, 43--49. Google ScholarDigital Library
- Hamlet, D. 2009. Tools and experiments supporting a testing-based theory of component composition. ACM Trans. Softw. Eng. Methodol. 18, 12:1--12:41. Google ScholarDigital Library
- Herlocker, J. L., Konstan, J. A., and Riedl, J. 2000. Explaining collaborative filtering recommendations. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW’00). 241--250. Google ScholarDigital Library
- Hofmann, T. 2004. Latent semantic models for collaborative filtering. ACM Trans. Inf. Syst. 22, 1, 89--115. Google ScholarDigital Library
- Huang, C.-Y., Lyu, M., and Kuo, S.-Y. 2003. A unified scheme of some nonhomogenous poisson process models for software reliability estimation. IEEE Trans. Soft. Eng. 29, 3, 261--269. Google ScholarDigital Library
- Jelinski, Z. and Moranda, P. 1972. Software reliability research. In Proceedings of the Statistical Methods for the Evaluation of Computer System Performance. 465--484.Google Scholar
- Koziolek, H., Schlich, B., and Bilich, C. 2010. A large-scale industrial case study on architecture-based software reliability analysis. In Proceedings of the 21st IEEE International Symposium on Software Reliability Engineering (ISSRE’10). 279--288. Google ScholarDigital Library
- Littlewood, B., Abdel-Ghaly, A., and Chan, P. 1986. Tools for the Analysis of the Accuracy of Software Reliability Predictions. Springer-Verlag, Heidelberg.Google Scholar
- Lyu, M. and Nikora, A. 1992. Applying reliability models more effectively {software}. Software, IEEE 9, 4, 43--52. Google ScholarDigital Library
- Lyu, M. R. 1995. Software Fault Tolerance. Trends in Software, Wiley. Google ScholarDigital Library
- Lyu, M. R. 1996. Handbook of Software Reliability Engineering. McGraw-Hill, New York. Google ScholarDigital Library
- Lyu, M. R. 2007. Software reliability engineering: A roadmap. Prof. Future of Software Engineering, Int’l Conf. Software Engineering (ICSE’07) 0, 153--170. Google ScholarDigital Library
- Ma, H., King, I., and Lyu, M. R. 2007. Effective missing data prediction for collaborative filtering. In Proceedings of the 30th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’07). 39--46. Google ScholarDigital Library
- Ma, H., King, I., and Lyu, M. R. 2009. Learning to recommend with social trust ensemble. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’09). 203--210. Google ScholarDigital Library
- Musa, J. D. 1993. Operational profiles in software-reliability engineering. IEEE Softw. 10, 14--32. Google ScholarDigital Library
- Musa, J. D., Iannino, A., and Okumoto, K. 1990. Software Reliability: Measurement, Prediction, Application. McGraw-Hill, New York. Google ScholarDigital Library
- Putnam, L. H. and Myers, W. 1992. Measures for Excellence: Reliable Software on Time, Within Budget. Prentice-Hall. Google ScholarDigital Library
- Rennie, J. D. M. and Srebro, N. 2005. Fast maximum margin matrix factorization for collaborative prediction. In Proceedings of the 22nd International Conference on Machine Learning (ICML’05). 713--719. Google ScholarDigital Library
- Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., and Riedl, J. 1994. Grouplens: An open architecture for collaborative filtering of netnews. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. 175--186. Google ScholarDigital Library
- Reussner, R. H., Schmidt, H. W., and Poernomo, I. H. 2003. Reliability prediction for component-based software architectures. J. Syst. Softw. 66, 3, 241--252. Google ScholarDigital Library
- Salakhutdinov, R. and Mnih, A. 2007. Probabilistic matrix factorization. In Proceedings of the Advances in Neural Information Processing Systems. 1257--1264.Google Scholar
- Salakhutdinov, R. and Mnih, A. 2008. Bayesian probabilistic matrix factorization using markov chain monte carlo. In Proceedings of the 25th International Conference on Machine Learning (ICML’08). 880--887. Google ScholarDigital Library
- Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web (WWW’01). 285--295. Google ScholarDigital Library
- Scholz, A., Buckl, C., Kemper, A., Knoll, A., Heuer, J., and Winter, M. 2008. Ws-amuse - web service architecture for multimedia services. In Proceedings of the 30th International Conference on Software Engineering (ICSE’08). 703--712. Google ScholarDigital Library
- Shao, L., Zhang, J., Wei, Y., Zhao, J., Xie, B., and Mei, H. 2007. Personalized qos prediction for web services via collaborative filtering. In Proceedings of the 5th International Conference on Web Services (ICWS’07). 439--446.Google Scholar
- Shardanand, U. and Maes, P. 1995. Social information filtering: Algorithms for automating word of mouth. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Google ScholarDigital Library
- ter Beek, M. H., Gnesi, S., Koch, N., and Mazzanti, F. 2008. Formal verification of an automotive scenario in service-oriented computing. In Proceedings of the 30th International Conference on Software Engineering (ICSE’08). 613--622. Google ScholarDigital Library
- Tsai, W. T. 2005. Service-oriented system engineering: A new paradigm. In Proceedings of the IEEE International Workshop on Service-Oriented System Engineering (SOSE’05). 3--8. Google ScholarDigital Library
- Tsai, W.-T., Zhou, X., Chen, Y., and Bai, X. 2008. On testing and evaluating service-oriented software. IEEE Comput. 41, 8, 40--46. Google ScholarDigital Library
- Wang, J., de Vries, A. P., and Reinders, M. J. 2006a. Unifying user-based and item-based collaborative filtering approaches by similarity fusion. In Proceedings of the 29th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’06). 501--508. Google ScholarDigital Library
- Wang, W.-L., Pan, D., and Chen, M.-H. 2006b. Architecture-based software reliability modeling. J. Syst. Softw. 79, 1, 132--146. Google ScholarDigital Library
- Xing, F., Guo, P., and Lyu, M. 2005. A novel method for early software quality prediction based on support vector machine. In Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering (ISSRE’05). 213--222. Google ScholarDigital Library
- Xue, G., Lin, C., Yang, Q., Xi, W., Zeng, H., Yu, Y., and Chen, Z. 2005. Scalable collaborative filtering using cluster-based smoothing. In Proceedings of the 28th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’05). 114--121. Google ScholarDigital Library
- Yacoub, S. M., Cukic, B., and Ammar, H. H. 1999. Scenario-based reliability analysis of component-based software. In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE’99). 22--31. Google ScholarDigital Library
- Ye, C., Cheung, S. C., and Chan, W. K. 2006. Publishing and composition of atomicity-equivalent services for B2B collaboration. In Proceedings of the 28th International Conference on Software Engineering (ICSE’06). 351--360. Google ScholarDigital Library
- Yu, K., Schwaighofer, A., Tresp, V., Xu, X., and Kriegel, H.-P. 2004. Probabilistic memory-based collaborative filtering. IEEE Trans. Knowl. Data Eng. 16, 1, 56--69. Google ScholarDigital Library
- Zhang, L.-J., Zhang, J., and Cai, H. 2007. Services Computing. Springer and Tsinghua University Press.Google Scholar
- Zheng, Z. and Lyu, M. R. 2010. Collaborative reliability prediction for service-oriented systems. In Proceedings of the IEEE/ACM 32nd International Conference on Software Engineering (ICSE’10). 35--44. Google ScholarDigital Library
- Zheng, Z., Ma, H., Lyu, M. R., and King, I. 2009. WSREC: A collaborative filtering based web service recommender system. In Proceedings of the 7th International Conference on Web Services (ICWS’09). 437--444. Google ScholarDigital Library
- Zheng, Z., Ma, H., Lyu, M. R., and King, I. 2011. Qos-aware web service recommendation by collaborative filtering. IEEE Trans. Serv. Comput. 4, 2, 140--152. Google ScholarDigital Library
Index Terms
- Personalized Reliability Prediction of Web Services
Recommendations
Collaborative Web Service QoS Prediction via Neighborhood Integrated Matrix Factorization
With the increasing presence and adoption of web services on the World Wide Web, the demand of efficient web service quality evaluation approaches is becoming unprecedentedly strong. To avoid the expensive and time-consuming web service invocations, ...
A Learning Approach to the Prediction of Reliability Ranking for Web Services
ICWS '15: Proceedings of the 2015 IEEE International Conference on Web ServicesService computing is a popular development paradigm in information technology. The functional properties of Web services assure correct functionality of cloud applications, while the nonfunctional properties such as reliability might significantly ...
Online reliability prediction of service composition
EAST 2014: Proceedings of the 2014 3rd International Workshop on Evidential Assessment of Software TechnologiesReliability is an important quality attribute for service oriented software. Existing approaches use static data collected from the testing to predict the software reliability. These approaches do not address the dynamism of service behavior after ...
Comments