Abstract
Direct marketing modeling identifies effective models for improving managerial decision making in marketing. This paper proposes a novel system for discovering models represented as Bayesian networks from incomplete databases in the presence of missing values. It combines an evolutionary algorithm with the traditional Expectation-Maximization(EM) algorithm to find better network structures in each iteration round. A data completing method is also presented for the convenience of learning and evaluating the candidate networks. The new system can overcome the problem of getting stuck in sub-optimal solutions which occurs in most existing learning algorithms and the efficiency problem in some existing evolutionary algorithms. We apply it to a real-world direct marketing modeling problem, and compare the performance of the discovered Bayesian networks with other models obtained by other methods. In the comparison, the Bayesian networks learned by our system outperform other models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jensen, F.V.: An Introduction to Bayesian Network. University of College London Press, London (1996)
Andreassen, S., Woldbye, M., Falck, B., Andersen, S.: MUNIN: A causal probabilistic network for interpretation of electromyographic findings. In: Proceedings of the Tenth International Joint Conference on Artificial Intelligence, pp. 366–372 (1987)
Cheeseman, P., Kelly, J., Self, M., Stutz, J., Taylor, W., Freeman, D.: Autoclass: A Bayesian classification system. In: Proceedings of the Fifth International Workshop on Machine Learning, pp. 54–64 (1988)
Heckerman, D., Horvitz, E.: Inferring informational goals from free-text queries: A Bayesian approach. In: Cooper, G.F., Moral, S. (eds.) Proceedings of the Fourteenth Conference of Uncertainty in Artificial Intelligence, pp. 230–237. Morgan Kaufmann, Wisconsin (July 1998)
Cheng, J., Greiner, R., Kelly, J., Bell, D., Liu, W.: Learning Bayesian networks from data: An information-theory based approach. Artificial Intelligence 137, 43–90 (2002)
Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search, 2nd edn. MIT Press, MA (2000)
Cooper, G., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Machine Learning 9(4), 309–347 (1992)
Heckerman, D.: A tutorial on learning Bayesian networks. Microsoft Research Adv. Technol. Div., Redmond, WA, Tech. Rep. MSR-TR-95-06 (1995)
Lam, W., Bacchus, F.: Learning Bayesian belief networks-an approach based on the MDL principle. Computer Intelligence 10(4), 269–293 (1994)
Larran̈aga, P., Poza, M., Yurramendi, Y., Murga, R., Kuijpers, C.: Structural learning of Bayesian network by genetic algorithms: A performance analysis of control parameters. IEEE Trans. Pattern Anal. Machine Intell. 18, 912–926 (1996)
Larrañaga, P., Kuijpers, C., Mura, R., Yurramendi, Y.: Learning Bayesian network structures by searching for the best ordering with genetic algorithms. IEEE Transactions on System, Man and Cybernetics 26(4), 487–493 (1996)
Wong, M.L., Lam, W., Leung, K.S.: Using evolutionary programming and minimum description length principle for data mining of Bayesian networks. IEEE Trans. Pattern Anal. Machine Intell. 21, 174–178 (1999)
Wong, M.L., Leung, K.S.: An efficient data mining method for learning Bayesian networks using an evolutionary algorithm-based hybrid approach. IEEE Trans. Evolutionary Computation 8(4), 378–404 (2004)
Schafer, J.L., Graham, J.W.: Missing data: Our view of the state of art. Psychological Methods 7(2), 147–177 (2002)
Ramoni, M., Sebastinani, P.: Efficient parameter learning in Bayesian networks from incomplete databases, Tech. Rep. KMI-TR-41 (1997)
Ramoni, M., Sebastinani, P.: The use of exogenous knowledge to learn Bayesian networks from incomplete databases, Tech. Rep. KMI-TR-44 (1997)
Friedman, N.: Learning belief networks in the presence of missing values and hidden variables. Machine Learning (1997)
Friedman, N.: The Bayesian Structural EM algorithm. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (1998)
Pen̈a, J.M., Lozano, J.A., Larran̈aga, P.: An improved Bayesian Structural EM algorithm for learning Bayesian networks for clustering. Pattern Recognition Letters, 779–786 (2000)
Pen̈a, J.M., Lozano, J.A., Larran̈aga, P.: Learning recursive Bayesian multinets for data clustering by means of constructive induction. Machine Learning, 63–89 (2002)
Myers, J.W., Laskey, K.B., DeJong, K.A.: Learning Bayesian networks from incomplete data using evolutionary algorithms. In: Proceedings of the First Annual Conference on Genetic and Evolutionary Computation Conference 1999, pp. 458–465. Morgan Kauffman, Orlando (July 1999)
Petrison, L.A., Blattberg, R.C., Wang, P.: Database marketing: Past present, and future. Journal of Direct Marketing 11(4), 109–125 (1997)
Cabena, P., Hadjinian, P., Stadler, R., Verhees, J., Zansi, A.: Discovering Data Mining: From Concept to Implementation. Prentice-Hall Inc., Englewood Cliffs (1997)
Zahavi, J., Levin, N.: Issues and problems in applying neural computing to target marketing. Journal of Direct Marketing 11(4), 63–75 (1997)
Bhattacharyya, S.: Direct marketing response models using genetic algorithms. In: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, pp. 144–148 (1998)
Bhattacharyya, S.: Evolutionary algorithms in data mining: Multi-objective performance modeling for direct marketing. In: Proceedings of the Sixth International Conference on Knowledge Discovery and Data Mining, pp. 465–473 (August 2000)
Zahavi, J., Levin, N.: Applying neural computing to target marketing. Journal of Direct Marketing 11(4), 76–93 (1997)
Ling, C.X., Li, C.: Data mining for direct marketing: Problems and solutions. In: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, pp. 73–79 (1998)
Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148–156 (1996)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo (1988)
Rubin, D.B.: Multiple Imputation for nonresponse in Surveys. Wiley, Chichester (1987)
Lakshminarayan, K., Harp, S.A., Samad, T.: Imputation of missing data using machine learning techniques. In: Proceeding of the second International Conference on Knowledge Discovery and data Mining, pp. 140–146 (1996)
Zio, M.D., Scanu, M., Coppola, L., Luzi, O., Ponti, A.: Bayesian networks for imputation. Journal of the Royal Statistical Society (A) 167(2), 309–322 (2004)
Hruschka, E.R.J., Ebecken, N.F.F.: Missing values prediction with K2. Intelligent Data Analysis 6(6), 557–566 (2002)
Kim, H., Golub, G.H., Park, H.: Imputation of missing values in DNA microarray gene expression data. In: Proceedings of IEEE Computational Systems Bioinformatics Conference, pp. 572–573. IEEE Press, Los Alamitos (2004)
Cai, Z., Heydari, M., Lin, G.: Microarray missing value imputation by iterated local least squares. In: Proceedings of the Fourth Asia-Pacific Bioinformatics Conference, pp. 159–168 (2006)
Liu, L., Hawkins, D.M., Ghosh, S., Young, S.: Robust singular value decomposition analysis of microarray data. Proceedings of the National Academy of Sciences of the United States of America 100(23), 13167–13172 (2003)
Geman, S., Geman, D.: Stochastic relaxation, gibbs distributions and the bayesian restoration of images. IEEE Trans. Pattern Anal. Machine Intell. 6, 721–742 (1984)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society(B) 39(1), 1–38 (1977)
Lauritzen, S.L.: The EM algorithm for graphical association models with missing data. Computational Statistics and Data Analysis, 191–201 (1995)
Ramoni, M., Sebastiani, P.: Robust learning with missing data. Machine Learning 45, 147–170 (2001)
Lauritzen, S.L., Spiegelhalter, D.J.: Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society 50(2), 157–224 (1988)
Huang, C., Darwinche, A.: Inference in belief networks: a procedural guide. International Journal of Approximate Reasoning 15(3), 225–263 (1996)
Neal, R.M.: Bayesian Learning for Neural Networks. Springer, Heidelberg (1996)
Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Machine Learning 29, 131–163 (1997)
Agresti, A.: Categorical Data Analysis. Wiley, New York (2002)
Rud, O.P.: Data Mining Cookbook: Modeling Data for Marketing, Risk and Customer Relationship Management. Wiley, New York (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wong, M.L. (2010). Direct Marketing Modeling Using Evolutionary Bayesian Network Learning Algorithm. In: Casillas, J., MartÃnez-López, F.J. (eds) Marketing Intelligent Systems Using Soft Computing. Studies in Fuzziness and Soft Computing, vol 258. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15606-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-15606-9_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15605-2
Online ISBN: 978-3-642-15606-9
eBook Packages: EngineeringEngineering (R0)