Abstract
A novel knowledge discovery technique using neural networks is presented. A neural network is trained to learn the correlations and relationships that exist in a dataset. The neural network is then pruned and modified to generalize the correlations and relationships. Finally, the neural network is used as a tool to discover all existing hidden trends in four different types of crimes (murder, rape, robbery, and auto theft) in US cities as well as to predict trends based on existing knowledge inherent in the network.
Similar content being viewed by others
References
J.P. Bigus, Data Mining With Neural Networks: Solving Business Problems from Application Development to Decision Support, McGraw-Hill: NY, 1996.
J. Han and M. Kamber, Data Mining: Concepts and Techniques, Morgan Kaufmann: San Francisco, California, 2001.
R. Andrews, J. Diederich, and A. Tickle, “A survey and critique of techniques for extracting rules from trained artificial neural networks,” Knowledge-Based Systems, vol. 8, no. 6, pp. 373–389, 1995.
L. Bochereau and P. Bourgine, “Extraction of semantic features and logical rules from a multilayer neural network,” in International Joint Conference on Neural Networks Washington DC vol. 2, 1990, pp. 579–582.
G. Towell and J. Shavlik, “The extraction of refined rules from knowledge based neural networks,” Machine Learning, vol. 131, pp. 71–101, 1993.
R. Andrews and S. Geva, “Rule extraction from a constrained error back propagation MLP” in Proc. 5th Australian Conference on Neural Networks Brisbane Queensland, 1994, pp. 9–12.
S.B. Thrun, “Extracting provably correct rules from artificial neural networks,” Technical Report IAI-TR-93-5 Institut fur Informatik III Universitat Bonn, 1994.
S. Sestito and T. Dillon, “Automated knowledge acquisition of rules with continuously valued attributes,” in Proc. 12th International Conference on Expert Systems and their Applications (AVIGNON'92), May 1992, pp. 645–656.
M.W. Carven and J.W. Shavlik, “Using sampling and queries to extract rules from trained neural networks,” in Machine Learning: Proceedings of the Eleventh International Conference, 1994, pp. 176–183.
A.B. Tickle, M. Orlowski, and J. Diederich, “DEDEC: Decision detection by rule extraction from neural networks,” QUT NRC, September 1994.
R. Setiono, H. Lu, and H. Liu, “Effective data mining using neural networks,” IEEE Transactions on Knowledge and Data Engineering, vol. 8, no. 6, pp. 957–961, 1996.
R. Setiono, “Extracting rules from pruned neural networks for breast cancer diagnosis,” Artificial Intelligence in Medicine, vol. 8, no. 1, pp. 37–51, 1996.
A. Gupta, S. Park, and S.M. Lam, “Generalized analytic rule extraction for feedforward neural networks,” IEEE Transactions on Knowledge and Data Engineering, vol. 11, pp. 985–991, 1998.
Jason T. L. Wang, Q. Ma, D. Shasha, and C.H. Wu, “Application of neural networks to biological data mining: A case study in protein sequence classification,” in The Sixth ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Boston: MA, USA, 2000, pp. 305–309.
K. Kaikhah and S. Doddameti, “Knowledge discovery using neural networks,” in Seventeenth International Conference on Industrial & Engineering Applications of Artificial Intelligence & Expert Systems, (IEA/AIE), May 2004, pp. 20–28.
K. Mehrotra, C.K. Mohan, and S. Ranka, Elements of Artificial Neural Networks (Complex Adaptive Systems, MIT Press: Cambridge, MA, 1997.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kaikhah, K., Doddameti, S. Discovering Trends in Large Datasets Using Neural Networks. Appl Intell 24, 51–60 (2006). https://doi.org/10.1007/s10489-006-6929-9
Issue Date:
DOI: https://doi.org/10.1007/s10489-006-6929-9