Skip to main content
Log in

An enhanced self-adaptive differential evolution based on simulated annealing for rule extraction and its application in recognizing oil reservoir

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

This study proposes an enhanced self-adaptive differential evolution based on simulated annealing for rule extraction (ESADE-Rule). ESADE-Rule adopts IF-THEN as the rule’s form, AND as the connection word for the rule’s antecedent, class label as the rule’s consequence. Rules are encoded as individuals in population of ESADE, and each individual represents a rule set consisting of three parts: the rule’s parameters (including the controls of the rule, antecedents and class labels), the control parameters (including scaling factors and crossover rates), and the fitness value. Mutation and crossover operations of ESADE are further carried out on the population. Then, selection operation is conducted by comparing the fitness values, through which the best individual would be selected out and be decoded to obtain the optimal rule set. Besides, ten benchmark datasets and three logging datasets are adopted to test ESADE-Rule’s performance. The three logging datasets contain oilsk81, oilsk83 and oilsk84 that come from Jianghan oilfield for testing recognition accuracy rate of reservoir. ESADE-Rule is compared with four rule extraction methods from the perspectives of recognition accuracy rate, rules’ number, antecedents’ number and samples’ number that are not covered by the rule set. The results prove that ESADE-Rule performs better at recognition accuracy rate and interpretability. With oilsk81 as training data set, oilsk83 and oilsk84 as testing data set, the testing results of recognition accuracy rate of oil reservoirs illustrate that compared with other four rule extraction methods, ESADE-Rule can obtain more general rules set when the attributes of datasets are similar.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Tsukimoto H (2000) Extracting rules from trained neural networks. IEEE Trans Neural Netw 11(2):377–389

    Article  Google Scholar 

  2. Lim MH, Rahardja S, Gwee BH (1996) A GA paradigm for learning fuzzy rules. Fuzzy Sets Syst 82:177– 186

    Article  MathSciNet  Google Scholar 

  3. Amin AE (2013) A novel classification model for cotton yarn quality based on trained neural network using genetic algorithm. Knowl-Based Syst 39:124–132

    Article  Google Scholar 

  4. Wang G, Wang BN (2008) Data mining study based on fuzzy neural networks and genetic algorithms. Comput Technol Dev 18(2):119–122

    Google Scholar 

  5. Mohamed MH (2011) Rules extraction from constructively trained neural networks based on genetic algorithms. Neurocomputing 74:3180–3192

    Article  Google Scholar 

  6. Li Y, Gao ZG, Li QY (2004) A data mining architecture based on ANN and genetic algorithm. Comput Eng 30(6):155–156

    Google Scholar 

  7. Guo HX, Li JL, Li YN (2014) Differential evolution for rule extraction and its application in recognizing oil reservoir. Syst Eng-Theory Methodol Appl 23(3):430–436

    Google Scholar 

  8. Storn R, Price KV (1996) Minimizing the real functions of the ICEC 1996 contest by differential evolution. In: Proceedings: 1996 IEEE International Conference on Evolutionary Computation, pp 842–844

  9. Qin AK, Suganthan PN (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: IEEE congress on evolutionary computation (CEC 2005). IEEE Press, Edinburgh, Scotland, pp 1785–1791

    Chapter  Google Scholar 

  10. Mallipeddi R, Suganthan PN, Pan QK et al (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Applied Soft Computing, pp 1679–1696

  11. Zhang JQ, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Article  Google Scholar 

  12. Brest J, Mernik M (2008) Population size reduction for the differential evolution algorithm. Applied Intelligence, pp 228– 247

  13. Ghosh A, Das S, Chowdhury A et al (2011) An improved differential evolution algorithm with fitness-based adaptation of the control parameters. Inf Sci 181(18):3749–3765

    Article  MathSciNet  Google Scholar 

  14. Islam SM, Das S, Ghosh S, Roy S et al (2012) An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization. IEEE Trans Syst, Man, Cybern, Part B: Cybern 42(2):482–500

    Article  Google Scholar 

  15. Neri F, Tirronen V (2010) Recent advances in differential evolution: a survey and experimental analysis. Artif Intell Rev 33(1-2):61–106

    Article  Google Scholar 

  16. Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. Evolutionary Computation. IEEE Trans 15(1):4–31

    Google Scholar 

  17. Zhu KJ, Su Sh H, Li JL (2005) Optimal number of clusters and the best partition in fuzzy c-mean. Syst Eng-Theory Pract 3:52–61

    Google Scholar 

  18. Guo HX, Li YN, Li JL et al (2014) Differential evolution improved with self-adaptive control parameters based on simulated annealing. Swarm and Evolutionary Computation 19:52–67

    Article  Google Scholar 

  19. Saito K, Nakano R (1988) Medical diagnostic expert system based on PDP model. IEEE Transactions Neural Networks , pp 255–262

  20. Cohen S, Rokach L, Maimon O (2007) Decision-tree instance-space decomposition with grouped gain-ratio. Inf Sci 177(17):3592–3612

    Article  Google Scholar 

  21. Kaikhah K, Doddameti S (2006) Discovering trends in large datasets using neural networks. Appl Intell 24(1):51–60

    Article  Google Scholar 

  22. Dam HH, Abbass HA, Lokan C et al (2008) Neural-based learning classifier systems. IEEE Trans Knowl Data Eng 20 (1):26–39

    Article  Google Scholar 

  23. Gallant SI (1988) Connectionist expert systems. ACM Commun 31(2):152–169

    Article  Google Scholar 

  24. Setiono R, Baesens B, Mues C (2008) Recursive neural network rule extraction for data with mixed attributes. Neural Networks. IEEE Trans 19(2):299–307

    Google Scholar 

  25. Hara A, Hayashi Y (2012) Ensemble neural network rule extraction using Re-RX algorithm. Neural Networks (IJCNN). IEEE International Joint Conference on, pp 1–6

  26. Hara A, Hayashi Y (2012) A new neural data analysis approach using ensemble neural network rule extraction. Artificial Neural Networks and Machine Learning–ICANN 2012. Springer, Berlin Heidelberg, pp 515–522

    Google Scholar 

  27. Hayashi Y, Sato R, Mitra S (2013) A New approach to Three Ensemble neural network rule extraction using Recursive-Rule extraction algorithm. Neural Networks (IJCNN). IEEE International Joint Conference on, pp 1–7

  28. Hayashi Y (2013) Neural Data Analysis: Ensemble Neural Network Rule Extraction Approach and Its Theoretical and Historical Backgrounds. Artificial Intelligence and Soft Computing. Springer, Berlin Heidelberg, pp 1–19

    Google Scholar 

  29. Hayashi Y (2013) Neural network rule extraction by a new ensemble concept and its theoretical and historical background: A review. Int J Comput Intell Appl 12(04): 1340006-1-1340006-22

    Article  Google Scholar 

  30. Naveen N, Ravi V, Rao CR (2009) Rule extraction from differential evolution trained radial basis function network using genetic algorithms. Automation Science and Engineering. IEEE International Conference on. IEEE, pp 152–157

  31. Liu B, Hsu W, Ma Y (1998) Integrating classification and association rule mining. In: Proceedings of the fourth International Conference on Knowledge Discovery in Databases and Data Mining, pp 80–86

  32. Agrawal R, Srikant R (1994) Fast algorithms for mining association rules. Proc 20th Int Conf Very Large Data Bases, VLDB 1215:487–499

    Google Scholar 

  33. Vo B, Le B (2009) A novel classification algorithm based on association rules mining. Knowledge Acquisition: Approaches, Algorithms and Applications, vol 5465. Springer, Berlin Heidelberg, pp 61–75

    Book  Google Scholar 

  34. Nguyen LTT, Vo B, Hong TP et al (2013) CAR-Miner: An efficient algorithm for mining class-association rules. Expert Syst Appl 40(6):2305–2311

    Article  Google Scholar 

  35. Nguyen D, Vo B (2014) Mining class-association rules with constraints. Knowledge and Systems Engineering. Springer International Publishing, pp 307–318

  36. Luna JM, Romero JR, Romero C et al (2014) On the use of genetic programming for mining comprehensible rules in subgroup discovery. IEEE Trans Cybern 44(12):2329–2341

    Article  Google Scholar 

  37. Luna JM, Romero JR, Romero C et al (2014) Reducing gaps in quantitative association rules: a genetic programming free-parameter algorithm. Int Comput Aided Eng 21(4):321–337

    Google Scholar 

  38. Asuncion A, Newman DJ UCI Machine Learning Repository, University of California, School of Information and Computer Science, Irvine, CA, 2007, available at: http://www.ics.uci.edu/~textasciitildemlearn/MLRepository.html

  39. Guo HX, Liao XW, Zhu KJ (2011) Optimizing Reservoir Features in Oil Exploration Management Based on Fusion of Soft Computing. Appl Soft Comput 11(1):1144–1155

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China No.71103163, 71103164, 71573237 by Program for New Century Excellent Talents in University, No. NCET-13-1012, by Research Foundation of Humanities and Social Sciences of Ministry of Education of China No.10YJC790071, by the Fundamental Research Founds for National University, China University of Geosciences (Wuhan) No.CUG120111, CUG110411, G2012002A, CUG140604, by China Postdoctoral Science Foundation Grant No. 20090461293, by special grade of the financial support from China Postdoctoral Science Foundation Grant No. 201003670, by the open foundation for the research center of resource environment economics in China University of Geosciences (Wuhan) and by the open foundation for Key Laboratory of Tectonics and Petroleum Resources (China University of Geosciences), Ministry of Education No. TPR-2011-11.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Haixiang Guo.

Appendix

Appendix

Table 21 oilsk81 dataset
Table 22 oilsk83 dataset
Table 23 oilsk84 dataset

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, H., Li, Y., Liu, X. et al. An enhanced self-adaptive differential evolution based on simulated annealing for rule extraction and its application in recognizing oil reservoir. Appl Intell 44, 414–436 (2016). https://doi.org/10.1007/s10489-015-0702-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-015-0702-x

Keywords

Navigation