Skip to main content
SpringerLink
Log in

A Stable, Unified Density Controlled Memetic Algorithm for Gene Regulatory Network Reconstruction Based on Sparse Fuzzy Cognitive Maps

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Gene regulatory networks (GRNs) denote the interrelation among genes in the genomic level. GRNs have a sparse network structures, and as a simulation of GRNs, the density of The Dialogue for Reverse Engineering Assessments and Methods (DREAM) challenge is less than 5%. So using sparse models to represent GRNs is a meaningful task. Fuzzy cognitive maps (FCMs) have been used to reconstruct GRNs. However, the networks learned by automated derivate-free methods is much denser than those in practical applications. Moreover, the performance of current sparse FCM learning algorithms is worse than what we expect. Therefore, proposing a fast, simple and sparse FCM learning algorithm is a realistic demand. Here, we propose a new unified algorithm: Density Controlled Memetic Algorithm (DC-MA) for learning sparse FCMs. As a simple and good-performance algorithm, memetic algorithm (MA) is chosen as the framework of DC-MA. In DC-MA, a new crossover operator and a mutation operator are designed to optimize the target, control the density and ensure the stability; the local search is used to improve the accuracy and a special self-learning operator is proposed to adjust density. To test the effectiveness of our algorithm, DC-MA is performed on synthetic data with varying sizes and densities. The results show that DC-MA obtains good performance in learning sparse FCMs from time series. On the benchmark datasets DREAM3, DREAM4 and large-scale GRN reconstruction DREAM5 dataset, DC-MA shows high accuracy. The good performance in learning sparse FCMs shows the effectiveness of DC-MA, and the simplicity and scalability of the framework ensure that DC-MA can be adapted to a wide range of needs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Acampora G, Pedrycz W, Vitiello A (2015) A competent memetic algorithm for learning fuzzy cognitive maps. IEEE Trans Fuzzy Syst 23(6):2397–2411

    Google Scholar 

  2. Aguilar J (2005) A survey about fuzzy cognitive maps papers. Int J Comput Cognit 3(2):27–33

    Google Scholar 

  3. Axelrod R (2015) Structure of decision: the cognitive maps of political elites. Princeton university Press, Princeton

    Google Scholar 

  4. Bhuvana J, Aravindan C (2016) Memetic algorithm with Preferential Local Search using adaptive weights for multi-objective optimization problems. Soft Comput 20(4):1365–1388

    Google Scholar 

  5. Bueno S, Salmeron JL (2009) Benchmarking main activation functions in fuzzy cognitive maps. Expert Syst Appl 36(3):5221–5229

    Google Scholar 

  6. Chen Y, Mazlack LJ, Lu LJ (2012) Inferring fuzzy cognitive map models for gene regulatory networks from gene expression data. In: 2012 IEEE international conference on bioinformatics and biomedicine (BIBM), IEEE, pp 1–4

  7. Chen Y, Mazlack L, Lu L (2012) Learning fuzzy cognitive maps from data by ant colony optimization. In: Proceedings of the 14th annual conference on Genetic and evolutionary computation, ACM, pp 9–16

  8. Chi Y, Liu J (2014) Learning large-scale fuzzy cognitive maps using a hybrid of memetic algorithm and neural network. In: Proceedings of the 2014 IEEE international conference on fuzzy systems, China, pp 1036–1040

  9. Chi Y, Liu J (2016) Learning of fuzzy cognitive maps with varying densities using a multiobjective evolutionary algorithm. IEEE Trans Fuzzy Syst 24(1):71–81

    Google Scholar 

  10. Chi Y, Liu J (2016) Reconstructing gene regulatory networks with a memetic-neural hybrid based on fuzzy cognitive maps. Nat Comput 18:1–12

    MathSciNet  Google Scholar 

  11. Davidson E, Levin M (2005) Gene regulatory networks. Proc Natl Acad Sci 102(14):4935

    Google Scholar 

  12. Deb K, Beyer HG (2001) Self-adaptive genetic algorithms with simulated binary crossover. Evolut Comput 9(2):197–221

    Google Scholar 

  13. Dogu E, Albayrak YE (2018) Criteria evaluation for pricing decisions in strategic marketing management using an intuitionistic cognitive map approach. Soft Comput 22:1–17

    Google Scholar 

  14. Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Foundations of genetic algorithms, vol 2. Elsevier, Amsterdam, pp 187–202

    Google Scholar 

  15. Froelich W, Pedrycz W (2017) Fuzzy cognitive maps in the modeling of granular time series. Knowl Based Syst 115:110–122

    Google Scholar 

  16. Ghazanfari M, Alizade S, Fathian M, Koulouriotis DE (2007) Comparing simulated annealing and genetic algorithm in learning FCM. Appl Math Comput 192(1):56–68

    MathSciNet  MATH  Google Scholar 

  17. Greenfield A, Madar A, Ostrer H, Bonneau R (2010) DREAM4: combining genetic and dynamic information to identify biological networks and dynamical models. PLoS ONE 5(10):e13397

    Google Scholar 

  18. Herrera F, Lozano M, Verdegay JL (1998) Tackling real-coded genetic algorithms: operators and tools for behavioural analysis. Artif Intell Rev 12(4):265–319

    MATH  Google Scholar 

  19. Hsieh YH, Chen IH, Yuan ST (2014) FCM-based customer expectation-driven service dispatch system. Soft Comput 18(2):359–378

    Google Scholar 

  20. Kosko B (1986) Fuzzy cognitive maps. Int J Man Mach Stud 24(1):65–75

    MATH  Google Scholar 

  21. Liu J, Chi Y, Zhu C (2016) A dynamic multiagent genetic algorithm for gene regulatory network reconstruction based on fuzzy cognitive maps. IEEE Trans Fuzzy Syst 24(2):419–431

    Google Scholar 

  22. Liu J, Chi Y, Zhu C, Jin Y (2017) A time series driven decomposed evolutionary optimization approach for reconstructing large-scale gene regulatory networks based on fuzzy cognitive maps. BMC Bioinform 18(1):241

    Google Scholar 

  23. Lu W, Yang J, Liu X, Pedrycz W (2014) The modeling and prediction of time series based on synergy of high-order fuzzy cognitive map and fuzzy c-means clustering. Knowl Based Syst 70:242–255

    Google Scholar 

  24. Marbach D, Schaffter T, Mattiussi C, Floreano D (2009) Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J Comput Biol 16(2):229–239

    Google Scholar 

  25. Martin N, Rani JK, Aleeswari A, Pandiammal P (2017) An analysis of the associated implications of green manufacturing using fuzzy cognitive maps. Mater Today Proc 4(2):4219–4227

    Google Scholar 

  26. Mencía R, Sierra MR, Mencía C, Varela R (2015) Memetic algorithms for the job shop scheduling problem with operators. Appl Soft Comput 34:94–105

    MATH  Google Scholar 

  27. Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Caltech concurrent computation program, C3P Report, 826

  28. Nápoles G, Grau I, Bello R, Grau R (2014) Two-steps learning of Fuzzy Cognitive Maps for prediction and knowledge discovery on the HIV-1 drug resistance. Expert Syst Appl 41(3):821–830

    Google Scholar 

  29. Nasiruzzaman A B M, Rabbani M G (2008) An educational purpose GUI for evolutionary computation in economic dispatch problem. In: International conference on electrical and computer engineering, pp 355–359

  30. Papageorgiou EI (2012) Learning algorithms for fuzzy cognitive maps—a review study. IEEE Trans Syst Man Cybern Part C Appl Rev 42(2):150–163

    Google Scholar 

  31. Papageorgiou EI, Groumpos P (2003) Optimization of fuzzy cognitive map model in clinical radiotherapy through differential evolution algorithm. Int J Biomed Soft Comput Human Sci Off J Biomed Fuzzy Syst Assoc 9(2):25–31

    Google Scholar 

  32. Papageorgiou EI, Aggelopoulou KD, Gemtos TA, Nanos GD (2013) Yield prediction in apples using fuzzy cognitive map learning approach. Comput Electron Agric 91:19–29

    Google Scholar 

  33. Papageorgiou EI, Parsopoulos KE, Stylios CS, Groumpos PP, Vrahatis MN (2005) Fuzzy cognitive maps learning using particle swarm optimization. J Intell Inform Syst 25(1):95–121

    Google Scholar 

  34. Papageorgiou EI, Stylios CD, Groumpos PP (2004) Active Hebbian learning algorithm to train fuzzy cognitive maps. Int J Approx Reason 37(3):219–249

    MathSciNet  MATH  Google Scholar 

  35. Papageorgiou E, Stylios C, Groumpos P (2003) Fuzzy cognitive map learning based on nonlinear Hebbian rule. Australasian joint conference on artificial intelligence. Springer, Berlin, pp 256–268

    MATH  Google Scholar 

  36. Pedrycz W, Jastrzebska A, Homenda W (2016) Design of fuzzy cognitive maps for modeling time series. IEEE Trans Fuzzy Syst 24(1):120–130

    MATH  Google Scholar 

  37. Salmeron JL, Palos-Sanchez PR (2017) Uncertainty propagation in fuzzy grey cognitive maps with Hebbian-like learning algorithms. IEEE Trans Cybern 99:1–10

    Google Scholar 

  38. Salmeron JL, Papageorgiou EI (2014) Fuzzy grey cognitive maps and nonlinear Hebbian learning in process control. Appl Intell 41(1):223–234

    Google Scholar 

  39. Salmeron JL, Ruiz-Celma A, Mena A (2017) Learning FCMs with multi-local and balanced memetic algorithms for forecasting industrial drying processes. Neurocomputing 232:52–57

    Google Scholar 

  40. Socha K, Dorigo M (2008) Ant colony optimization for continuous domains. Eur J Oper Res 185(3):1155–1173

    MathSciNet  MATH  Google Scholar 

  41. Song HJ, Miao CY, Wuyts R, Shen ZQ, D’Hondt M, Catthoor F (2011) An extension to fuzzy cognitive maps for classification and prediction. IEEE Trans Fuzzy Syst 19(1):116–135

    Google Scholar 

  42. Stach W, Kurgan L, Pedrycz W (2007) Parallel learning of large fuzzy cognitive maps. In: Proceeding of the 2007 IEEE international joint conference on neural networks, USA

  43. Stach W, Kurgan L, Pedrycz W (2008) Data-driven nonlinear Hebbian learning method for fuzzy cognitive maps. In: Fuzzy systems, 2008. FUZZ-IEEE 2008, (IEEE World Congress on Computational Intelligence), pp 1975–1981

  44. Stach W, Kurgan L, Pedrycz W (2010) A divide and conquer method for learning large fuzzy cognitive maps. Fuzzy Sets and Syst 161(19):2515–2532

    MathSciNet  MATH  Google Scholar 

  45. Stach W, Kurgan L, Pedrycz W, Reformat M (2005) Genetic learning of fuzzy cognitive maps. Fuzzy Sets Syst 153(3):371–401

    MathSciNet  MATH  Google Scholar 

  46. Stach W, Pedrycz W, Kurgan LA (2012) Learning of fuzzy cognitive maps using density estimate. IEEE Trans Systems Man Cybern Part B 42(3):900–912

    Google Scholar 

  47. Stolovitzky G, Monroe DON, Califano A (2007) Dialogue on reverse-engineering assessment and methods. Ann New York Acad Sci 1115(1):1–22

    Google Scholar 

  48. Tsadiras A, Zitopoulos G (2017) Fuzzy cognitive maps as a decision support tool for container transport logistics. Evol Syst 8(1):19–33

    Google Scholar 

  49. Wright AH (1991) Genetic algorithms for real parameter optimization. Foundations of genetic algorithms, vol 1. Elsevier, Asterdam, pp 205–218

    Google Scholar 

  50. Wu K, Liu J (2016) Robust learning of large-scale fuzzy cognitive maps via the lasso from noisy time series. Knowl Based Syst 113:23–38

    Google Scholar 

  51. Yang S, Liu J (2018) Time series forecasting based on high-order fuzzy cognitive maps and wavelet transform. IEEE Trans Fuzzy Syst 26:3391–3402

    Google Scholar 

  52. Yesil E, Dodurka MF (2013) Goal-oriented decision support using big bang-big crunch learning based fuzzy cognitive map: an ERP management case study. In: Proceeding of 2013 IEEE international conference on fuzzy systems, pp 1–8

  53. Zhong W, Liu J, Xue M, Jiao L (2004) A multiagent genetic algorithm for global numerical optimization. IEEE Trans Syst Man Cybern Part B 34(2):1128–1141

    Google Scholar 

  54. Zhu Y, Zhang W (2008) An integrated framework for learning fuzzy cognitive map using RCGA and NHL algorithm. In: IEEE conference on wireless communications, networking and mobile computing, Dalian, China, pp 1–5

  55. Zou X, Liu J (2017) A mutual information based two-phase memetic algorithm for large-scale fuzzy cognitive map learning. IEEE Trans Fuzzy Syst 26:2120–2134

    Google Scholar 

  56. Zheng R, Li M, Chen X, Wu FX, Pan Y, Wang J (2018) BiXGBoost: a scalable, flexible boosting-based method for reconstructing gene regulatory networks. Bioinformatics 35(11):1893–1900

    Google Scholar 

  57. Yu B, Xu JM, Li S, Chen C, Chen RX, Wang L, Zhang Y, Wang MH (2017) Inference of time-delayed gene regulatory networks based on dynamic Bayesian network hybrid learning method. Oncotarget 8(46):80373

    Google Scholar 

  58. Zhang XJ, Liu KQ, Liu ZP et al (2013) NARROMI: a noise and redundancy reduction technique improves accuracy of gene regulatory network inference. Bioinformatics 29(1):106–113

    Google Scholar 

  59. Zhang XJ, Zhao J, Hao JK et al (2015) Conditional mutual inclusive information enables accurate quantification of associations in gene regulatory networks. Nucleic Acids Res 43(5):e31

    Google Scholar 

  60. Wang J, Qing G (2018) Ensemble interval-valued fuzzy cognitive maps. IEEE Access 6:38356–38366

    Google Scholar 

  61. Papageorgiou EI, Arthi K (2012) Fuzzy cognitive map ensemble learning paradigm to solve classification problems: application to autism identification. Appl Soft Comput 12(12):3798–3809

    Google Scholar 

  62. Wu K, Liu J, Chi Y (2017) Wavelet fuzzy cognitive maps. Neurocomputing 232:94–103

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the General Program of National Natural Science Foundation of China (NSFC) under Grant 61773300 and in part by the Key Program of Fundamental Research Project of Natural Science of Shaanxi Province, China under Grant 2017JZ017.

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xidian University, Xi’an, 710071, China

    Yilan Wang & Jing Liu

Authors
  1. Yilan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jing Liu.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 45 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Liu, J. A Stable, Unified Density Controlled Memetic Algorithm for Gene Regulatory Network Reconstruction Based on Sparse Fuzzy Cognitive Maps. Neural Process Lett 50, 2843–2870 (2019). https://doi.org/10.1007/s11063-019-10056-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-019-10056-2

Keywords

Search

Navigation