Skip to main content
SpringerLink
Log in

An active-learning probabilistic neural network for feasibility classification of constrained engineering optimization problems

  • Original Article
  • Published:
Engineering with Computers Aims and scope Submit manuscript

Abstract

Constrained optimization problems (COPs) with multiple computational expensive constraints are commonly encountered in simulation-based engineering designs. During the optimization process, the feasibility analysis of the intermediate solutions depends on the computational simulations will be computationally prohibitive. To relieve this computational burden, an active-learning probabilistic neural network (AL-PNN) classification modeling approach is proposed to build a classifier for quickly analyzing the feasibility of the intermediate solutions. In the proposed AL-PNN approach, an interesting region tracking strategy is developed to locate the regions that may contain part of the constraint boundary. The judge rule of the interesting region is based on whether the predicted class labels of pseudo points are different in subregions, which is generated by dividing the design space with the K-means cluster algorithm. Once the interesting region is located, the newly infill sample point used to update the PNN classification model can be obtained by a distance screening criterion. Seven numerical cases and the design of the rocket interstage section are used to demonstrate the performances of the proposed approach. The results illustrate that the proposed AL-PNN approach can provide more accurate classification results than the compared four state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Chatterjee T, Chakraborty S, Chowdhury R (2019) A critical review of surrogate assisted robust design optimization. Arch Comput Methods Eng 26(1):245–274

    Article  MathSciNet  Google Scholar 

  2. Wang H, Jin Y, Yang C, Jiao L (2020) Transfer stacking from low-to high-fidelity: a surrogate-assisted bi-fidelity evolutionary algorithm. Appl Soft Comput 92:106276

    Article  Google Scholar 

  3. Ruan X, Jiang P, Zhou Q, Hu J, Shu L (2020) Variable-fidelity probability of improvement method for efficient global optimization of expensive black-box problems. Struct Multidiscip Optim 62(6):3021–3052

    Article  MathSciNet  Google Scholar 

  4. Zhou Q, Wu J, Xue T, Jin P (2021) A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems. Eng Comput 37:623–639

    Article  Google Scholar 

  5. Zeng P, Li T, Chen Y, Jimenez R, Feng X, Senent S (2020) New collocation method for stochastic response surface reliability analyses. Eng Comput 36:1751–1762

    Article  Google Scholar 

  6. Vasu A, Grandhi RV (2014) Response surface model using the sorted k-fold approach. AIAA J 52(10):2336–2341

    Article  Google Scholar 

  7. Hu J, Zhou Q, McKeand A, Xie T, Choi SK (2021) A model validation framework based on parameter calibration under aleatory and epistemic uncertainty. Struct Multidiscip Optim 63(2):645–660

    Article  Google Scholar 

  8. Qian J, Yi J, Cheng Y, Liu J, Zhou Q (2020) A sequential constraints updating approach for Kriging surrogate model-assisted engineering optimization design problem. Eng Comput 36:993–1009

    Article  Google Scholar 

  9. Viana FAC, Simpson TW, Balabanov V, Toropov V (2014) Special section on multidisciplinary design optimization: metamodeling in multidisciplinary design optimization: how far have we really come? AIAA J 52(4):670–690

  10. Jiang C, Hu Z, Liu Y, Mourelatos ZP, Gorsich D, Jayakumar P (2020) A sequential calibration and validation framework for model uncertainty quantification and reduction. Comput Methods Appl Mech Eng 368:113172

    Article  MathSciNet  MATH  Google Scholar 

  11. Jiang C, Qiu H, Yang Z, Chen L, Gao L, Li P (2019) A general failure-pursuing sampling framework for surrogate-based reliability analysis. Reliab Eng Syst Saf 183:47–59

    Article  Google Scholar 

  12. Zhou Q, Shao X, Jiang P, Zhou H, Shu L (2015) An adaptive global variable fidelity metamodeling strategy using a support vector regression based scaling function. Simul Model Pract Theory 59(12):18–35

    Article  Google Scholar 

  13. Pal M, Deswal S (2011) Support vector regression based shear strength modelling of deep beams. Comput Struct 89(13):1430–1439

    Article  Google Scholar 

  14. Karamichailidou D, Kaloutsa V, Alexandridis AJRE (2021) Wind turbine power curve modeling using radial basis function neural networks and tabu search. Renew Energy 163:2137–2152

    Article  Google Scholar 

  15. Safarpoor M, Shirzadi A (2021) Numerical investigation based on radial basis function–finite-difference (RBF–FD) method for solving the Stokes–Darcy equations. Eng Comput 37:909–920 

  16. Rashid K, Ambani S, Cetinkaya E (2013) An adaptive multiquadric radial basis function method for expensive black-box mixed-integer nonlinear constrained optimization. Eng Optim 45(2):185–206

    Article  MathSciNet  Google Scholar 

  17. Zhai Z, Li H, Wang X (2020) An adaptive sampling method for Kriging surrogate model with multiple outputs. Eng Comput. https://doi.org/10.1007/s00366-020-01145-1

  18. Asadi A, Bakhtiyari AN, Alarifi IM (2020) Predictability evaluation of support vector regression methods for thermophysical properties, heat transfer performance, and pumping power estimation of MWCNT/ZnO–engine oil hybrid nanofluid. Eng Comput. https://doi.org/10.1007/s00366-020-01038-3

  19. Jiang C, Qiu H, Gao L, Wang D, Yang Z, Chen L (2020) Real-time estimation error-guided active learning Kriging method for time-dependent reliability analysis. Appl Math Model 77:82–98

    Article  MathSciNet  MATH  Google Scholar 

  20. Basudhar A, Dribusch C, Lacaze S, Missoum S (2012) Constrained efficient global optimization with support vector machines. Struct Multidiscip Optim 46(2):201–221

    Article  MATH  Google Scholar 

  21. Basudhar A, Missoum S, Sanchez AH (2008) Limit state function identification using support vector machines for discontinuous responses and disjoint failure domains. Probab Eng Mech 23(1):1–11

    Article  Google Scholar 

  22. Singh P, Van Der Herten J, Deschrijver D, Couckuyt I, Dhaene T (2017) A sequential sampling strategy for adaptive classification of computationally expensive data. Struct Multidiscip Optim 55(4):1425–1438

    Article  MathSciNet  Google Scholar 

  23. Basudhar A, Missoum S (2010) An improved adaptive sampling scheme for the construction of explicit boundaries. Struct Multidiscip Optim 42(4):517–529

    Article  Google Scholar 

  24. Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019

    Article  Google Scholar 

  25. Le Chau N, Dao T-P (2020) An efficient hybrid approach of improved adaptive neural fuzzy inference system and teaching learning-based optimization for design optimization of a jet pump-based thermoacoustic-stirling heat engine. Neural Comput Appl 32(11):7259–7273

    Article  Google Scholar 

  26. Patel J, Choi S-K (2012) Classification approach for reliability-based topology optimization using probabilistic neural networks. Struct Multidiscip Optim 45(4):529–543

    Article  MathSciNet  MATH  Google Scholar 

  27. Harandizadeh H, Armaghani D (2020) Prediction of air-overpressure induced by blasting using an ANFIS-PNN model optimized by GA. Appl Soft Comput 99:106904

    Article  Google Scholar 

  28. Specht DF (1990) Probabilistic neural networks. Neural Netw 3(1):109–118

    Article  Google Scholar 

  29. Baliarsingh SK, Vipsita S, Gandomi AH, Panda A, Bakshi S, Ramasubbareddy S (2020) Analysis of high-dimensional genomic data using MapReduce based probabilistic neural network. Comput Methods Prog Biomed 195:105625

    Article  Google Scholar 

  30. Earp S, Curtis A (2020) Probabilistic neural network-based 2D travel-time tomography. Neural Comput Appl 32(22):17077–17095

    Article  Google Scholar 

  31. Sun Y, Chen J, Yuen C, Rahardja S (2017) Indoor sound source localization with probabilistic neural network. IEEE Trans Ind Electron 65(8):6403–6413

    Article  Google Scholar 

  32. Zeinali Y, Story BA (2017) Competitive probabilistic neural network. Integr Comput Aided Eng 24(2):105–118

    Article  Google Scholar 

  33. Yao Y, Wang N (2020) Fault diagnosis model of adaptive miniature circuit breaker based on fractal theory and probabilistic neural network. Mech Syst Signal Process 142:106772

    Article  Google Scholar 

  34. Ahmadipour M, Hizam H, Othman ML, Radzi MAM, Murthy AS (2018) Islanding detection technique using slantlet transform and ridgelet probabilistic neural network in grid-connected photovoltaic system. Appl Energy 231:645–659

    Article  Google Scholar 

  35. Crombecq K, Laermans E, Dhaene T (2011) Efficient space-filling and non-collapsing sequential design strategies for simulation-based modeling. Eur J Oper Res 214(3):683–696

    Article  Google Scholar 

  36. Liu H, Ong Y-S, Cai J (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Weapons Engineering, Naval University of Engineering, Wuhan, 430033, China

    Dengjian Fang & Taotao Zhang

  2. College of Naval Architecture and Ocean Engineering, Naval University of Engineering, Wuhan, 430033, China

    Fan Wu

Authors
  1. Dengjian Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taotao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Taotao Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fang, D., Zhang, T. & Wu, F. An active-learning probabilistic neural network for feasibility classification of constrained engineering optimization problems. Engineering with Computers 38 (Suppl 4), 3237–3250 (2022). https://doi.org/10.1007/s00366-021-01441-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00366-021-01441-4

Keywords

Search

Navigation