Skip to main content
SpringerLink
Log in

Structure parameter estimation method for microwave device using dimension reduction network

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Gaussian process (GP) is a multi-layer perceptron neural network (NN) with infinite units in its hidden layer that could learn effectively, so as a machine learning (ML) method, it has been a sought-after surrogate model in electromagnetics (EM) field. GP can implement complex covariance functions or insert itself into a more complicated probability structure to improve predictive function. When handling the high-dimensional data, however, GP still causes some problems, e.g., precise and efficiency degradation. Hence, we propose a dimension reduction network structure based on GP to strengthen its ability of feature extraction and apply the approach into the inverse surrogate models of microwave devices. In this model, the compressed representation process of input features is dependent on a multi-layer extreme learning machine (ML-ELM), which stacks multiple ELMs-based autoencoders (AEs) by nonorthogonal random parameters including weights and biases of hidden layers. The novelties of this paper are as follows: (1) enormous unlabeled data satisfied with designed requirements are generated randomly, and they are then used to train the parameters of ML-ELM except the last layer to improve its performance, instead of random determination of its weights and biases; (2) parameters of the last layer of the ML-ELM and hyperparameters of GP are fine-tuned by particle swarm optimization (PSO) algorithm based on some labeled data; and (3) we also study on the ML-ELM architecture deeply and draw some rewarding conclusions based on different experimental results of some typical testing functions. Empirical study on the triple-band microwave antenna demonstrates that compared with GP, predictive accuracy of the proposed method is high, considering about compressing for dimensionality of the same data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Ding WT, Tian YB, Li PF et al (2022) Antenna optimization based on master-apprentice broad learning system. Int J Mach Learn Cybern 13(2):461–470

    Article  Google Scholar 

  2. Khatab ZE, Gazestani AH, Ghorashi SA et al (2021) A fingerprint technique for indoor localization using autoencoder based semi-supervised deep extreme learning machine. Signal Process 181:107915

    Article  Google Scholar 

  3. Xiao LY, Shao W, Ding X et al (2019) Multigrade artificial neural network for the design of finite periodic arrays. IEEE Trans Antennas Propag 67(5):3109–3116

    Article  Google Scholar 

  4. Fourati H, Maaloul R, Chaari L (2021) A survey of 5G network systems: challenges and machine learning approaches. Int J Mach Learn Cybern 12(2):385–431

    Article  Google Scholar 

  5. Pitra Z, Bajer L, Holena M (2015) Comparing SVM, gaussian process and random forest surrogate models for the CMA-ES. In: ITAT (pp 186–193), Slovensky Raj, Slovakia

  6. Sun FY, Tian YB, Ren ZL (2016) Modeling the resonant frequency of compact microstrip antenna by the PSO-based SVM with the hybrid kernel function. Int J Numer Model Electron Networks Devices Fields 29(6):1129–1139

    Article  Google Scholar 

  7. Fu H, Vong CM, Wong PK et al (2016) Fast detection of impact location using kernel extreme learning machine. Neural Comput Appl 27(1):121–130

    Article  Google Scholar 

  8. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501

    Article  Google Scholar 

  9. Zhu J, Fox JJ, Yi N et al (2019) Structural design for stretchable microstrip antennas. ACS Appl Mater Interfaces 11(9):8867–8877

    Article  Google Scholar 

  10. Zhang G, Cui D, Mao S et al (2020) Unsupervised feature learning with sparse Bayesian auto-encoding based extreme learning machine. Int J Mach Learn Cybern 11(7):1557–1569

    Article  Google Scholar 

  11. Wilson A, Nickisch H (2015) Kernel interpolation for scalable structured Gaussian processes (KISS-GP). In: International In: Conference on Machine Learning (pp 1775–1784), Lille, France

  12. Bajer L, Pitra Z, Repický J et al (2019) Gaussian process surrogate models for the CMA evolution strategy. Evol Comput 27(4):665–697

    Article  Google Scholar 

  13. Burt D, Rasmussen CE, Van Der Wilk M (2019) Rates of convergence for sparse variational Gaussian process regression. In: International Conference on Machine Learning (pp 862–871), Taiwan, China

  14. Rasmussen CE (2003) Gaussian processes in machine learning. In: Summer school on machine learning (pp 63–71). Springer, Berlin, Heidelberg

  15. Jacobs JP (2015) Efficient resonant frequency modeling for dual-band microstrip antennas by gaussian process regression. IEEE Trans Antennas Propag 14(3):337–341

    Article  Google Scholar 

  16. Cardona HDV, Orozco ÁA, Álvarez MA (2016) Multi-output Gaussian processes for enhancing resolution of diffusion tensor fields. In: The 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp 1111–1114), Florida, USA

  17. Fan X, Tian YB, Zhao Y (2018) Optimal design of microwave devices by fitness-estimation-based particle swarm optimization algorithm. Appl Comput Electromagn Soc J 33(11):1259–1267

    Google Scholar 

  18. Wilson AG, Hu Z, Salakhutdinov R, et al (2016) Deep kernel learning Artificial intelligence and statistics. In: PMLR (pp 370–378), New York, USA

  19. Huang G, Song S, Gupta JND et al (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44(12):2405–2417

    Article  Google Scholar 

  20. Kasun LLC, Zhou H, Huang GB et al (2013) Representational learning with ELMs for big data. Intell Syst 28(6):31–34

    Google Scholar 

  21. Vincent P, Larochelle H, Lajoie I, et al (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(12).

  22. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786): 504–507

  23. Kasun LLC, Yang Y, Huang GB et al (2016) Dimension reduction with extreme learning machine. IEEE Trans Image Process 25(8):3906–3918

    Article  MathSciNet  MATH  Google Scholar 

  24. Abu AO, Abo-Hammour Z, Momani S et al (2012) Solving singular two-point boundary value problems using continuous genetic algorithm. Abstr Appl Anal 2012:25

    MathSciNet  MATH  Google Scholar 

  25. Abo-Hammour Z, Abu AO, Momani S et al (2014) Optimization solution of Troesch’s and Bratu’s problems of ordinary type using novel continuous genetic algorithm. Discret Dyn Nat Soc 2014:15

    Article  MathSciNet  MATH  Google Scholar 

  26. Arqub AO, Abo-Hammour Z (2014) Numerical solution of systems of second-order boundary valueproblems using continuous genetic algorithm. Inf Sci 279:396–415

    Article  MATH  Google Scholar 

  27. Abo-Hammour Z, Arqub AO, Alsmadi O et al (2014) An optimization algorithm for solving systems of singular boundary value problems. Appl Math Inform Sci 8(6):2809–2821

    Article  MathSciNet  Google Scholar 

  28. Chen XZ, Tian YB, Zhang TL et al (2020) Differential evolution based manifold Gaussian process machine learning for microwave Filter’s parameter extraction. IEEE Access 8:146450–146462

    Article  Google Scholar 

  29. Fan J, Zhang Q, Zhu J et al (2020) Robust deep auto-encoding Gaussian process regression for unsupervised anomaly detection. Neurocomputing 376:180–190

    Article  Google Scholar 

  30. Eberhart R, Kennedy J (1995) Particle swarm optimization. In: IEEE international conference on neural networks (pp 1942–1948), Perth, Western Australia

  31. Marini F, Walczak B (2015) Particle swarm optimization (PSO). A tutorial-ScienceDirect. Chemom Intell Lab Syst 149:153–165

    Article  Google Scholar 

  32. Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning. MIT press, Cambridge

    MATH  Google Scholar 

  33. Chakraborty S, Chowdhury R (2019) Graph-theoretic-approach-assisted Gaussian process for nonlinear stochastic dynamic analysis under generalized loading. J Eng Mech 145(12):04019105

    Google Scholar 

  34. Kuipers L, Niederreiter H (2012) Uniform distribution of sequences. Courier Corporation

  35. Jorgensen B (2012) Statistical properties of the generalized inverse Gaussian distribution. Springer

  36. Kiche J, Ngesa O, Orwa G (2019) On generalized gamma distribution and its application to survival data. Int J Stat Prob 8(5):85–102

    Article  Google Scholar 

  37. Floudas CA, Pardalos PM, Adjiman C, et al (2013) Handbook of test problems in local and global optimization. Springer

  38. Molga M, Smutnicki C (2005) Test functions for optimization needs. Test Funct Optim Needs 101:48

    Google Scholar 

  39. Back T (1996) Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford University Press

  40. Dixon LCW (1978) The global optimization problem. An introduction. Toward Global Optim 2:1–15

    Google Scholar 

  41. PichenyV WT, Ginsbourger D (2013) A benchmark of kriging-based infill criteria for noisy optimization. Struct Multidiscip Optim 48(3):607–626

    Article  Google Scholar 

  42. Kumar A, Jhanwar D, Sharma MM (2017) A compact printed multistubs loaded resonator rectangular monopole antenna design for multiband wireless systems. Int J RF Microwave Comput Aided Eng 27(9):e21147

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the scientific research capacity improvement project of key developing disciplines in Guangdong Province of China under No. 2021ZDJS057, the special projects in key fields of Guangdong Universities of China under No. 2022ZDZX1020, and the Tertiary Education Scientific research project of Guangzhou Municipal Education Bureau of China under No. 202234598.

Author information

Author notes

  1. Shudan Han and Yubo Tian are co-first authors.

Authors and Affiliations

  1. School of Electronics and Information, Jiangsu University of Science and Technology, Zhenjiang, 212003, China

    Shudan Han

  2. School of Information and Communication Engineering, Guangzhou Maritime University, Guangzhou, 510725, China

    Yubo Tian

Authors
  1. Shudan Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yubo Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yubo Tian.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (RAR 489996 kb)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Han, S., Tian, Y. Structure parameter estimation method for microwave device using dimension reduction network. Int. J. Mach. Learn. & Cyber. 14, 1285–1301 (2023). https://doi.org/10.1007/s13042-022-01698-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01698-1

Keywords

Search

Navigation