Skip to main content

Advertisement

SpringerLink
Log in

Constrained-storage variable-branch neural tree for classification

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In this study, the constrained-storage variable-branch neural tree (CSVBNT) is proposed for pattern classification. In the CSVBNT, each internal node is designed as a single-layer neural network (SLNN) that is used to classify the input samples. The genetic algorithm is proposed to search for the proper number of output nodes in the output layer of the SLNN. Furthermore, the growing method is proposed to determine which node has the highest priority to split in the CSVBNT because of storage constraint. The growing method selects a node to split in the CSVBNT according to the classification error rate and computing complexity of the CSVBNT. In the experiments, CSVBNT has lower classification error rate than other NTs when they have the same computing time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Gelfand SB, Ravishankar CS, Delp EJ (1991) An iterative growing and pruning algorithm for classification tree design. IEEE Trans Pattern Anal Mach Intell 13(2):163–174

    Article  Google Scholar 

  2. Yildiz OT, Alpaydin E (2001) Omnivariate decision trees. IEEE Trans Neural Netw 12(6):1539–1546

    Article  Google Scholar 

  3. Zhao H, Ram S (2004) Constrained cascade generalization of decision trees. IEEE Trans Knowl Data Eng 16(6):727–739

    Article  Google Scholar 

  4. Gonzalo MM, Alberto S (2004) Using all data to generate decision tree ensembles. IEEE Trans Syst Man Cybern C Appl Rev 34(4):393–397

    Article  Google Scholar 

  5. Witold P, Zenon AS (2005) C-fuzzy decision trees. IEEE Trans Syst Man Cybern C Appl Rev 35(4):498–511

    Article  Google Scholar 

  6. Wang XB, Chen GQ, Ye F (2000) On the optimization of fuzzy decision trees. Fuzzy Sets Syst 112(3):117–125

    Article  MathSciNet  Google Scholar 

  7. Deffuant G (1990) Neural units recruitment algorithm for generation of decision trees. Proc Int Joint Conf Neural Netw 1:637–642

    Google Scholar 

  8. Lippmann R (1987) An introduction to computing with neural nets. IEEE Acoust Speech Signal Process Mag 4(2):4–22

    Google Scholar 

  9. Sankar A, Mammone R (1992) Neural tree networks. In: Sankar A (ed) Neural network: theory and application. Academic Press, San Diego, pp 281–302

    Google Scholar 

  10. Sethi IK, Yoo J (1997) Structure-driven induction of decision tree classifiers through neural learning. Pattern Recogn 30(11):1893–1904

    Article  Google Scholar 

  11. Sirat J, Nadal J (1990) Neural trees: a new tool for classification. Neural Netw 1:423–448

    Article  MathSciNet  Google Scholar 

  12. Li T, Tang YY, Fang FY (1995) A structure-parameter-adaptive (SPA) neural tree for the recognition of large character set. Pattern Recogn 28(3):315–329

    Article  Google Scholar 

  13. Zhang M, Fulcher J (1996) Face recognition using artificial neural networks group-based adaptive tolerance (GAT) trees. IEEE Trans Neural Netw 7:555–567

    Article  Google Scholar 

  14. Foresti GL, Pieroni GG (1998) Exploiting neural trees in range image understanding. Pattern Recogn Lett 19(9):869–878

    Article  Google Scholar 

  15. Song HH, Lee SW (1998) A self-organizing neural tree for large set pattern classification. IEEE Trans Neural Netw 9:369–380

    Article  Google Scholar 

  16. Foresti GL (1999) Outdoor scene classification by a neural tree based approach. Pattern Anal Appl 2:129–142

    Article  Google Scholar 

  17. Guo H, Gelfand SB (1992) Classification trees with neural networks feature extraction. IEEE Trans Neural Netw 3:923–933

    Article  Google Scholar 

  18. Foresti GL (2004) An adaptive high-order neural tree for pattern recognition. IEEE Trans Syst Man Cybern Part B Cybern 34:988–996

    Article  Google Scholar 

  19. Giles GL, Maxwell T (1987) Learning, invariance, and variable-branchization in high-order. Neural Netw 26:4972–4978

    Google Scholar 

  20. Maji P (2008) Efficient design of neural network tree using a single splitting criterion. Nerocomputing 71:787–800

    Article  Google Scholar 

  21. Utgoff PE (1998) Perceptron tree: a case study in hybrid concept representation. In: Proceedings of the VII national conference on artificial intelligence, pp 601–605

  22. Sirat JA, Nadal JP (1990) Neural tree: a new tool for classification. Network 1:423–438

    Article  MathSciNet  Google Scholar 

  23. Foresti GL, Micheloni C (2002) Generalized neural trees for pattern classification. IEEE Trans Neural Netw 13:1540–1547

    Article  Google Scholar 

  24. Micheloni C, Rani A, Kumarb S, Foresti GL (2012) A balanced neural tree for pattern classification. Neural Netw 27:81–90

    Article  Google Scholar 

  25. Goldberg D (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading

    MATH  Google Scholar 

  26. Koza J (1992) Genetic programming. MIT Press, Cambridge

    MATH  Google Scholar 

  27. Grossberg S (ed) (1988) Neural networks and natural intelligence. MIT Press, Cambridge

    MATH  Google Scholar 

  28. Rumelhart D, McClelland J (eds) (1986) Parallel distributed processing: explorations in microstructure of cognition. MIT Press, Cambridge

    Google Scholar 

  29. Zurada JM (ed) (1992) Introduction to neural systems. West, St. Paul

    Google Scholar 

  30. Angeline PJ, Saunders GM, Pollack JB (1994) An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Netw 5(1):54–64

    Article  Google Scholar 

  31. Mahmoudabadi H, Izadi M, Menhaj MB (2009) A hybrid method for grade estimation using genetic algorithm and neural networks. Comput Geosci 13:91–101

    Article  MATH  Google Scholar 

  32. Samanta B, Bandopadhyay S, Ganguli R (2004) Data segmentation and genetic algorithms for sparse data division in Nome placer gold grade estimation using neural network and geostatistics. Min Explor Geol 11(1–4):69–76

    Google Scholar 

  33. Chatterjee S, Bandopadhyay S, Machuca D (2010) Ore grade prediction using a genetic algorithm and clustering based ensemble neural network model. Math Geosci 42(3):309–326

    Article  MATH  Google Scholar 

  34. Tahmasebi P, Hezarkhani A (2009) Application of optimized neural network by genetic algorithm, IAMG09. Stanford University, Stanford

    Google Scholar 

  35. Stallkamp J, Schlipsing M, Salmen J, Igel C (2011) The German traffic sign recognition benchmark: a multi-class classification competition. In: International joint conference on neural networks

  36. Krizhevsky A (2009) Learning multiple layers of features from tiny images. Master’s thesis, Computer Science Department, University of Toronto

  37. Gonzalez RC, Woods RE (1992) Digital image processing. Addison-Wesley, Boston

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Digital Content of Application and Management, Wenzao Ursuline University of Languages, 900 Mintsu 1st Road, Kaohsiung, 807, Taiwan, ROC

    Shiueng-Bien Yang

Authors
  1. Shiueng-Bien Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiueng-Bien Yang.

Ethics declarations

Conflict of interest

Author declares that he has no conflict of interest in this manuscript.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, SB. Constrained-storage variable-branch neural tree for classification. Neural Comput & Applic 31, 3665–3680 (2019). https://doi.org/10.1007/s00521-017-3315-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-3315-y

Keywords

Search

Navigation