Skip to main content

Repeatable Functionalities in Complex Layers of Formal Neurons

  • Conference paper
  • First Online:

Part of the book series: Proceedings of the International Neural Networks Society ((INNS,volume 3))

Abstract

Complex layers of formal neurons can be designed on data sets built from a relatively small number of multidimensional feature vectors. Data sets with this structure can almost always be separated linearly. Genetic data sets typically have this property.

Maximizing the margins is a fundamental principle when designing linear classifiers (formal neurons) based on training sets consisting of a small number of multivariate feature vectors. Maximizing Euclidean (L2) margins is a basic concept in the support vector machines (SVM) method of classifiers designing. An alternative approach to designing formal neurons may be to maximize the margins based on the L1 norm. The margins of the L1 norm enable the design of complex layers of formal neurons.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Duda, O.R., Hart, P.E., Stork, D.G.: Pattern Classification. J. Wiley, New York (2001)

    MATH  Google Scholar 

  2. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2006)

    MATH  Google Scholar 

  3. Bobrowski, L.: Data Exploration and Linear Separability, pp. 1-172. Lambert (2019).

    Google Scholar 

  4. Boser, B.E., Guyon, I., Vapnik, V.N.: A training algorithm for optimal margin classifiers. In: Proceedings of the Fifth Annual Workshop of Computational Learning Theory, vol. 5, pp. 144–152. ACM, Pittsburgh (1992).

    Google Scholar 

  5. Bobrowski, L.: Complexes of low dimensional linear classifiers with L1 margins. In: Nguyen, N.T., Chittayasothorn, S., Niyato, D., Trawiński, B. (eds.) ACIIDS 2021. LNCS (LNAI), vol. 12672, pp. 29–40. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-73280-6_3

    Chapter  Google Scholar 

  6. Bobrowski, L.: Design of piecewise linear classifiers from formal neurons by some basis exchange technique. Pattern Recogn. 24(9), 863–870 (1991)

    Article  Google Scholar 

  7. Bobrowski, L.: Data Mining Based on Convex and Piecewise Linear (CPL) Criterion Functions (in Polish). Bialystok University of Technology Press, Bialystok (2005)

    Google Scholar 

  8. Rosenblatt, F.: Principles of Neurodynamics. Spartan Books, Washington (1962)

    MATH  Google Scholar 

  9. Bobrowski, L., Łukaszuk, T.: Relaxed linear separability (RLS) approach to feature (Gene) subset selection. In: Xia, X. (ed.)Selected Works in Bioinformatics, INTECH, pp. 103–118 (2011)

    Google Scholar 

  10. Simonnard, M.: Linear Programming. Prentice – Hall, New York (1966)

    Google Scholar 

  11. Kuncheva, L.: Combining Pattern Classifiers: Methods and Algorithms, 2nd edn. J. Wiley, New Jersey (2014)

    MATH  Google Scholar 

  12. Alon, U., et al.: Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. USA 96, 6745–6750 (1999)

    Article  Google Scholar 

  13. Petersen K.: Ergodic Theory (Cambridge Studies in Advanced Mathematics). Cambridge University Press, Cambridge (1990)

    Google Scholar 

  14. Collins, S.C., Mikhaleva, A., Vrcelj, K., et al.: Large-scale neuroanatomical study uncovers 198 gene associations in mouse brain morphogenesis. Nat. Commun. 10, 3465 (2019)

    Article  Google Scholar 

Download references

Acknowledgments

The presented study was supported by the grant WZ/WI-IIT/3/2020 from the Bialystok University of Technology and funded from the resources for research by the Polish Ministry of Science and Higher Education.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Leon Bobrowski .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bobrowski, L., Łukaszuk, T. (2021). Repeatable Functionalities in Complex Layers of Formal Neurons. In: Iliadis, L., Macintyre, J., Jayne, C., Pimenidis, E. (eds) Proceedings of the 22nd Engineering Applications of Neural Networks Conference. EANN 2021. Proceedings of the International Neural Networks Society, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-030-80568-5_36

Download citation

Publish with us

Policies and ethics