Skip to main content

Convolutional Neural Networks Considering Robustness Improvement and Its Application to Face Recognition

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2015)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9492))

Included in the following conference series:

  • 2398 Accesses

Abstract

This paper proposes a novel activation function to promote robustness to the outliers of the training samples. Data samples in the decision boundaries are weighted more by adding the derivatives of the sigmoid function outputs to avoid drastic update of the network weights. Therefore, the network becomes more robust to outliers and noisy patterns. We also present appropriate backpropagation learning algorithm for the convolutional neural networks. We evaluate the performance improvement by the proposed method on a face recognition task, and proved that it outperformed the state of art face recognition methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. LeCun, Y., Kavukcuoglu, K., Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE (2010)

    Google Scholar 

  2. LeCun, Y., Bengio, Y.: Convolutional networks for images, speech, and time series. In: The Handbook of Brain Theory and Neural Networks, vol. 3361, pp. 310 (1995)

    Google Scholar 

  3. Bouchain, D.: Character recognition using convolutional neural networks. In: Institute for Neural Information Processing, vol. 2007 (2006)

    Google Scholar 

  4. LeCun, Y., Huang, F.J., Bottou, L.: Learning methods for generic object recognition with invariance to pose and lighting. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004. IEEE (2004)

    Google Scholar 

  5. Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practices for convolutional neural networks applied to visual document analysis. In: 2013 12th International Conference on Document Analysis and Recognition. IEEE Computer Society (2003)

    Google Scholar 

  6. Khalajzadeh, H., Mansouri, M., Teshnehlab, M.: Hierarchical structure based convolutional neural network for face recognition. Int. J. Comput. Intell. Appl. 12(03), (2013)

    Google Scholar 

  7. Mamalet, F., Garcia, C.: Simplifying convnets for fast learning. In: Villa, A.E., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds.) ICANN 2012, Part II. LNCS, vol. 7553, pp. 58–65. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  8. Hebb, D.O: The Organization of Behavior. Wiley, New York (1949, 1968)

    Google Scholar 

  9. Soo-Young, L., Dong-Gyu, J.: Merging back-propagation and hebbian learning rules for robust classifications. Neural Netw. Official J. Int. Neural Netw. Soc. 9(7), 1213–1222 (1996)

    Article  Google Scholar 

  10. Shih, F., Fu, C., Zhang, K.: Multi-view face identification and pose estimation using B-spline interpolation. Inf. Sci. 169(3), 189–204 (2005)

    Article  MathSciNet  Google Scholar 

  11. Rinky, B., Mondal, P., Manikantan, K., Ramachandran, S.: DWT based feature extraction using edge tracked scale normalization for enhanced face recognition. Procedia Technol. 6, 344–353 (2012)

    Article  Google Scholar 

  12. Zuiderveld, K.: Contrast limited adaptive histogram equalization. In: Graphics Gems IV. Academic Press Professional, Inc. (1994)

    Google Scholar 

Download references

Acknowledgements

The research was partly supported by ‘Basic Science Research Program’, through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and future Planning (2013R1A2A2A01068687) (50%) and by the Industrial Strategic Technology Development Program (10044009) funded by the Ministry of Trade, Industry and Energy (MOTIE, Korea) (50 %).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minho Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Jalali, A., Jang, G., Kang, JS., Lee, M. (2015). Convolutional Neural Networks Considering Robustness Improvement and Its Application to Face Recognition. In: Arik, S., Huang, T., Lai, W., Liu, Q. (eds) Neural Information Processing. ICONIP 2015. Lecture Notes in Computer Science(), vol 9492. Springer, Cham. https://doi.org/10.1007/978-3-319-26561-2_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26561-2_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26560-5

  • Online ISBN: 978-3-319-26561-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics