Kisung Seo
ABSTRACT
This paper introduces a symbolic regression based filter transform for convolutional neural network using CGP (Cartesian Genetic Programming). Symbolic regression is a powerful technique to discover analytic equations that describe data, which can lead to explainable models and the ability to predict unseen data. In contrast, neural networks have achieved amazing levels of accuracy on image recognition and natural language processing tasks, but they are often seen as black-box models that are difficult to interpret and typically extrapolate poorly. symbolic regression approaches to deep learning are underexplored.
- Kim S., Liu P. U., Mukherjee S., Gilbert M., Jing L., Ceperic V., and Soljacic M, Integration of Neural Netwrok-Based Symbolic Regression in Deep Learning for Scientific Discovery, IEEE Trans. On Neural Networks and Learning Systems, 32(9), 2021.Google Scholar
Cross Ref
- Petersen B. K., Larma M. L., Mundhenk T. Nathan, Santiago C. P., Kim S. K., and Kim J. T., Deep Symbolic Regression: Recovering Mathematical Expressions from Data Via Risk-Seeking Policy Gradients, In Proceedings of the conference on ICLR, 2021.Google Scholar
- He K., Zhang X., Ren S., Sun J., Deep residual learning for image recognition. CVPR, pp. 770--778, 2016.Google ScholarCross Ref
- Li W., Li W., Sun L., Wu M., Yu L., Liu J., Li Y. and Tiam S., Transformer-based model for symbolic regression via joint supervised learning, In Proceedings of the conference ICLR, 2023.Google Scholar
- Krizhevsky, A., Nair, V. and Hinton, G., The CIFAR-10 Dataset, https://www.cs.toronto.edu/~kriz/cifar.html, 2014Google Scholar
- Koza, J. R. Genetic Programming: On the Programming of Computers by Natural Selection, MIT Press, Cambridge, MA, USA, 1992.Google ScholarDigital Library
- Miller J. F, Thomson P., Cartesian Genetic Programming, In Proceedings of the 3rd European Conference on Genetic Programming, Springer, LNCS 1802, pp. 121--132, 2000.Google Scholar
- Seo, K. and Hyeon, B., 2014. Cartesian Genetic Programming Based Optimization and Prediction, Advanced in Intelligent Systems and Computing, Springer, Vol. 275, pp. 497--502, 2014.Google Scholar
Index Terms
- Toward Symbolic Regression based Model Transform for Convolutional Neural Network
Recommendations
Exploring hidden semantics in neural networks with symbolic regression
GECCO '22: Proceedings of the Genetic and Evolutionary Computation ConferenceMany recent studies focus on developing mechanisms to explain the black-box behaviors of neural networks (NNs). However, little work has been done to extract the potential hidden semantics (mathematical representation) of a neural network. A succinct ...
Scene text recognition using residual convolutional recurrent neural network
Text is a significant tool for human communication, and text recognition in scene images becomes more and more important. In this paper, we propose a residual convolutional recurrent neural network for solving the task of scene text recognition. The ...
Convolutional Neural Network Single-Point Control Model
ICNSER2019: Proceedings of the International Conference on Industrial Control Network and System Engineering ResearchThe artificial intelligence as-a-service represented by the convolutional neural network faces many security problems, such as the adversary bypassing the cloud access control to obtain the control of the convolutional neural network model. In view of ...
Comments