Abstract
Although the CPU power of recent embedded systems has increased, their storage space is still limited. To overcome this limitation, most embedded devices are connected to a cloud server so they can outsource heavy calculations. However, some applications must handle private data, meaning internet connections are undesirable based on security concerns. Therefore, small devices that handle private data should be able to work without internet connections. This paper presents a limited modal regression model that restricts the number of internal units to a certain fixed number. Modal regression can be used for multivalued function approximation with limited sensory inputs. In this study, a kernel density estimator (KDE) with a fixed number of kernels called “limited KDE” was constructed. We will demonstrate how to implement the limited KDE and how to construct a lightweight algorithm for modal regression using a system-on-chip field-programmable gate array device.
A part of this research was supported by a Special grant of Chubu University.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Note that Gaussian kernel satisfies the condition for the reproduction kernel.
- 2.
Remember that \(\varvec{X}\) in Eq. (2) includes the output dimension and \(\varvec{X} = [\varvec{x}, y]^T\).
References
Cao, Y., He, H., Man, H.: SOMKE: kernel density estimation over data streams by sequences of self-organizing maps. IEEE Trans. Neural Netw. Learn. Syst. 23(8), 1254–1268 (2012). https://doi.org/10.1109/TNNLS.2012.2201167
Dunn, J.C.: A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J. Cybern. 3(3), 32–57 (1973). https://doi.org/10.1080/01969727308546046
Einbeck, J., Tutz, G.: Modelling beyond regression functions: an application of multimodal regression to speed flow data. Appl. Stat. 55(4), 461–475 (2006). https://doi.org/10.1111/j.1467-9876.2006.00547.x
Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101, 99–134 (1998). https://doi.org/10.1016/S0004-3702(98)00023-X
Lee, D., Noh, S., Min, S., Choi, J., Kim, J., Cho, Y., Sang, K.C.: LRFU: a spectrum of policies that subsumes the least recently used and least frequently used policies. IEEE Trans. Comput. 50(12), 1352–1361 (2001)
MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Cam, L.M.L., Neyman, J. (eds.) Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. University of California Press, Berkeley (1967)
Parzen, E.: On estimation of a probability density function and mode. Ann. Math. Stat. 33(3), 1065–1076 (1962). https://doi.org/10.1214/aoms/1177704472
Sasaki, H., Ono, Y., Sugiyama, M.: Modal regression via direct log-density derivative estimation. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds.) ICONIP 2016. LNCS, vol. 9948, pp. 108–116. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46672-9_13
Tax, D.M., Duin, R.P.: Support vector data description. Mach. Learn. 54(1), 45–66 (2004). https://doi.org/10.1023/B:MACH.0000008084.60811.49
Yamamoto, M, Yamauchi, K.: Swap kernel regression. In: Tetko, I.V., Kůrková, V., Karpov, P., Theis, F. (eds.) ICANN 2019. LNCS, vol. 11728, pp. 579–592. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30484-3_47
Yamauchi, K.: A Quick Maximum Power Point Tracking Method Using an Embedded Learning Algorithm for Photovoltaics on Roads, pp. 85–106. InTechOpen (2018). https://doi.org/10.5772/intechopen.79711
Yamauchi, K., Bhargav, V.N.: Minimum modal regression. In: Marsico, M.D., di Baja, G.S., Fred, A. (eds.) ICPRAM2018 7th International Conference on Pattern Recognition Applications and Methods, pp. 448–455 (2018)
Yao, W., Lindsay, B.G., Li, R.: Local modal regression. Stat. J. Nonparametr. 24(3), 647–663 (2012). https://doi.org/10.1080/10485252.2012.678848
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Watanabe, T., Yamauchi, K. (2019). Lightweight Modal Regression for Stand Alone Embedded Systems. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Lecture Notes in Computer Science(), vol 11954. Springer, Cham. https://doi.org/10.1007/978-3-030-36711-4_31
Download citation
DOI: https://doi.org/10.1007/978-3-030-36711-4_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36710-7
Online ISBN: 978-3-030-36711-4
eBook Packages: Computer ScienceComputer Science (R0)