Abstract
Contextual neural networks utilizing conditional multi-step aggregation functions have many useful properties. For example, their ability to decrease the activity between internal neuron connections may decrease computational costs, whereas their built-in automatic selection of attributes required for proper classification can simplify problem setup. The research of contextual neural networks was motivated by a limited number of satisfactory machine learning solutions providing these features. An implementation of the CxNN model in the H2O.ai machine learning framework was also developed to validate the method. In this article we explain relevant terms and the implementation of contextual neural networks as well as conditional multi-step aggregation functions. To validate the solution, experiments and their results are presented for selected UCI benchmarks and Cancer Gene Expression Microarray data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Richter, A.N., Khoshgoftaar, T.M., Landset, S., Hasanin, T.: A multi-dimensional comparison of toolkits for machine learning with Big Data. In: IEEE International Conference on Information Reuse and Integration, pp. 1–8, IEEE, San Francisco (2015)
Ng, S.S.Y., Zhu, W., Tang, W.W.S., Wan, L.C.H., Wat, A.Y.W.: An independent study of two deep learning platforms - H2O and SINGA. In: International Conference on Industrial Engineering and Engineering Management, IEEM 2016, pp 1–5. IEEE Press, Bali (2016)
Cook, D.: Practical Machine Learning with H2O. Powerful, Scalable Techniques for Deep Learning and AI. O’Reilly Media, Beijing (2016)
Liang, M., Trejo, C., Muthu, L., Ngo, L.B., Luckow A., Apon, A.W.: Evaluating R-based Big Data analytic frameworks. In: IEEE International Conference on Cluster Computing (CLUSTER), pp. 1–2, IEEE, Chicago (2015)
H2O.ai homepage. https://www.h2o.ai/company/h2o-ai-partners-with-ibm-to-bring-enterprise-ai-to-ibm-power-systems/. Accessed 31 Oct 2018
Domingos, S.L., Carvalho, R.N., Carvalho, R.S., Ramos, G.N.: Identifying IT purchases anomalies in the Brazilian government procurement system using deep learning. In: 15th IEEE International Conference on Machine Learning and Applications (ICMLA) (2016)
Grolinger, K., Capretz, M.A.M., Seewald, L.: Energy consumption prediction with Big Data: balancing prediction accuracy and computational resources. In: IEEE International Congress on Big Data (BigData Congress), pp. 1–8 (2016)
Suleiman, D., Al-Naymat, G.: SMS spam detection using H2O framework. In: Procedia Computer Science, vol. 113, pp. 154–161 (2017)
H2O.ai 3.10.0.3 documentation. https://h2o-release.s3.amazonaws.com/h2o/rel-turing/3/docs-website/h2o-docs/index.html
Huk, M.: Backpropagation generalized delta rule for the selective attention Sigma-if artificial neural network. Int. J. Appl. Math. Comput. Sci. 22, 449–459 (2012)
Huk, M.: Learning distributed selective attention strategies with the Sigma-if neural network. In: Akbar, M., Hussain, D. (eds.) Advances in Computer Science and IT, pp. 209–232. InTech, Vukovar (2009)
Szczepanik, M., Jóźwiak, I.: Data management for fingerprint recognition algorithm based on characteristic points’ groups. In: Pechenizkiy, M., Wojciechowski, M. (eds.) New Trends in Databases and Information Systems. Advances in Intelligent Systems and Computing, vol. 185, pp. 425–432. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-32518-2_40
Huk, M.: Context-related data processing with artificial neural networks for higher reliability of telerehabilitation systems. In: 17th International Conference on E-health Networking, Application & Services (HealthCom), pp. 217–221. IEEE Computer Society, Boston (2015)
Huk, M., Kwasnicka, H.: The concept and properties of Sigma-if neural network. In: Ribeiro, B., Albrecht, R.F., Dobnikar, A., Pearson, D.W., Steele, N.C. (eds.) Adaptive and Natural Computing Algorithms, pp. 13–17. Springer, Vienna (2005). https://doi.org/10.1007/3-211-27389-1_4
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)
Huk, M.: Sigma-if neural network as the use of selective attention technique in classification and knowledge discovery problems solving. Annales UMCS Sectio AI - Informatica 4(2), 121–131 (2006)
Huk, M.: Notes on the generalized backpropagation algorithm for contextual neural networks with conditional aggregation functions. J. Intell. Fuzzy Syst. 32, 1365–1376 (2017)
Huk, M.: Manifestation of selective attention in Sigma-if neural network. In: 2nd International Symposium Advances in Artificial Intelligence and Applications, International Multiconference on Computer Science and Information Technology, IMCSIT/AAIA 2007, vol. 2, pp. 225–236 (2007)
Raczkowski, D., Canning, A.: Thomas-Fermi charge mixing for obtaining self-consistency in density functional calculations. Phys. Rev. B 64, 121101–121105 (2001)
UCI Machine Learning Repository. http://archive.ics.uci.edu/ml
Armstrong, S.A.: MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat. Genet. 30, 41–47 (2002)
Janusz, B.J., Wołk, K.: Implementing contextual neural networks in distributed machine learning framework. In: Nguyen, N.T., Hoang, D.H., Hong, T.-P., Pham, H., Trawiński, B. (eds.) ACIIDS 2018. LNCS (LNAI), vol. 10752, pp. 212–223. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75420-8_20
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wołk, K., Burnell, E. (2019). Implementation and Analysis of Contextual Neural Networks in H2O Framework. In: Nguyen, N., Gaol, F., Hong, TP., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2019. Lecture Notes in Computer Science(), vol 11432. Springer, Cham. https://doi.org/10.1007/978-3-030-14802-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-14802-7_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-14801-0
Online ISBN: 978-3-030-14802-7
eBook Packages: Computer ScienceComputer Science (R0)