Han-Gyu Kim
ABSTRACT
In this work, we use two different types of recurrent neural networks (RNNs) to predict medical examination results of a subject given the previous measurements. The first one is a simple recurrent network (SRN) which models temporal trajectories of a data sequence to infer the unknown future observation, and the second one is a long short-term memory (LSTM) that enables modeling the longer trajectories by exploiting forgetting switches. The non-linear, temporal evolution of medical status of a human subjects are approximated by the RNNs, and the prediction of the future measurement becomes more accurate than those of the linear approximation method. The performance evaluation experiments are carried out on the real medical examination data, and the proposed methods show superior performances over the linear regression method. For the subjects who have abnormal behaviors in their medical examination results, the performance improvements are much more significant, so the proposed methods are expected to be used in detecting potential patients to provide earlier diagnosis and proper treatments for their illnesses.
- M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467, 2016.Google Scholar
- L. Ahmad, A. Eshlaghy, A. Poorebrahimi, M. Ebrahimi, and A. Razavi. Using three machine learning techniques for predicting breast cancer recurrence. Journal of Health and Medical Informatics, 4(124), 4 2013.Google Scholar
- C. Bishop. Pattern Recognition and Machine Learning. Springer, January 2006. Google ScholarDigital Library
- G. E. Dahl, D. Yu, L. Deng, and A. Acero. Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Transactions on Audio, Speech, and Language Processing, 20(1):30--42, 2012. Google ScholarDigital Library
- J. L. Elman. Distributed representations, simple recurrent networks, and grammatical structure. Machine learning, 7(2--3):195--225, 1991. Google ScholarDigital Library
- A. Graves, A.-R. Mohamed, and G. Hinton. Speech recognition with deep recurrent neural networks. In 2013 IEEE international conference on acoustics, speech and signal processing, pages 6645--6649. IEEE, 2013.Google ScholarCross Ref
- K. Greff, R. K. Srivastava, J. Koutník, B. R. Steunebrink, and J. Schmidhuber. LSTM: A search space odyssey. arXiv preprint arXiv:1503.04069, 2015.Google Scholar
- P. Hachesu, M. Ahmadi, S. Alizadeh, and F. Sadoughi. Use of data mining techniques to determine and predict length of stay of cardiac patients. Healthcare Informatics Research, 19(2):121--129, 6 2013.Google ScholarCross Ref
- G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6):82--97, 2012.Google ScholarCross Ref
- S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735--1780, 1997. Google ScholarDigital Library
- S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167, 2015.Google Scholar
- A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097--1105, 2012. Google ScholarDigital Library
- J. Lee, J. S. Lee, S.-H. Park, S. A. Shin, and K. Kim. Cohort profile: The national health insurance service-national sample cohort (NHIS-NSC), south korea. International Journal of Epidemiology, pages 1--8, 1 2016.Google ScholarCross Ref
- J. Oh and B. Kim. Prediction model for demands of the health meteorological information using a decision tree method. Asian Nursing Research, 4(3):151--162, 9 2010.Google ScholarCross Ref
- T.-H. Wen, M. Gasic, N. Mrksic, P.-H. Su, D. Vandyke, and S. Young. Semantically conditioned LSTM-based natural language generation for spoken dialogue systems. arXiv preprint arXiv:1508.01745, 2015.Google Scholar
- F. Wilcoxon. Individual comparisons by ranking methods. Biometrics bulletin, 1(6):80--83, 1945.Google ScholarCross Ref
- X. Yan. Linear regression analysis: theory and computing. World Scientific, 2009. Google ScholarDigital Library
- K. Yao, B. Peng, Y. Zhang, D. Yu, G. Zweig, and Y. Shi. Spoken language understanding using long short-term memory neural networks. In Spoken Language Technology Workshop (SLT), 2014 IEEE, pages 189--194. IEEE, 2014.Google ScholarCross Ref
- W. Zaremba, I. Sutskever, and O. Vinyals. Recurrent neural network regularization. arXiv preprint arXiv:1409.2329, 2014.Google Scholar
Index Terms
- Medical examination data prediction using simple recurrent network and long short-term memory
Recommendations
On extended long short-term memory and dependent bidirectional recurrent neural network
Highlights- This work did unprecedented analysis on the memory property of RNN cells.
- The work develops extended LSTM that retains longer memory than previous RNN cells.
- A new robust RNN model called dependent BRNN is proposed.
- The ...
AbstractIn this work, we first analyze the memory behavior in three recurrent neural networks (RNN) cells; namely, the simple RNN (SRN), the long short-term memory (LSTM) and the gated recurrent unit (GRU), where the memory is defined as a function that ...
Long short-term memory recurrent neural network architectures for Urdu acoustic modeling
Recurrent neural networks (RNNs) have achieved remarkable improvements in acoustic modeling recently. However, the potential of RNNs have not been utilized for modeling Urdu acoustics. The connectionist temporal classification and attention based RNNs ...
An Intelligent Recurrent Neural Network with Long Short-Term Memory (LSTM) BASED Batch Normalization for Medical Image Denoising
The process of denoising of medical images that are corrupted by noise is considered as a long established setback in the signal or image processing domain. An effective system for denoising in order to remove white, salt and also pepper noises by means ...
Comments