Abstract
Recently, the classification of multivariate time series has attracted much attention in the field of machine learning and data mining, due to its wide application values in biomedicine, finance, industry and so on. During the last decade, deep learning has achieved great success in many tasks. However, while many studies have applied deep learning to time series classification, few works can provide good interpretability. In this paper, we propose a deep sequence model with built-in interpretability by fusing deep learning with prototype learning, aiming to achieve interpretable classification of multivariate time series. In particular, an input sequence is classified by being compared with a set of prototypes, which are also sequences learned by the developed model, i.e., exemplary cases in the problem domain. We use the matched subset of the MIMIC-III Waveform Database to evaluate the proposed model and compare it with several baseline models. Experimental results show that our model can not only achieve the best performance but also provide good interpretability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Senin, P., Malinchik, S.: SAX-VSM: interpretable time series classification using sax and vector space model. In: ICDM 2013, pp. 1175–1180 (2013)
Grabocka, J., Schilling, N., Wistuba, M., Schmidt-Thieme, L.: Learning time-series shapelets. In: KDD 2014, pp. 392–401 (2014)
Cui, Z., Chen, W., Chen, Y.: Multi-scale convolutional neural networks for time series classification. arXiv preprint arXiv:1603.06995 (2016)
Zheng, Y., Liu, Q., Chen, E., Ge, Y., Zhao, J.L.: Time series classification using multi-channels deep convolutional neural networks. In: Li, F., Li, G., Hwang, S., Yao, B., Zhang, Z. (eds.) WAIM 2014. LNCS, vol. 8485, pp. 298–310. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08010-9_33
Assaf, R., Schumann, A.: Explainable deep neural networks for multivariate time series predictions. In: IJCAI 2019, pp. 6488–6490 (2019)
Wu, M., Hughes, M.C., Parbhoo, S., Zazzi, M., Roth, V., Doshi-Velez, F.: Beyond sparsity: tree regularization of deep models for interpretability. In: AAAI 2018, pp. 1670–1678 (2018)
Montavon, G., Samek, W., Müller, K.-R.: Methods for interpreting and understanding deep neural networks. Digit. Signal Process. 73, 1–15 (2018)
Vaswani, A., et al.: Attention is All you Need. In: NIPS 2017, pp. 5998–6008 (2017)
Kolodner, J.L.: An introduction to case-based reasoning. Artif. Intell. Rev., 6(1), 3–34 (1992)
Li, O., Liu, H., Chen, C., Rudin, C.: Deep learning for case-based reasoning through prototypes: a neural network that explains its predictions. In: AAAI 2018, pp. 3530–3537 (2018)
Ming, Y., Xu, P., Qu, H., Ren, L.: Interpretable and steerable sequence learning via prototypes. In: KDD 2019, pp. 903–913 (2019)
Gee, A.H., García-Olano, D., Ghosh, J., Paydarfar, D.: Explaining deep classification of time-series data with learned prototypes. In: KHD@IJCAI, pp. 15–22 (2019)
Lines, J., Bagnall, A.: Time series classification with ensembles of elastic distance measures. Data Min. Knowl. Disc. 29(3), 565–592 (2014). https://doi.org/10.1007/s10618-014-0361-2
Wistuba, M., Grabocka, J., Schmidt-Thieme, L.: Ultra-fast shapelets for time series classification. arXiv preprint arXiv:1503.05018(2015)
Ghalwash, M.F., Obradovic, Z.: Early classification of multivariate temporal observations by extraction of interpretable shapelets. BMC Bioinform. 13, 195 (2012)
Ye, L., Keogh, E.J.: Time series shapelets: a new primitive for data mining. In: KDD 2009, pp. 947–956 (2009)
Zheng, Y., Liu, Q., Chen, E., Ge, Y., Zhao, J.L.: Exploiting multi-channels deep convolutional neural networks for multivariate time series classification. Front. Comput. Sci., 10(1), 96–112 (2016). https://doi.org/10.1007/s11704-015-4478-2
Zhao, B., Huanzhang, L., Chen, S.: Convolutional neural networks for time series classification. J. Syst. Eng. Electron. 28(1), 162–169 (2017)
Zhang, C., et al.: A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data. In: AAAI 2019, pp. 1409–1416 (2019)
Liu, C.-L., Hsaio, W.-H., Yao-Chung, T.: Time series classification with multivariate convolutional neural network. IEEE Trans. Ind. Electron. 66(6), 4788–4797 (2019)
Guo, T., Lin, T., Antulov-Fantulin, N.: Exploring interpretable LSTM neural networks over multi-variable data. In: ICML 2019, pp. 2494–2504 (2019)
Sturm, I., Bach, S., Samek, W., Müller, K.-R.: Interpretable Deep Neural Networks for Single-Trial EEG Classification. CoRR abs/1604.08201 (2016)
Strobelt, H., Gehrmann, S., Pfister, H., Rush, A.M.: LSTMVis: a tool for visual analysis of hidden state dynamics in recurrent neural networks. IEEE Trans. Vis. Comput. Graph., 24(1), 667–676 (2018)
Goodfellow, S., Goodwin, A., Eytan, D., Greer, R., Mazwi, M., Laussen, P.: Towards understanding ECG rhythm classification using convolutional neural networks and attention mappings. In: MLHC 2018, pp. 83–101 (2018)
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., Cottrell, G.W.: A dual-stage attention-based recurrent neural network for time series prediction. In: IJCAI 2017, pp. 2627–2633 (2017)
Bai, T., Zhang, S., Egleston, B.L.: Interpretable representation learning for healthcare via capturing disease progression through time. In: KDD 2018, pp. 43–51 (2018)
Johnson, A.E.W., et al.: MIMIC-III, a freely accessible critical care database. Sci. Data (2016). https://doi.org/10.1038/sdata.2016.35
Choi, E., Bahadori, M.T., Schuetz, A., Stewart, W.F., Sun, J.: Doctor AI: predicting clinical events via recurrent neural networks. In: MLHC 2016, pp. 301–318 (2016)
Acknowledgments
This work is partially supported by the National Natural Science Foundation of China (No. 61725205, 617772428), and the Fundamental Research Funds for the Central Universities (No. 3102019AX10).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ma, D., Wang, Z., Xie, J., Guo, B., Yu, Z. (2020). Interpretable Multivariate Time Series Classification Based on Prototype Learning. In: Yu, Z., Becker, C., Xing, G. (eds) Green, Pervasive, and Cloud Computing. GPC 2020. Lecture Notes in Computer Science(), vol 12398. Springer, Cham. https://doi.org/10.1007/978-3-030-64243-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-64243-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64242-6
Online ISBN: 978-3-030-64243-3
eBook Packages: Computer ScienceComputer Science (R0)