Summary
In many industrial and medical diagnosis problems it is essential to investigate time series measurements collected to recognize existing or potential faults/diseases. Today this is usually done manually by humans. However the lengthy and complex nature of signals in practice often makes it a tedious and hard task to analyze and interpret available data properly even by experts with rich experiences. The incorporation of intelligent data analysis method such as case-based reasoning is showing strong benefit in offering decision support to technicians and clinicians for more reliable and efficient judgments.
This chapter addresses a general framework enabling more compact and efficient representation of practical time series cases capturing the most important characteristics while ignoring irrelevant trivialities. Our aim is to extract a set of qualitative, interpretable features from original, and usually real-valued time series data. These features should on one hand convey significant information to human experts enabling potential discoveries/findings and on the other hand facilitate much simplified case indexing and similarity matching in case-based reasoning. The road map to achieve this goal consists of two subsequent stages. In the first stage it is tasked to transform the time series of real numbers into a symbolic series by temporal abstraction or symbolic approximation. A few different methods are available at this stage and they are introduced in this chapter. Then in the second stage we use knowledge discovery method to identify key sequences from the transformed symbolic series in terms of their cooccurrences with certain classes. Such key sequences are valuable in providing concise and important features to characterize dynamic properties of the original time series signals. Four alternative ways to index time series cases using discovered key sequences are discussed in this chapter.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
A. Aamodt and E. Plaza. Case-based reasoning: foundational issues, methodological variations and systems approaches. AI Communications, 7:39–59, 1994.
Agrawal, R., Srikant, R.: Mining sequential patterns. In: Proceedings of the 11th International Conference on Data Engineering. (1995) 3–14
A. Apostolico, M.E. Bock, and S. Lonardi. Monotony of surprise and large-scale quest for unusual words. In: Proceedings of the 6th International conference on Research in Computational Molecular Biology, Washington, DC, pp. 22–31, 2002.
Bar-Shalom, Y. and X. Li, Estimation and Tracking: Principles, Techniques, and Software, Artech House, Boston, 1993.
E. Beckenstein, G. Bachman and L. Narici. Fourier and Wavelet Analysis, Springer, 2000.
R. Bellazzi, C. Larizza, ans A. Riva. Temporal abstractions for interpreting diabetic patients monitoring data. Intelligent Data Analysis, 2: 97–122, 1998.
I. Bichindaritz and E. Conlon. Temporal knowledge representation and organization for case-based reasoning. In Proc. TIME-96, IEEE Computer Society Press, Washington, DC, 1996, pp. 152–159.
H.A. Braun et al. Low-Dimensional Dynamics in Sensory Biology 2: Facial Cold Receptors of the Rat. J. of Comp. Neuroscience 7(1), pp. 17–32, 1999.
Chan, K.P., Fu, A.W.: Efficient time series matching by wavelets. In: Proceedings of the International Conference on Data Engineering. (1999) 126–133
J.P. Crutchfield and K. Young. Inferring statistical complexity. Phys. Rev. Lett., Vol. 63, No. 2, pp. 105–108, 1989.
Daw, C.S., Finney, C.E.A.: A review of symbolic analysis of experimental data. Review of Scientific Instruments, 74(2): 915–930, 2003.
Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery. In: Advances in Knowledge Discovery and Data Mining. MIT Press (1996) 1–36
Garofalakis, M.N., Rajeev, R., Shim, K.: SPIRIT: Sequential sequential pattern mining with regular expression constraints. In: Proceedings of the 25th International Conference on Very Large Databases. (1999) 223–234
J. Godelle and C. Letellier. Symbolic sequence statistical analysis for free liquid jets. Phys. Rev. E 62, Issue 6, pp. 7973–7981, 2000.
Gordon, N., A. Marrs and D. Salmond, Sequential Analysis of Nonlinear Dynamic Systems Using Particles and Mixtures, in: Nonlinear and Nonstationary Signal Processing, W. Fitzgerald, R. Smith, A. Walden, and P. Young, ed., Chapter 2, Cambridge University Press, Cambridge, 2001.
Hayashi, A., Mizuhara, Y., Suematsu, N.: Embedding time series data for classification. In: Perner, P., Imiya, A. (eds.): Proceedings of the IAPR International Conference on Machine Learning and Data Mining in Pattern Recognition. Leipzig (2005) 356–365
Hetland, M.L.: A survey of recent methods for efficient retrieval of similar time sequences. In: Last, M., Kandel, A., Bunke, H. (eds.): Data Mining in Time Series Databases. World Scientific (2004)
L.M. Hively, V.A. Protopopescu, and P.C. Gailey. Timely detection of dynamical change in scalp EEG signals. Chaos, Vol. 10, Issue 4, pp. 864–875, 2000.
M. Holschneider. Wavelet – An Analysis Tool. Oxford Science publications, 1995.
Huang, C.F., Chen, Y.C., Chen, A.P.: An association mining method for time series and its application in the stock prices of TFT-LCD industry. In: Perner, P. (ed.): Proceedings of the 4th Industrial Conference on Data Mining. Leipzig (2004)
Huhtala, Y., Kärkkäinen, J., Toivonen, H.: Mining for similarities in aligned time series using wavelets. In: Data Mining and Knowledge Discovery: Theory, Tools, and Technology. SPIE Proceedings Series, Vol. 3695. Orlando, FL (1999) 150–160
M.D. Jaere, A. Aamodt, and P. Skalle. Representing temporal knowledge for case-based prediction. In S. Craw and A. Preece, editors, Proceeding of the European Conference on Case-Based Reasoning, 2002, pp. 174–188.
J. Jarmulak, S. Craw, and R. Rowe. Genetic algorithms to optimize CBR retrieval. In E. Blanzieri and L. Portinale, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 136–147. Springer, 2000.
S. Kadar, J. Wang, and K. Showalter. Noise-supported travelling waves in sub-excitable media. Nature 391, pp. 770–772, 1998.
Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Locally adaptive dimensionality reduction for indexing large time series databases. In: Proceedings of ACM SIGMOD Conference on Management of Data. Santa Barbara, CA (2001) 151–162
Keogh, E., Chakrabarti, K., Pazzani, M., Mehrotra, S.: Dimensionality reduction for fast similarity search in large time series databases. Journal of Knowledge and Information Systems (2001)
J.-S. Kim et al. Decreased entropy of symbolic heart rate dynamics during daily activity as a predictor of positive head-up tilt test in patients with alleged neurocardiogenic syncope. Phys. Med. Biol. 45, pp. 3403–3412, 2000.
Last, M., Klein, Y., Kandel, A.: Knowledge discovery in time series databases. IEEE Trans. Systems, Man, and Cybernetics — Part B: Cybernetics 31 (2001) 160–169
Lee, S.K., White P.R.: The Enhancement of Impulse Noise And Vibration Signals For Fault Detection in Rotating and Reciprocating Machinery, Journal of Sound and Vibration 217 (1998), 485–505.
Lin, J.: Feature Extraction of Machine Sound Using Wavelet and Its Application in Fault Diagnosis, NDT&E International 34 (2001), 25–30.
S. Lonardi. Global detectors of unusual words: Design, implementation, and applications to pattern discovery in biosequences. Ph.D thesis, Department of Computer Sciences, Purdue University, 2001.
D. McSherry. Explaining the Pros andv Cons of conclusions in CBR. In P. Funk and P.A.G. Calero, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 317–330. Springer, 2004.
S. Montani, et al. Case-based retrieval to support the treatment of end stage renal failure patients, Artificial Intelligence in Press.
S. Montani and L. Portinale. Case based representation and retrieval with time dependent features. In Proceedings of the International Conference on Case-Based Reasoning, pages 353–367, Springer, 2005.
Nilsson, M., Funk, P.: A Case-Based Classification of Respiratory Sinus Arrhythmia. In P. Funk and P.A.G. Calero, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 673–685. Springer, 2004.
E. Olsson, P. Funk, and N. Xiong. Fault diagnosis in industry using sensor readings and case-based reasoning. Journal of Intelligent & Fuzzy Systems, 15:41–46, 2004.
Park, S., Chu, W.W., Yoon, J., Hsu, C.: Efficient search for similar subsequences of different lengths in sequence databases. In: Proceedings of the International Conference on Data Engineering. (2000) 23–32
P. Perner. Incremental learning of retrieval knowledge in a case-based reasoning system. In K. D. Ashley and D. G. Bridge, editors, Proceedings of the International Conference on Case-Based Reasoning, pages 422–436. Springer, 2003.
Pous, C., Colomer, J., and Melendez, J.: Extending a fault dictionary towards a case based reasoning system for linear electronic analog circuits diagnosis. In: Proceedings of the 7th European Conference on Case-Based Reasoning, Madrid, 2004, pp 748–762.
Pray, K.A., Ruiz, C.: Mining expressive temporal associations from complex data. In: Perner, P., Imiya, A. (eds.): Proceedings of the IAPR International Conference on Machine Learning and Data Mining in Pattern Recognition. Leipzig (2005) 384–394
Ray, A.: Symbolic dynamic analysis of complex systems for anomaly detection. Signal Processing 84 (2004) 1115–1130
R. Schmidt, B. Heindl, B. Pollwein, and L. Gierl. Abstraction of data and time for multiparametric time course prognoses. In: Advances of Case-Based Reasoning, LNAI 1168, Springer-Verlag, Berlin, 1996, pp. 377–391.
J. Lin, E. Keogh, S. Lonardi et al. A symbolic representation of time series, with implications for streaming algorithms. In: Proceedings of the 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, pages 2–11, 2003
G. Salton. Automatic information organization and retrieval. New York: McGraw-Hill, 1968.
Y. Shahar. A framework for knowledge-based temporal abstractions. Artificial Intelligence, 90:79–133, 1997.
Srikant, R., Agrawal, R.: Mining sequential patterns: Generalizations and performance improvements. In: Proceedings of the 5th International Conference on Extending Database Technology. (1996) 3–17
S.D. Stearns. Digital Signal Processing with Examples in Matlab. CRC Press, Florida, 2003
X.Z. Tang, E.R. Tracy, and R. Brown. Symbol statistics and spatio-temporal systems. Physica D, Vol. 102, Issue 3–4, pp. 253–261, 1997.
Tung, A.K.H., Lu, H., Han, J., Feng, L.: Breaking the barrier of transactions: Mining inter-transaction association rules. In: Proceedings of ACM Conference on Knowledge Discovery and Data Mining. (1999) 297–301
G. Tzanetakis, G. Essl, and P. Cook. Audio Analysis using the Discrete Wavelet Transform. In Proceedings of the WSES International Conference on Acoustics and Music: Theory and Applications (AMTA 2001) Skiathos, Greece, 2001.
Wu, Y., Agrawal, D., Abbadi, A. EI: A comparison of DFT and DWT based similarity search in time series databases. In: Proceedings of the 9th ACM CIKM Conference on Information and Knowledge Management. McLean, VA (2000) 488–495
Yoon, H., Yang, K., Shahabi, C.: Feature subset selection and feature ranking for multivariate time series. IEEE Trans. Knowledge and Data Engineering 17 (2005) 1186–1198
S. Zelikovitz and H. Hirsh. Integrating background knowledge into nearest-neighbor text classification. In S. Craw and A. Preece, editors, Proceedings of the European Conference on Case-Based Reasoning, pages 1–5. Springer, 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Funk, P., Xiong, N. (2008). Extracting Knowledge from Sensor Signals for Case-Based Reasoning with Longitudinal Time Series Data. In: Perner, P. (eds) Case-Based Reasoning on Images and Signals. Studies in Computational Intelligence, vol 73. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73180-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-73180-1_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73178-8
Online ISBN: 978-3-540-73180-1
eBook Packages: EngineeringEngineering (R0)