Abstract
An effective solution to the tasks of continuous monitoring and aggregation querying of complex domain-meaningful concepts and patterns in environments featuring large continuously changing data sets is very important for many domains. Typical domains include: making financial decisions, integrating intelligence information from multiple sources, evaluating the effects of traffic controllers’ actions, detection of security threats in communication networks, planning and monitoring in robotics, and management of chronic patients in medical domains. In this paper, we present a general domain-independent method for an effective solution of these two tasks. Our method involves incremental creation of meaningful, interval-based abstractions, from raw, time-stamped data continuously arriving from multiple sources, which is supported by the accumulation and continuous validation of the created abstractions. We implemented our method in the Momentum system, which is an active knowledge-based time-oriented database—a temporal extension of the active-database concept that we propose for incremental application of knowledge to continuously arriving time-oriented data. We evaluated the Momentum system in a medical domain within a database of 1,000 patients monitored after bone-marrow transplantation, and a knowledge base of complex abstractions regarding more than 100 raw-data types and about 400 concept types derivable from them. Initial evaluations are highly encouraging with regards to the feasibility of the whole approach.
Similar content being viewed by others
References
ACT-NET (1996). The active database management system manifesto: A rulebase of ADBMS features. ACM SIGMOD Record, 25(3), 20–49 September.
Beck (1999). Extreme programming explained: Embrace change (1st ed.). Addison-Wesley Pub. Co.
Boaz, D., Balaban, M., & Shahar, Y. (2003). A temporal-abstraction rule language for medical databases. Proceeding of the workshop on Intelligent Data Analysis in Medicine and Pharmacology (IDAMAP), Protaras, Cyprus.
Boaz, D., & Shahar, Y. (2005). A distributed temporal-abstraction mediation architecture for medical databases. Artificial Intelligence in Medicine, 34(1), 3–24.
Chakravarty, S., & Shahar, Y. (2000). CAPSUL: A constraint-based specification of repeating patterns in time-oriented data. Annals of Mathematics and Artificial Intelligence (AMAI), 30, 3–22.
Forgy, C. L. (1982). RETE: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intelligence, 1982, 17–37.
Freeman, Hupfer, & Arnold (1999). JavaSpaces(TM) principles, patterns, and practice (1st ed.). Addison-Wesley Pub. Co.
Hightower, & Lesiecki (2001). Java tools for extreme programming: Mastering open source tools including ant, JUnit, and cactus (1st ed.). Wiley.
Kimball, R., & Ross, M. (2002). The data warehouse toolkit: The complete guide to dimensional modeling (2nd edn.). Wiley.
Nguyen, J. H., Shahar, Y., Tu, S. W., Das, A., & Musen, M. A. (1999). Integration of temporal reasoning and temporal-data maintenance into a reusable database mediator to answer abstract, time-oriented queries: The Tzolkin system. Journal of Intelligent Information Systems, 13(1/2), 121–145.
O’Connor, M. J., Grosso, W. E., Tu, S. W., & Musen, M. A. (2001). RASTA: A distributed temporal abstraction system to facilitate knowledge-driven monitoring of clinical databases. Proceedings of MEDINFO-2001, the Tenth World Congress on Medical Informatics (pp. 508–512). London, UK.
O’Connor, M. J., Tu, S. W., & Musen, M. A. (2002). The Chronus II temporal database mediator. Proceedings of the American Medical Informatics Association (AMIA) 2002 Annual Fall Symposium. San Antonio, Texas.
Paton, N. (Ed.) (1999). Active rules in database systems. Springer.
Shahar, Y. (1997). A framework for knowledge-based temporal abstraction. Artificial Intelligence, 90(1–2), 79–133.
Shahar, Y. (1998). Dynamic temporal interpretation contexts for temporal abstraction. Annals of Mathematics and Artificial Intelligence, 22(1–2), 159–192.
Shahar, Y., Chen, H., Stites, D. P., Basso, L. V., Kaizer, H., Wilson, D. M., et al. (1999). Semiautomated acquisition of clinical temporal-abstraction knowledge. Journal of the American Medical Informatics Association (JAMIA), 6, 494–511.
Shahar, Y., Goren-Bar, D., Boaz, D., & Tahan, G. (2006). Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data. Artificial Intelligence in Medicine 38(2), 115–135.
Shahar, Y., & Molina, M. (1998). Knowledge-based spatiotemporal linear abstraction. Pattern Analysis and Applications, 1(2), 91–104.
Shahar, Y., & Musen, M. A. (1996). Knowledge-based temporal abstraction in clinical domains. Artificial Intelligence in Medicine, 8, 267–298.
Spokoiny, A., & Shahar, Y. (2003). Momentum—An active time-oriented database for intelligent abstraction, exploration and analysis of clinical data. Proceeding of the workshop on Intelligent Data Analysis in Medicine and Pharmacology—IDAMAP 2003, at 9th Conference on Artificial Intelligence in Medicine Europe—Europe (AIME) ‘03. Protaras, Cyprus.
Spokoiny, A., & Shahar, Y. (2004). A time-oriented active database approach for intelligent abstraction, monitoring and querying of clinical data from multiple sources. Proceedings of the 11th World Congress on Medical Informatics—MEDINFO-04. San Francisco, California, USA.
Spokoiny, A., & Shahar, Y. (in press). Incremental application of knowledge to continuously arriving time-oriented data. Journal of Intelligent Information Systems.
van Beek, P. (1991). Temporal query processing with indefinite information. Artificial Intelligence in Medicine, 3, 325–339.
Widom, J., & Ceri, S. (1996). Active database systems: Triggers and rules for advanced database processing. San Mateo, California: Morgan Kaufmann.
Wiederhold, G. (1992). Mediators in the architecture of future information systems. IEEE Computer, 25, 38–50.
Wiederhold, G., & Genesereth, M. (1997). The conceptual basis of mediation services. IEEE Expert, 12(5), 38–47.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Spokoiny, A., Shahar, Y. An active database architecture for knowledge-based incremental abstraction of complex concepts from continuously arriving time-oriented raw data. J Intell Inf Syst 28, 199–231 (2007). https://doi.org/10.1007/s10844-006-0008-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10844-006-0008-x