Abstract
As information and communication technologies advance, large amounts of data are created everyday. The demands for processing such big data are also increasing. To meet them, the MapReduce framework has been proposed and is now widely used. On the other hand, a rule-based system is used to implement such an intelligent system as an expert system. For applying a rule-based system to process large amounts of data, we propose a method that implements a rule system based on the MapReduce framework. We constructed a simple rule system using Hadoop, which is an open source implementation of the MapReduce framework, and compared several methods of executing a rule system. Our experimental results indicate the potential of a rule system implemented using the MapReduce framework.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Apache hadoop, http://hadoop.apache.org/
Bǎdicǎ, C., Braubach, L., Paschke, A.: Rule-based distributed and agent systems. In: Bassiliades, N., Governatori, G., Paschke, A. (eds.) RuleML 2011 - Europe. LNCS, vol. 6826, pp. 3–28. Springer, Heidelberg (2011)
Cao, B., Yin, J., Zhang, Q., Ye, Y.: A MapReduce-based architecture for rule matching in production system. In: IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp. 790–795 (2010)
Dean, J., Ghemawat, S.: MapReduce: Simplified data processing on large clusters. In: OSDI 2004: 6th Symposium on Operating Systems Design and Implementation, pp. 137–150 (2004)
Forgy, C.: Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intelligence 19(1), 17–37 (1982)
Husain, M., McGlothlin, J., Masud, M., Khan, L., Thuraisingham, B.: Heuristics-based query processing for large RDF graphs using cloud computing. IEEE Transactions on Knowledge and Data Engineering 23(9), 1312–1327 (2011)
Ishida, T.: Parallel rule firing in production systems. IEEE Transactions on Knowledge and Data Engineering 3(1), 11–17 (1991)
Kifer, M.: Rule interchange format: The framework. In: Calvanese, D., Lausen, G. (eds.) RR 2008. LNCS, vol. 5341, pp. 1–11. Springer, Heidelberg (2008)
Myung, J., Yeon, J., Lee, S.G.: SPARQL basic graph pattern processing with iterative MapReduce. In: Proceedings of the 2010 Workshop on Massive Data Analytics on the Cloud (MDAC 2010), pp. 6:1–6:6 (2010)
Ravindra, P., Hong, S., Kim, H., Anyanwu, K.: Efficient processing of RDF graph pattern matching on MapReduce platforms. In: Proceedings of the Second International Workshop on Data Intensive Computing in the Clouds, DataCloud-SC 2011, pp. 13–20 (2011)
RDFgrid: Map/Reduce-based Linked Data Processing with Hadoop, http://rdfgrid.rubyforge.org/
Tachmazidis, I., Antoniou, G., Flouris, G., Kotoulas, S.: Scalable nonmonotonic reasoning over RDF data using MapReduce. In: Proceedings of the Joint Workshop on Scalable and High-Performance Semantic Web Systems, pp. 75–90 (2012)
Urbani, J., Kotoulas, S., Maassen, J., Harmelen, F.V., Bal, H.: WebPIE: A web-scale parallel inference engine using MapReduce. Web Semantics: Science, Services and Agents on the World Wide Web 10, 59–75 (2012)
W3C Recommendation: RIF Core Dialect, 2nd edn. (2013), http://www.w3.org/TR/rif-core/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Maeda, R., Ohta, N., Kuwabara, K. (2014). MapReduce-Based Implementation of a Rule System. In: Badica, A., Trawinski, B., Nguyen, N. (eds) Recent Developments in Computational Collective Intelligence. Studies in Computational Intelligence, vol 513. Springer, Cham. https://doi.org/10.1007/978-3-319-01787-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-01787-7_19
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01786-0
Online ISBN: 978-3-319-01787-7
eBook Packages: EngineeringEngineering (R0)