Abstract
In general data mining, HUIM also known as high-utility itemset mining is an offshoot of frequent item set mining (FIM). HUIM is known to give more emphasis to many factors which can give HUIM a distinct edge over FIM. PHIUM, or Potential high-utility item set mining has been created to give intrinsic patterns in databases that tend to be uncertain. Despite most previous methods being highly effective and powerful miners, PHUIM needs to work fast. Most current mining techniques do not handle databases with extremely large number of records when performing HUIM. In this paper, we make the assumption that the dataset is bigger than a direct load into RAM could handle. Furthermore, the dataset is not of the size where modification or duplication is possible, and as such a MapReduce framework is created that can be used to handle datasets that fall into these categories. One of the main objectives of this research is to be able to reduce the frequency of database scans while simultaneously maximizing parallel processing. Using experimental analysis, our Hadoop based algorithm performs well to mine high utility itemsets from big databases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agrawal, R., Imielinski, T., Swami, A.: Mining association rules between sets of items in large database. In: ACM SIGMOD International Conference on Management of Data, pp. 207–216 (1993)
Chan, R., Yang, Q., Shen, Y.D.: Mining high utility itemsets. In: IEEE International Conference on Data Mining, pp. 19–26 (2003)
Yao, H., Hamilton, H.J., Butz, C.J.: A foundational approach to mining itemset utilities from databases. In: SIAM International Conference on Data Mining, pp. 211–225 (2004)
Chui, C.K., Kao, B., Hung, E.: Mining frequent itemsets from uncertain data. In: The Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 47–58 (2007)
Wu, T.Y., Lin, J.C., Yun, U., Chen, C.H., Srivastava, G., Lv, X.: An efficient algorithm for fuzzy frequent itemset mining. J. Intell. Fuzzy Syst. 38(5), 5787–5797 (2020)
Leung, C.K.S., Mateo, M.A.F., Brajczuk, D.A.: A tree-based approach for frequent pattern mining from uncertain data. In: The Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 653–661 (2008)
Lin, C.W., Hong, T.P.: A new mining approach for uncertain databases using CUFP trees. Expert Syst. Appl. 39(4), 4084–4093 (2012)
Wu, J.M., Srivastava, G., Wei, M., Yun, U., Lin, J.C.: Fuzzy high-utility pattern mining in parallel and distributed Hadoop framework. Inform. Sci. 1(553), 31–48 (2021)
Lin, Y.C., Wu, C.W., Tseng, V.S.: Mining high utility itemsets in big data. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 659–661 (2015)
Lin, J.C., Srivastava, G., Li, Y., Hong, T.P., Wang, S.L.: Mining high-utility sequential patterns in uncertain databases. In: 2020 IEEE International Conference on Big Data (Big Data) 10 Dec 2020, pp. 5373–5380. IEEE (2020)
Zhang, B., Lin, J.C., Fournier-Viger, P., Li, T.: Mining of high utility-probability sequential patterns from uncertain databases. PloS ONE 12(7), e0180931 (2017)
Fournier-Viger, P., et al.: The SPMF open-source data mining library version 2. In: Berendt, B., et al. (eds.) ECML PKDD 2016. LNCS (LNAI), vol. 9853, pp. 36–40. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46131-1_8
Ahmed, U., Lin, J.C., Srivastava, G., Yasin, R., Djenouri, Y.: An evolutionary model to mine high expected utility patterns from uncertain databases. IEEE Trans. Emerg. Top. Comput. Intell. 5(1), 19–28 (2020)
Srivastava, G., Lin, J.C.-W., Zhang, X., Li, Y.: Large-scale high-utility sequential pattern analytics in Internet of Things. IEEE Internet Things J. 8(16), 12669–12678 (2021). https://doi.org/10.1109/JIOT.2020.3026826
Singh, R., Dwivedi, A.D., Srivastava, G., Wiszniewska-Matyszkiel, A., Cheng, X.: A game theoretic analysis of resource mining in blockchain. Cluster Comput. 23(3), 2035–2046 (2020). https://doi.org/10.1007/s10586-020-03046-w
Wu, J.M.-T., et al.: Mining of high-utility patterns in big IoT-based databases. Mob. Netw. Appl. 26(1), 216–233 (2021). https://doi.org/10.1007/s11036-020-01701-5
Raj, E.D., Manogaran, G., Srivastava, G., Wu, Y.: Information granulation-based community detection for social networks. IEEE Trans. Comput. Soc. Syst. 8(1), 122–133 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, J.MT., Srivastava, G., Lin, J.CW., Djenouri, Y., Wei, M., Polap, D. (2021). Mining of High-Utility Patterns in Big IoT Databases. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2021. Lecture Notes in Computer Science(), vol 12855. Springer, Cham. https://doi.org/10.1007/978-3-030-87897-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-87897-9_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87896-2
Online ISBN: 978-3-030-87897-9
eBook Packages: Computer ScienceComputer Science (R0)