Abstract
Aggregating the search result from multiple data sources is a challenging problem in the metasearch engines. However, the ordinary methods do not have enough ability to deal with these tremendous data. Aiming at this issue, based on the big data we aim to harness the efficiency and effectiveness of the aggregation result from multiple data sources and propose an aggregation framework, which consists of aggregating the multi-users requirements and preferences ranking lists and modelling discrete multi-objective evolutionary model. Based on the DPSO algorithm, we improve and optimize its encoding scheme, initialization methods, position and velocity definition, integrating updating, turbulence operator, external archive updating strategy and leaders selection, which could address the problem of low efficiency on the large scale data sources. Extensive experiments on the public datasets, real-world datasets and synthetic simulation datasets demonstrate that our method outperforms existing state-of-the-art ranking aggregation method and multi-objective evolutionary method by the efficiency, performance and convergence.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
All datasets have been published in http://www.whudml.com.
References
Desarkar, M.S., Sarkar, S., Mitra, P.: Preference relations based unsupervised rank aggregation for metasearch. Expert Syst. Appl. 49, 86–98 (2016)
Ozdemiray, A.M., Altingovde, I.S.: Explicit search result diversification using score and rank aggregation methods. J. Am. Soc. Inf. Sci. 66(6), 1212–1228 (2015)
Ali, R., Naim, I.: User feedback based metasearching using neural network. Int. J. Mach. Learn. Cybern. 6(2), 265–275 (2015)
Li, L., Xu, G., Zhang, Y., Kitsuregawa, M.: Random walk based rank aggregation to improving web search. Knowl.-Based Syst. 24(7), 943–951 (2011)
Keyhanipour, A.H., Moshiri, B., Kazemian, M., Piroozmand, M., Lucas, C.: Aggregation of web search engines based on users’ preferences in WebFusion. Knowl.-Based Syst. 20(4), 321–328 (2007)
Amin, G.R., Emrouznejad, A., Sadeghi, H.: Metasearch information fusion using linear programming. Rairo-Oper. Res. 46(04), 289–303 (2012)
Meng, W., Wu, Z., Yu, C., Li, Z.: A highly scalable and effective method for metasearch. ACM Trans. Inf. Syst. (TOIS) 19(3), 310–335 (2001)
Amin, G.R., Emrouznejad, A.: Optimizing search engines results using linear programming. Expert Syst. Appl. 38(9), 11534–11537 (2011)
Dwork, C., Kumar, R., Naor, M., Sivakumar, D.: Rank aggregation methods for the web, pp. 613–622. ACM (2001)
Coppersmith, D., Fleischer, L.K., Rurda, A.: Ordering by weighted number of wins gives a good ranking for weighted tournaments. ACM Trans. Algorithms (TALG) 6(3), 1–13 (2010)
Montague, M., Aslam, J.A.: Condorcet fusion for improved retrieval, pp. 538–548. CIKM (2002)
Wu, S., Li, J., Zeng, X., Bi, Y.: Adaptive data fusion methods in information retrieval. J. Am. Soc. Inf. Sci. 65(10), 2048–2061 (2014)
Klementiev, A., Roth, D., Small, K., Titov, I.: Unsupervised rank aggregation with domain-specific expertise, pp.1101–1106. IJCAI (2009)
Wei, Y., Shijun, L.: Automatically discovering of inconsistency among cross-source data based on Web big data. Comput. Res. Dev. 52(2), 295–308 (2015)
Zhao, Y., Shen, B.: Empirical study of user preferences based on rating data of movies. PloS One 11(1), e0146541 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Tan, X., Yu, W., Tan, L. (2024). Large-Scale Rank Aggregation from Multiple Data Sources Based D3MOPSO Method. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14331. Springer, Singapore. https://doi.org/10.1007/978-981-97-2303-4_5
Download citation
DOI: https://doi.org/10.1007/978-981-97-2303-4_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2302-7
Online ISBN: 978-981-97-2303-4
eBook Packages: Computer ScienceComputer Science (R0)