Abstract
This paper built a system containing the Distributed Crawling Module, the Database Module and the Analysis Module to collect a large number of objective data, clean the data and realize the business intelligence representation. The distributed crawling system includes the Distributed Crawling Module building from Hadoop, the Database Module by SQL Server and the Analysis Module by the SAS system. The first two modules support a distributed way to collect and convert non-structural data into structural data for the last module processing. Then, this paper extends research fields from theory to application about B&R, constructs rating system from the perspective of political risk, economic risk, financial risk, business environment risk and legal risk, establishes a 140 rating index, collects 46,200 sample data, and adopts Model of Principal Components Analysis, Analytic Hierarchy Process and Efficacy Function to access “the Belt & Road Initiative” 66 countries for 5 consecutive years of export credit insurance in the country risk rating. This paper also gives a detail explanation on 2015 rating results, showing that, Singapore wins the highest credit rating among the country; the credit rating of Latvia, Estonia, Slovakia, Turkey, Malaysia, Russia, Thailand and other countries is very high; Afghanistan, Ukraine, Laos, Iran, Arabia, Republic of Syria, Iraq, Burma, Republic of Yemen, East Timor and other countries with poor credit ratings. The conclusion is consistent with the domestic and overseas well-known rating agencies.









Similar content being viewed by others
References
Stats W (2018) Inernet World Stats. http://www.internetworldstats.com/stats.htm. Accessed 4 Feb 2018
Cisco (2014) Cisco Visual Networking Index: Forecast and Methodology, 2013–2018
Bra PD, Houben G, Kornatzky Y, Post R (1994) Information retrieval in distributed hypertexts. In: Proceedings of the 4th RlAO Conference
Li S, Yu Z, Chen X (2003) A survey on web crawling. Computer Science, China, pp 151–157
Diligenti M, Coetzee F, Lawrence S, Lee Giles C, Gori M (2000) Focused crawling using context graph. In: Proceedings of the 26th International Conference on Very Large Data Basesp, pp 527–534
Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113
Nutch Apache (2017) http://nutch.apache.org. Accessed 4 Feb 2018
Zhan HF, Yang YX, Fang H et al (2011) A study on distributed network crawler and its applications. Comput Sci Technol 5:68–74
Yuan W, Xue AR, Zhou XM et al (2014) A study on the optimization of distributed crawler based on Nutch. Wirel Commun Technol 23(3):44–47
Qian J, Lv P, Yue X, Liu C, Jing Z (2015) Hierarchical attribute reduction algorithms for big data using MapReduce. Knowl Based Syst 73:18–31
Zhang W, Xu L, Duan P, Gong W, Lu Q, Yang S (2015) A video cloud platform combing online and offline cloud computing technologies. Pers Ubiquit Comput 19(7):1099–1110
Yang J, Xie YT, Guo YB (2018) Panel data clustering analysis based on composite PCC: a parametric approach. Clust Comput. https://doi.org/10.1007/s10586-018-1973-x
Yang X (2004) National risk assessment of export credit insurance. Economic Science Press, Beijing, pp 2–13
Xie Y, Sun X, Sun H (2016) Dynamic credit risk measurement of unlisted insurance companies. Insur Stud 7:35–43 in Chinese
Chee SW, Cheng FF, Nassir AM (2015) Macroeconomics determinants of sovereign credit ratings. Int Bus Res. https://doi.org/10.5539/ibr.v8n2p42
Xie YT, Yang J, Liu H (2017) Agriculture risk regionalization analysis based on panel data clustering with affinity propagation. Stat Inf Forum 32(1):33–40 (in Chinese)
Guo Y (2013) Research on national risk assessment based on hybrid neural network model. Dalian University of Technology, Dalian
Teker D, Pala A, Kent O (2013) Determinants of sovereign rating: factor based ordered probit models for panel data analysis modeling framework. Int J Econ Financ Issues 3(1):122–132
Wang D, Yang J (2018) Study on risk rating of "the belt road initiative" countries. J Beijing Technol Bus Univ (Soc Sci) 33(4):117–126
Xie YT, Li H, Zou Q (2017) A study on the innovation index of resource-based cities in China: taking 116 prefecture level cities for example. J Peking Univ (Humanities and Social Sciences) 54(5):146–158
Li H, Zhang HM, Xie YT, Wang D (2017) Analysis of factors influencing the henry hub natural gas price based on factor analysis. Pet Sci 14(4):822–830
Acknowledgements
The paper was financially supported by the National Social Science Fund of China “Research on the redistribution function of social security system: Research on the national social security fund’s intervention in pension insurance payment” (18BJY212) and “the Fundamental Research Funds for the Central Universities” in UIBE (CXTD9-04).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Xie, Y., Wang, W., Guo, Y. et al. Study on the country risk rating with distributed crawling system. J Supercomput 75, 6159–6177 (2019). https://doi.org/10.1007/s11227-018-2539-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-018-2539-7