Skip to main content

An Efficient Risk Data Learning with LSTM RNN

  • Conference paper
  • First Online:
Data Mining (AusDM 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1127))

Included in the following conference series:

  • 639 Accesses

Abstract

The use of big risk data for risk management has evolved into a concern within financial services industry in recent years. Whether the quality of big risk data can be relied upon is to be ascertained till 2019. To facilitate the measurement and prediction of data quality, we propose an efficient approach to slide a piece of data from the big risk data and a model to train divergent Long Short-Term Memory (“LSTM”) Recurrent Neural Networks (“RNNs”) with various algorithms. The network is evaluated by the improvement in network run time, prediction accuracy and relevant error. This enables financial institutions to identify potential data risks instantly for earlier mitigation soon.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Frydenberg, H.J.: Restoring trust in Australia’s financial system. Australian Government, The Treasury, pp. 3–42 (2019)

    Google Scholar 

  2. Frost, J.: APRA rejected CBA home loan data as inaccurate and incomplete. Financial Review: Business, Banking and Finance, p. 1 (2018)

    Google Scholar 

  3. Yeates, C.: Banks dive as UBS raises home loan concerns. Sydney Morning Herald: Banking & Finance, pp. 1–2 (2018)

    Google Scholar 

  4. Eyers, J.: CBA want to use AI to tackle fraud and cyber attacks. Business Insider, pp. 1–2 (2016)

    Google Scholar 

  5. Härle, P., Havas, A., Kremer, A., Rona, D., Samandari, H.: The future of bank risk management. Mckinsey & Company, pp. 1–32 (2015)

    Google Scholar 

  6. APRA: Prudential Practice Guide CPG 235 – Managing Data Risk. Australian Prudential Regulation Authority (APRA), pp. 1–13 (2013)

    Google Scholar 

  7. Upadhyay, A.: How long does it take to complete a big data or data science project in real time on large data sets?. Quora, p. 1 (2017)

    Google Scholar 

  8. Zhou, P., et al.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 207–212 (2016)

    Google Scholar 

  9. Zhu, W.T., et al.: Co-occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Association for the Advancement of Artificial Intelligence, pp. 3697–3702 (2016)

    Google Scholar 

  10. Mikolov, T., Joulin, A., Chopra, S., Mathieu, M., Ranzato, M.A.: Learning longer memory in recurrent neural networks. In: International Conference on Learning Representation, arXiv preprint arXiv:1412.7753 [cs] (2014)

  11. KPMG: Equity market risk premium – research summary. KPMG, pp. 3–7 (2018)

    Google Scholar 

  12. CFI: Market risk premium. Corporate Finance Institute (CFI), pp. 2–5 (2018)

    Google Scholar 

  13. Moody’s Analytics: Credit risk calculator. Moody’s, pp. 3–7 (2018)

    Google Scholar 

  14. KPMG: Basel 4: the way ahead, operational risk, the new standardized approach. KPMG, pp. 3–9 (2018)

    Google Scholar 

  15. Migueis, M.: Is Operational risk regulation forward-looking and sensitive to current risks?. Board of Governors of the Federal Reserve System, pp. 1–7 (2018)

    Google Scholar 

  16. IOSCO: Recommendations for liquidity risk management for collective investment schemes. The Board of the International Organization of Securities Commissions (IOSCO), pp. 1–20 (2018)

    Google Scholar 

  17. Josko, J.M.B., Oikawa, M.K., Ferreira, J.E.: A formal taxonomy to improve data defect description. In: Gao, H., Kim, J., Sakurai, Y. (eds.) DASFAA 2016. LNCS, vol. 9645, pp. 307–320. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32055-7_25

    Chapter  Google Scholar 

  18. Ergen, T., Kozat, S.S.: Efficient online learning algorithms based on LSTM neural networks. IEEE Trans. Neural Netw. Learn. Syst. 29(8), 3772–3783 (2017)

    MathSciNet  Google Scholar 

  19. Palangi, H., et al.: Deep sentence embedding using long short-term memory networks: analysis and application to information retrieval. IEEE/ ACM Trans. Audio Speech Lang. Process. 24(4), 694–707 (2016)

    Article  Google Scholar 

  20. Fan, Y.C., Qian, Y., Xie, F.L., Soong, F.K.: TTS synthesis with bidirectional LSTM based recurrent neural networks. In: Conference of the International Speech Communication Association, pp. 1964–1968 (2014)

    Google Scholar 

  21. Kingma, D.P., Ba, J.L.: ADAM: a method for stochastic optimization. In: International Conference on Learning Representations. arXiv preprint arXiv:1412.6980, [cs.LG] (2014)

  22. Ward, R., Wu, X.X., Bottou, L.: AdaGrad stepsizes: sharp convergence over nonconvex landscapes. In: International Conference on Machine Learning, pp. 6677–6686 (2019)

    Google Scholar 

  23. AI-Jarrah, O.Y., Yoo, P.D., Muhaidat, S., Karagiannidis, G.K., Taha, K.: Efficient machine learning for big data: a review. Big Data Res. 2(3), 87–93 (2015)

    Article  Google Scholar 

  24. Lv, Y.S., Duan, Y.J., Kang, W.W., Li, Z.X., Wang, F.Y.: Traffic flow prediction with big data: a deep learning approach. IEEE Trans. Intell. Transp. Syst. 16(2), 865–873 (2015)

    Google Scholar 

  25. Chen, H.M., Zhao, H., Shen, J., Zhou, R., Zhou, Q.G.: Supervised machine learning model for high dimensional gene data in colon cancer detection. In: IEEE International Congress on Big Data, pp. 134–141 (2015)

    Google Scholar 

  26. Grolinger, K., Capretz, M.A.M., Seewald, L.: Energy consumption prediction with big data: balancing prediction accuracy and computational resources. In: IEEE International Congress on Big Data, pp. 157–164 (2016)

    Google Scholar 

  27. Serhani, M.A., E1 Kassabi, H.T., Taleb, I., Nujum, A.: An hybrid approach to quality evaluation across big data value chain. In: IEEE International Congress on Big Data, pp. 418–425 (2016)

    Google Scholar 

  28. Taleb, I., E1 Kassabi, H.T., Serhani, M.A., Dssouli, R., Bouhaddioui, C.: Big data quality: a quality dimensions evaluation. In: International Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovation, pp. 759–765. IEEE (2016)

    Google Scholar 

  29. Ruta, D.: Automated trading with machine learning on big data. In: IEEE International Congress on Big Data, pp. 824–830 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Raymond K. Wong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wong, K.Y., Wong, R.K. (2019). An Efficient Risk Data Learning with LSTM RNN. In: Le, T., et al. Data Mining. AusDM 2019. Communications in Computer and Information Science, vol 1127. Springer, Singapore. https://doi.org/10.1007/978-981-15-1699-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-1699-3_10

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-1698-6

  • Online ISBN: 978-981-15-1699-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics