Multimodal Multi-Task Financial Risk Forecasting

A brief overview of Multimodal Multi-Task Financial Risk Forecasting. In this work, we present a multi-task solution that utilizes domain specialized textual features and audio attentive alignment for predictive financial risk and price modeling. Our method advances existing solutions in two aspects: 1) tailoring a deep multimodal text-audio attention model, 2) optimizing volatility, and price movement prediction in a multi-task ensemble formulation. We first cover earnings calls, financial risk, and stock volatility to motivate our work. We then discuss how we develop a multimodal architecture to use audio and text to forecast stock price movements and volatility from earnings calls. We then discuss our results, detailing how multimodality helps, the Post Earnings Announcement Drift (PEAD), and multi-task learning.\r\nFinally, we go over the limitations and ethical considerations pertaining to our work and discuss the key takeaways of Multimodal Financial Forecasting.