skip to main content
10.1145/3549206.3549285acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesic3Conference Proceedingsconference-collections
research-article

Mid Price Prediction via Statistical Feature Expansion and Kernel Adaptive Filtering

Published:24 October 2022Publication History

ABSTRACT

Predicting mid-price movements of stocks is a difficult task. It is mainly owing to the fact a financial times series is often non-stationary, chaotic, and a dynamic mixture of several factors. This work provides a thorough investigation on the use of statistical features and mid-price prediction via kernel adaptive filtering algorithms. First, we apply the process of feature expansion (FE) to build a procedure that is effective and efficient in terms of price prediction. Subsequently, we use these features to improve upon the accuracy of the prediction model. We work on several years of data from the National Stock Exchange (NSE-50) for experimentation. The proposed solution is comprehensive as it includes the utilization of multiple feature engineering techniques and mid-price prediction using the Kernel Adaptive Filtering class of algorithms. We conduct comprehensive studies on ten different Kernel Adaptive Filtering algorithms and show that these techniques outperform similar methods in the literature. This work contributes to stock analysis research by providing extensive design and evaluation of the predictive capability, feature engineering, and data pre-processing approaches.

References

  1. Yaser S Abu-Mostafa and Amir F Atiya. 1996. Introduction to financial forecasting. Applied intelligence 6, 3 (1996), 205–213.Google ScholarGoogle Scholar
  2. Rajendra Acharya, P Subbanna Bhat, N Kannathal, Ashok Rao, and Choo Min Lim. 2005. Analysis of cardiac health using fractal dimension and wavelet transformation. ITBM-RBM 26, 2 (2005), 133–139.Google ScholarGoogle ScholarCross RefCross Ref
  3. JG Agrawal, V Chourasia, and A Mittra. 2013. State-of-the-art in stock prediction techniques. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering 2, 4 (2013), 1360–1366.Google ScholarGoogle Scholar
  4. Jérôme Antoni and Robert Bond Randall. 2006. The spectral kurtosis: application to the vibratory surveillance and diagnostics of rotating machines. Mechanical systems and signal processing 20, 2 (2006), 308–331.Google ScholarGoogle Scholar
  5. Maximilian Christ, Nils Braun, Julius Neuffer, and Andreas W Kempa-Liehr. 2018. Time series feature extraction on basis of scalable hypothesis tests (tsfresh–a python package). Neurocomputing 307(2018), 72–77.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Zhijian Cui, Xiaodong Shi, and Yidong Chen. 2016. Sentiment analysis via integrating distributed representations of variable-length word sequence. Neurocomputing 187(2016), 126–132.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Rain Ferenets, Tarmo Lipping, Andres Anier, Ville Jantti, Sari Melto, and Seppo Hovilehto. 2006. Comparison of entropy and complexity measures for the assessment of depth of sedation. IEEE Transactions on Biomedical Engineering 53, 6 (2006), 1067–1077.Google ScholarGoogle ScholarCross RefCross Ref
  8. Ronald Aylmer Fisher. 1925. Theory of statistical estimation. In Mathematical Proceedings of the Cambridge Philosophical Society, Vol. 22. Cambridge University Press, 700–725.Google ScholarGoogle ScholarCross RefCross Ref
  9. Indranil Ghosh and Tamal Datta Chaudhuri. 2021. FEB-stacking and FEB-DNN models for stock trend prediction: A performance analysis for pre and post Covid-19 periods. Decision Making: Applications in Management and Engineering 4, 1(2021), 51–84.Google ScholarGoogle ScholarCross RefCross Ref
  10. Hakan Gündüz, Zehra Çataltepe, and Yusuf Yaslan. 2017. Stock daily return prediction using expanded features and feature selection. Turkish Journal of Electrical Engineering and Computer Sciences 25, 6(2017), 4829–4840.Google ScholarGoogle ScholarCross RefCross Ref
  11. Bruno Miranda Henrique, Vinicius Amorim Sobreiro, and Herbert Kimura. 2018. Stock price prediction using support vector regression on daily and up to the minute prices. The Journal of finance and data science 4, 3 (2018), 183–201.Google ScholarGoogle ScholarCross RefCross Ref
  12. Tomoyuki Higuchi. 1988. Approach to an irregular time series on the basis of the fractal theory. Physica D: Nonlinear Phenomena 31, 2 (1988), 277–283.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Rupesh A Kamble. 2017. Short and long term stock trend prediction using decision tree. In 2017 International Conference on Intelligent Computing and Control Systems (ICICCS). IEEE, 1371–1375.Google ScholarGoogle ScholarCross RefCross Ref
  14. Sydney Mambwe Kasongo and Yanxia Sun. 2019. A deep learning method with filter based feature engineering for wireless intrusion detection system. IEEE access 7(2019), 38597–38607.Google ScholarGoogle ScholarCross RefCross Ref
  15. Luckyson Khaidem, Snehanshu Saha, and Sudeepa Roy Dey. 2016. Predicting the direction of stock market prices using random forest. arXiv preprint arXiv:1605.00003(2016).Google ScholarGoogle Scholar
  16. Kyoung-jae Kim and Ingoo Han. 2000. Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index. Expert systems with Applications 19, 2 (2000), 125–132.Google ScholarGoogle Scholar
  17. Deepak Kumar, Pradeepta Kumar Sarangi, and Rajit Verma. 2021. A systematic review of stock market prediction using machine learning and statistical techniques. Materials Today: Proceedings(2021).Google ScholarGoogle Scholar
  18. Manish Kumar and M Thenmozhi. 2006. Forecasting stock index movement: A comparison of support vector machines and random forest. In Indian institute of capital markets 9th capital markets conference paper.Google ScholarGoogle Scholar
  19. Yaguo Lei, Jing Lin, Zhengjia He, and Ming J Zuo. 2013. A review on empirical mode decomposition in fault diagnosis of rotating machinery. Mechanical systems and signal processing 35, 1-2 (2013), 108–126.Google ScholarGoogle Scholar
  20. Kunyang Li, Weifeng Pan, Yifan Li, Qing Jiang, and Guanzheng Liu. 2018. A method to detect sleep apnea based on deep neural network and hidden Markov model using single-lead ECG signal. Neurocomputing 294(2018), 94–101.Google ScholarGoogle ScholarCross RefCross Ref
  21. Weifeng Liu, Jose C Principe, and Simon Haykin. 2011. Kernel adaptive filtering: a comprehensive introduction. Vol. 57. John Wiley & Sons.Google ScholarGoogle Scholar
  22. Shambhavi Mishra, Tanveer Ahmed, Vipul Mishra, Sami Bourouis, and Mohammad Aman Ullah. 2022. An Online Kernel Adaptive Filtering-Based Approach for Mid-Price Prediction. Scientific Programming 2022 (2022).Google ScholarGoogle Scholar
  23. Shambhavi Mishra, Tanveer Ahmed, Vipul Mishra, Manjit Kaur, Thomas Martinetz, Amit Kumar Jain, and Hammam Alshazly. 2021. Multivariate and Online Prediction of Closing Price Using Kernel Adaptive Filtering. Computational Intelligence and Neuroscience 2021 (2021).Google ScholarGoogle Scholar
  24. Tinghui Ouyang, Heming Huang, Yusen He, and Zhenhao Tang. 2020. Chaotic wind power time series prediction via switching data-driven modes. Renewable Energy 145(2020), 270–281.Google ScholarGoogle ScholarCross RefCross Ref
  25. Jigar Patel, Sahil Shah, Priyank Thakkar, and Ketan Kotecha. 2015. Predicting stock market index using fusion of machine learning techniques. Expert Systems with Applications 42, 4 (2015), 2162–2172.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Arthur Petrosian. 1995. Kolmogorov complexity of finite sequences and recognition of different preictal EEG patterns. In Proceedings Eighth IEEE Symposium on Computer-Based Medical Systems. IEEE, 212–217.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Mingyue Qiu and Yu Song. 2016. Predicting the direction of stock market index movement using an optimized artificial neural network model. PloS one 11, 5 (2016), e0155133.Google ScholarGoogle ScholarCross RefCross Ref
  28. Siddhant Sinha, Shambhavi Mishra, Vipul Mishra, and Tanveer Ahmed. 2022. Sector influence aware stock trend prediction using 3D convolutional neural network. Journal of King Saud University-Computer and Information Sciences 34, 4(2022), 1511–1522.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Cornelis J Stam. 2005. Nonlinear dynamical analysis of EEG and MEG: review of an emerging field. Clinical neurophysiology 116, 10 (2005), 2266–2301.Google ScholarGoogle Scholar
  30. Sana Tonekaboni, Shalmali Joshi, Kieran Campbell, David K Duvenaud, and Anna Goldenberg. 2020. What went wrong and when? Instance-wise feature importance for time-series black-box models. Advances in Neural Information Processing Systems 33 (2020), 799–809.Google ScholarGoogle Scholar
  31. Raksha Upadhyay, A Manglick, DK Reddy, PK Padhy, and PK Kankar. 2015. Channel optimization and nonlinear feature extraction for Electroencephalogram signals classification. Computers & Electrical Engineering 45 (2015), 222–234.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Songlin Zhao, Badong Chen, and Jose C Principe. 2011. Kernel adaptive filtering with maximum correntropy criterion. In The 2011 International Joint Conference on Neural Networks. IEEE, 2012–2017.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Mid Price Prediction via Statistical Feature Expansion and Kernel Adaptive Filtering

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        IC3-2022: Proceedings of the 2022 Fourteenth International Conference on Contemporary Computing
        August 2022
        710 pages
        ISBN:9781450396752
        DOI:10.1145/3549206

        Copyright © 2022 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 24 October 2022

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited
      • Article Metrics

        • Downloads (Last 12 months)21
        • Downloads (Last 6 weeks)3

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format