Predicting Stock Trends with CNN-BiLSTM Based Multi-Feature Integration Model
Xu Yuemei1(),Wang Zihou2,Wu Zixin1
1School of Information Science and Technology, Beijing Foreign Studies of University, Beijing 100089, China 2National Computer Network Emergency Response Technical Team/Coordination Center of China, Beijing 100029, China
[Objective] Based on the traditional financial data analysis, this paper explores the impacts of online news on stock market, aiming to improve the accuracy of predicting stock trends. [Methods] First, we used the Convolutional Neural Network (CNN) and Bi-directional Long Short-Term Memory (Bi-LSTM) to extract news events and their sentiment orientations. Then, we proposed a prediction model for stock trends, which combines the stock numerical data and the news event sentiments. Finally, we examined the feasibility of this model with two individual stocks (GREE Electric Appliance in the household appliance industry and ZTE in the electronic appliance industry). [Results] The prediction accuracy of our model was 11.6% and 25.6% higher than the exiting algorithms. [Limitations] We did not evaluate the impacts of prediction period on the performance of the proposed model. [Conclusions] The news events and their sentiment orientations could lead to the fluctuation of stock prices.
Sun X Q, Shen H W, Cheng X Q, Trading Network Predicts Stock Price[J]. Scientific Reports, 2014, 4:Article No. 3711.
doi: 10.1038/srep03711
[2]
Adebiyi A A, Adewumi A O, Ayo C K. Comparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction[J]. Journal of Applied Mathematics, 2014: Article No. 614342.
[3]
Birz G. Stale Economic News, Media and the Stock Market[J]. Journal of Economic Psychology, 2017, 61(3):384-412.
[4]
Chong E, Han C, Park F C. Deep Learning Networks for Stock Market Analysis and Prediction: Methodology, Data Representations, and Case Studies[J]. Expert Systems with Applications, 2017, 83:187-205.
doi: 10.1016/j.eswa.2017.04.030
[5]
Akita R, Yoshihara A, Matsubara T. Deep Learning for Stock Prediction Using Numerical and Textual Information[C]// Proceedings of IEEE/ACIS 15th International Conference on Computer and Information Science. IEEE, 2016: 978-984.
[6]
Usmani M, Adil S H, Raza K. Stock Market Prediction Using Machine Learning Classifiers and Social Media, News[C]// Proceedings of the 3rd International Conference on Computer and Information Sciences. IEEE, 2016: 322-327.
[7]
Bollen J, Mao H, Zeng X. Twitter Mood Predicts the Stock Market[J]. Journal of Computational Science, 2011, 2(1):1-8.
doi: 10.1016/j.jocs.2010.12.007
(Li Jie, Lin Yongfeng. Prediction of Time Series Data Based on Multi-time Scale RNN[J]. Computer Application and Software, 2018, 35(7):33-37, 62.)
[9]
Zhang Y S, Yang S T. Prediction on the Highest Price of the Stock Based on PSO-LSTM Neural Network[C]// Proceedings of the 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE). 2019: 1565-1569.
[10]
Althelaya K A, El-Alfy E M, Mohammed S. Stock Market Forecast Using Multivariate Analysis with Bidirectional and Stacked (LSTM, GRU)[C]// Proceedings of the 21st Saudi Computer Society National Computer Conference (NCC). 2018:1301-1307.
[11]
Zhao Z Y, Rao R N, Tu S X, et al. Time-Weighted LSTM Model with Redefined Labeling for Stock Trend Prediction[C]// Proceedings of the 29th International Conference on Tools with Artificial Intelligence. 2017: 1210-1217.
(Kong Xiangyu, Bi Xiuchun, Zhang Shuguang. Financial News and Prediction for Stock Market: An Empirical Analysis Based on Data Mining Techniques[J]. Journal of Applied Statistics and Management, 2016, 35(2):215-224.)
[13]
Oncharoen P, Vateekul P. Deep Learning for Stock Market Prediction Using Event Embedding and Technical Indicators[C]// Proceeding of the 5th International Conference on Advanced Informatics: Concept Theory and Applications. 2018: 19-24.
[14]
Tsai C F, Lin Y C, Yen D C, et al. Predicting Stock Returns by Classifier Ensembles[J]. Applied Soft Computing, 2011, 11(2):2452-2459.
doi: 10.1016/j.asoc.2010.10.001
(Zhang Mengji, Du Wanyu, Zheng Nan. Predicting Stock Trends Based on News Event[J]. Data Analysis and Knowledge Discovery, 2019, 3(5):11-17.)
[16]
Luan Y D, Lin S F. Research on Text Classification Based on CNN and LSTM[C]// Proceedings of 2019 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA). 2019: 435-442.
[17]
Yadav A, Vishwakarma D K. Sentiment Analysis Using Deep Learning Architectures: A Review[J]. Artificial Intelligence Review, 2020, 53:4335-4385.
doi: 10.1007/s10462-019-09794-5
[18]
Rapach D E, Zhou G F. Forecasting Stock Returns[J]. Handbook of Economic Forecasting, 2013, 2:327-383.
[19]
Chen K, Zhou Y, Dai F Y. A LSTM-Based Method for Stock Returns Prediction: A Case Study of China Stock Market[C]// Proceeding of 2015 IEEE International Conference on Big Data. 2015: 2823-2824.
[20]
Gandhmal D P, Kumar K. Systematic Analysis and Review of Stock Market Prediction Techniques[J]. Computer Science Review, 2019, 34:100190.
doi: 10.1016/j.cosrev.2019.08.001
(Zhang Yuchuan, Zhang Zuoquan, Huang Zhen. Application of Support Vector Machine in Selecting High Quality Stock[J]. Statistics and Decision, 2008(4):163-165.)
[22]
Kara Y, Boyacioglu M A, Bayken K. Predicting Direction of Stock Price Index Movement Using Artificial Neural Networks and Support Vector Machines: The Sample of the Istanbul Stock Exchange[J]. Expert Systems with Applications, 2011, 38(5):5311-5319.
doi: 10.1016/j.eswa.2010.10.027
[23]
Wilkinson N. An Introduction to Behavioral Economics[M]. Palgrave Macmillan, 2008.
[24]
Bruce J V, Adrian G, Geoff H. Do News and Sentiment Play a Role in Stock Price Prediction?[J]. Applied Intelligence, 2019, 49:3815-3820.
doi: 10.1007/s10489-019-01458-9
[25]
Chen W, Zhang Y, Yeo C K, et al. Stock Market Prediction Using Neural Networks Through News on Online Social Networks[C]// Proceeding of 2017 International Smart Cities Conference. 2017:23-29.
[26]
Vargas M R, dos Anjos C E M, Bichara G L G, et al. Deep Learning for Stock Market Prediction Using Technical Indicators and Financial News Articles[C]// Proceeding of 2018 International Joint Conference on Neural Networks. DOI: 10.1109/IJCNN.2018.8489208.
doi: 10.1109/IJCNN.2018.8489208
(Cen Yonghua, Tan Zhihao, Wu Chengyao. Impact of Financial Media Information on Stock Market: An Empirical Study of Sentiment Analysis[J]. Data Analysis and Knowledge Discovery, 2019, 3(9):98-114.)
[28]
Zhao W T, Wu F, Fu Z Q, et al. Sentiment Analysis on Weibo Platform for Stock Prediction[C]// Proceedings of the 6th International Conference on Artificial Intelligence and Security (ICAIS). 2020: 323-333.
[29]
Basu S. The Investment Performance of Common Stocks in Relation to Their Price/Earnings Ratio: A Test of the Efficient Market Hypojournal[J]. The Journal of Finance, 1977, 32(3):663-682.
doi: 10.1111/j.1540-6261.1977.tb01979.x
[30]
French K R, Fama E F. Size and Book-to-Market Factors in Earnings and Returns[J]. The Journal of Finance, 1995, 50(1):131-155.
doi: 10.1111/j.1540-6261.1995.tb05169.x
[31]
Cheadle C, Vawter M P, Freed W J, et al. Analysis of Microarray Data Using Z Score Transformation[J]. The Journal of Molecular Diagnostics, 2003, 5(2):73-81.
doi: 10.1016/S1525-1578(10)60455-2
(Xu Yuemei, Liu Yunwen, Cai Lianqiao. Predicitng Retweets of Government Microblogs with Deep-Combined Features[J]. Data Analysis and Knowledge Discovery, 2020, 4(2/3):18-28.)
[33]
Staudemeyer R C, Morris E R. Understanding LSTM - A Tutorial into Long Short-Term Memory Recurrent Neural Networks[OL]. arXiv Preprint, arXiv: 1909. 09586.
[34]
Friedman J H. Greedy Function Approximation: A Gradient Boosting Machine[J]. The Annals of Statistics, 2001, 29(5):1189-1232.
doi: 10.1214/aos/1013203450