Please wait a minute...
Data Analysis and Knowledge Discovery  2023, Vol. 7 Issue (5): 21-32    DOI: 10.11925/infotech.2096-3467.2022.0538
Current Issue | Archive | Adv Search |
Hotel Stock Prediction Based on Multimodal Deep Learning
Liu Yang1,2,Zhang Wen1,Hu Yi3,Mao Jin2(),Huang Fei4
1School of Information Management, Wuhan University, Wuhan 430072, China
2Center for Studies of Information Resource, Wuhan University,Wuhan 430072, China
3School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China
4Economics and Management School, Wuhan University, Wuhan 430072, China
Download: PDF (4206 KB)   HTML ( 56
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper aims to predict the price trend of hotel stocks by analyzing consumer sentiment in tourism reviews using multi-modal deep learning methods. [Methods] First, we constructed a multi-modal deep learning model to encode the multi-modal information. Then, we extracted the interaction information between texts and images through LSTM and graph neural network. Finally, we predicted the price of hotel stocks. [Results] We conducted an empirical study using Yelp’s tourism review data. Compared with the baseline models, the proposed model has superiority, and the average accuracy of stock prediction reached 59.10%. [Limitations] The proposed model was only tested on the dataset of four hotels on the Yelp website and has not been further validated on other tourism platforms. [Conclusions] The proposed model can effectively extract the interactive information between different modalities and improve the accuracy of hotel stock prediction.

Key wordsMultimodal Data      Deep Learning      Travel Reviews      Consumer Sentiment      Stock Prediction     
Received: 26 May 2022      Published: 04 July 2023
ZTFLH:  TP391  
  G350  
Fund:National Natural Science Foundation of China(72204190);Humanities and Social Science Foundation of the Ministry of Education in China(22YJCZH114);China Postdoctoral Science Foundation(2022M722476)
Corresponding Authors: Mao Jin,ORCID:0000-0001-9572-6709,E-mail:danveno@163.com。   

Cite this article:

Liu Yang, Zhang Wen, Hu Yi, Mao Jin, Huang Fei. Hotel Stock Prediction Based on Multimodal Deep Learning. Data Analysis and Knowledge Discovery, 2023, 7(5): 21-32.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2022.0538     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2023/V7/I5/21

The Model Framework of This Paper
The Input Processing Module
The Module of Graph Convolutional Network
酒店品牌 门店数量 评论数量
Crown Plaza 26 3 891
Hilton 59 11 814
Marriott 27 4 286
Westin 18 5 917
总计 130 25 908
Data Display of Each Hotel
特征名称 特征说明
Date 评论发表的时间
Brand 评论对应的酒店品牌
Area 酒店门店所处的城市
Comment 评论文本
Picture 评论图片
Feature Description
酒店名称 股票代码 数据条数
Crown Plaza InterContinental Hotels Group PLC (IHG) 4 745
Hilton Hilton Worldwide Holdings Inc. (HLT) 4 115
Marriott Marriott International, Inc. (MAR) 6 016
Westin Marriott International, Inc. (MAR) 6 016
Stock Data of Hotel
Date Distribution of Each Hotel
模型 Accuracy (%) F1-score (%)
Crown Plaza Marriott Westin Hilton Crown Plaza Marriott Westin Hilton
Baseline LR 50.96 53.55 48.74 54.46 52.12 51.46 49.17 46.87
DT 47.63 51.62 50.44 51.09 49.98 52.23 52.28 50.78
SVM 49.93 51.58 48.59 52.62 56.13 57.82 48.94 35.63
CNN 51.75 52.52 51.86 52.21 56.11 53.85 52.78 51.54
RNN 52.45 53.68 51.34 54.62 56.43 51.98 50.30 45.47
本研究 LS-GCN 58.31 57.72 59.82 60.56 56.86 57.77 59.92 56.18
Comparison Results of Baseline Models
The Results of Ablation Experiment
Comparative Training Process of Different Modalities
Accuracy of Different Modes
[1] 张健, 陈勇, 夏罡, 等. 人工神经网络之股票预测[J]. 计算机工程, 1997(2): 52-55.
[1] (Zhang Jian, Chen Yong, Xia Gang, et al. Stock Forecasting Using Artificial Neural Network[J]. Computer Engineering, 1997(2): 52-55.)
[2] Ding X, Zhang Y, Liu T, et al. Deep Learning for Event-driven Stock Prediction[C]// Proceedings of the 24th International Joint Conference on Artificial Intelligence. 2015.
[3] Nguyen T H, Shirai K, Velcin J. Sentiment Analysis on Social Media for Stock Movement Prediction[J]. Expert Systems with Applications, 2015, 42(24): 9603-9611.
doi: 10.1016/j.eswa.2015.07.052
[4] Dutta A, Bandopadhyay G, Sengupta S. Prediction of Stock Performance in the Indian Stock Market Using Logistic Regression[J]. International Journal of Business and Information, 2012, 7(1): 105-136.
[5] Singh R, Srivastava S. Stock Prediction Using Deep Learning[J]. Multimedia Tools and Applications, 2017, 76(18): 18569-18584.
doi: 10.1007/s11042-016-4159-7
[6] Luo X M, Wang H L, Raithel S, et al. Corporate Social Performance, Analyst Stock Recommendations, and Firm Future Returns[J]. Strategic Management Journal, 2015, 36(1): 123-136.
doi: 10.1002/smj.2219
[7] Luo X M, Zhang J, Duan W J. Social Media and Firm Equity Value[J]. Information Systems Research, 2013, 24(1): 146-163.
doi: 10.1287/isre.1120.0462
[8] Liu Y, Fei H, Zeng Q G, et al. Electronic Word-of-Mouth Effects on Studio Performance Leveraging Attention-based Model[J]. Neural Computing and Applications, 2020, 32(23): 17601-17622.
doi: 10.1007/s00521-020-04937-0
[9] Zhang S, Tong H H, Xu J J, et al. Graph Convolutional Networks: A Comprehensive Review[J]. Computational Social Networks, 2019, 6(1): Article No. 11.
[10] Menon K, Dubé L. Ensuring Greater Satisfaction by Engineering Salesperson Response to Customer Emotions[J]. Journal of Retailing, 2000, 76(3): 285-307.
doi: 10.1016/S0022-4359(00)00034-8
[11] Calvo-Porral C, Ruiz-Vega A, Lévy-Mangin J-P. How Consumer Involvement Influences Consumption-Elicited Emotions and Satisfaction[J]. International Journal of Market Research, 2021, 63(2): 251-267.
doi: 10.1177/1470785319838747
[12] Chen G Z, Huang X. From Good Feelings to Good Behavior: Exploring the Impacts of Positive Emotions on Tourist Environmentally Responsible Behavior[J]. Journal of Hospitality and Tourism Management, 2022, 50: 1-9.
doi: 10.1016/j.jhtm.2021.11.017
[13] Yuan H, Tang Y Y, Xu W, et al. Exploring the Influence of Multimodal Social Media Data on Stock Performance: An Empirical Perspective and Analysis[J]. Internet Research, 2021, 31(3): 871-891.
doi: 10.1108/INTR-11-2019-0461
[14] Ge Y D, Qiu J N, Liu Z Y, et al. Beyond Negative and Positive: Exploring the Effects of Emotions in Social Media During the Stock Market Crash[J]. Information Processing & Management, 2020, 57(4). DOI:10.1016/j.ipm.2020.102218.
doi: 10.1016/j.ipm.2020.102218
[15] Oh S, Baek H, Ahn J. Predictive Value of Video-sharing Behavior: Sharing of Movie Trailers and Box-office Revenue[J]. Internet Research, 2017, 27(3): 691-708.
doi: 10.1108/IntR-01-2016-0005
[16] Xun J Y, Guo B. Twitter as Customer’s eWOM: An Empirical Study on Their Impact on Firm Financial Performance[J]. Internet Research, 2017, 27(5): 1014-1038.
doi: 10.1108/IntR-07-2016-0223
[17] Akita R, Yoshihara A, Matsubara T, et al. Deep Learning for Stock Prediction Using Numerical and Textual Information[C]// Proceedings of 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS). IEEE, 2016.
[18] Fischer T, Krauss C. Deep Learning with Long Short-Term Memory Networks for Financial Market Predictions[J]. European Journal of Operational Research, 2018, 270(2): 654-69.
doi: 10.1016/j.ejor.2017.11.054
[19] Ananthi M, Vijayakumar K. Stock Market Analysis Using Candlestick Regression and Market Trend Prediction (CKRM)[J]. Journal of Ambient Intelligence and Humanized Computing, 2021, 12: 4819-4826.
doi: 10.1007/s12652-020-01892-5
[20] Liu Y, Fei H, Zeng Q G, et al. Electronic Word-of-Mouth Effects on Studio Performance Leveraging Attention-based Model[J]. Neural Computing and Applications, 2020, 32: 17601-17622.
doi: 10.1007/s00521-020-04937-0
[21] Ngiam J, Khosla A, Kim M, et al. Multimodal Deep Learning[C]// Proceedings of the 28th International Conference on Machine Learning 2011: 689-696.
[22] 刘建伟, 丁熙浩, 罗雄麟. 多模态深度学习综述[J]. 计算机应用研究, 2020, 37(6): 1601-1614.
[22] (Liu Jianwei, Ding Xihao, Luo Xionglin. Survey of Multimodal Deep Learning[J]. Application Research of Computers, 2020, 37(6): 1601-1614.)
[23] Chen Y M, Wei Z Y, Huang X J. Incorporating Corporation Relationship via Graph Convolutional Neural Networks for Stock Price Prediction[C]// Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 2018: 1655-1658.
[24] Li Y, Pan Y. A Novel Ensemble Deep Learning Model for Stock Prediction Based on Stock Prices and News[J]. International Journal of Data Science and Analytics, 2022, 13(2): 139-149.
doi: 10.1007/s41060-021-00279-9
[25] Lee S I, Yoo S J. Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets[J]. The Journal of Supercomputing, 2020, 76(10): 8294-8312.
doi: 10.1007/s11227-019-03101-3
[26] Devlin J, Chang M W, Lee K, et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding[OL]. arXiv Preprint, arXiv:1810.04805.
[27] Szegedy C, Ioffe S, Vanhoucke V, et al. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning[C]// Proceedings of the 31st AAAI Conference on Artificial Intelligence. 2017.
[28] Theckedath D, Sedamkar R R. Detecting Affect States Using VGG16, ResNet50 and SE-ResNet50 Networks[J]. SN Computer Science, 2020, 1(2): Article No. 79.
[29] Yu Y, Si X, Hu C, et al. A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures[J]. Neural Computation, 2019, 31(7): 1235-1270.
doi: 10.1162/neco_a_01199 pmid: 31113301
[30] Wasserman S, Faust K. Social Network Analysis: Methods and Applications[A]// Wasserman S,Faust K. Structural Analysis in the Social Sciences[M]. 1994.
[1] Huang Xuejian, Ma Tinghuai, Wang Gensheng. Detecting Weibo Rumors Based on Hierarchical Semantic Feature Learning Model[J]. 数据分析与知识发现, 2023, 7(5): 81-91.
[2] Wang Yinqiu, Yu Wei, Chen Junpeng. Automatic Question-Answering in Chinese Medical Q & A Community with Knowledge Graph[J]. 数据分析与知识发现, 2023, 7(3): 97-109.
[3] Zhang Zhengang, Yu Chuanming. Knowledge Graph Completion Model Based on Entity and Relation Fusion[J]. 数据分析与知识发现, 2023, 7(2): 15-25.
[4] Shen Lining, Yang Jiayi, Pei Jiaxuan, Cao Guang, Chen Gongzheng. A Fine-Grained Sentiment Recognition Method Based on OCC Model and Triggering Events[J]. 数据分析与知识发现, 2023, 7(2): 72-85.
[5] Wang Weijun, Ning Zhiyuan, Du Yi, Zhou Yuanchun. Identifying Interdisciplinary Sci-Tech Literature Based on Multi-Label Classification[J]. 数据分析与知识发现, 2023, 7(1): 102-112.
[6] Xiao Yuhan, Lin Huiping. Mining Differentiated Demands with Aspect Word Extraction: Case Study of Smartphone Reviews[J]. 数据分析与知识发现, 2023, 7(1): 63-75.
[7] Cheng Quan, She Dexin. Drug Recommendation Based on Graph Neural Network with Patient Signs and Medication Data[J]. 数据分析与知识发现, 2022, 6(9): 113-124.
[8] Wang Lu, Le Xiaoqiu. Research Progress on Citation Analysis of Scientific Papers[J]. 数据分析与知识发现, 2022, 6(4): 1-15.
[9] Zheng Xiao, Li Shuqing, Zhang Zhiwang. Measuring User Item Quality with Rating Analysis for Deep Recommendation Model[J]. 数据分析与知识发现, 2022, 6(4): 39-48.
[10] Yu Chuanming, Lin Hongjun, Zhang Zhengang. Joint Extraction Model for Entities and Events with Multi-task Deep Learning[J]. 数据分析与知识发现, 2022, 6(2/3): 117-128.
[11] Zhang Yunqiu, Li Bocheng, Chen Yan. Automatic Classification with Unbalanced Data for Electronic Medical Records[J]. 数据分析与知识发现, 2022, 6(2/3): 233-241.
[12] Zhang Fangcong, Qin Qiuli, Jiang Yong, Zhuang Runtao. Named Entity Recognition for Chinese EMR with RoBERTa-WWM-BiLSTM-CRF[J]. 数据分析与知识发现, 2022, 6(2/3): 251-262.
[13] Hu Yamin, Wu Xiaoyan, Chen Fang. Review of Technology Term Recognition Studies Based on Machine Learning[J]. 数据分析与知识发现, 2022, 6(2/3): 7-17.
[14] Yan Dongmei, He Wenxin, Chen Zhi. Predicting Stock Prices Based on RoBERTa-TCN and Sentimental Characteristics[J]. 数据分析与知识发现, 2022, 6(12): 123-134.
[15] Liu Yang, Ma Lili, Zhang Wen, Hu Zhongyi, Wu Jiang. Detecting Sarcasm from Travel Reviews Based on Cross-Modal Deep Learning[J]. 数据分析与知识发现, 2022, 6(12): 23-31.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn