Review of Methods and Applications of Text Sentiment Analysis
Zhong Jiawa1,2,Liu Wei1(),Wang Sili1,Yang Heng1
1Northwest Institute of Eco-Environment and Resources, Chinese Academy of Sciences, Lanzhou 730000, China 2School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190, China
[Objective] This paper reviews literature on text sentiment analysis, aiming to summarize its technical development trends and applications. [Coverage] We searched relevant literature from the Web of Science Core Collection and CNKI database on the concepts, methods and techniques of sentiment analysis. A total of 69 papers were retrieved from 2011 to 2020 and then analyzed. [Methods] We summarized the main models and applications of text sentiment analysis from the dimensions of time and theme. We also discussed the fields needs to be improved. [Results] There were mainly three methods for text sentiment analysis, which were based on sentiment lexicon and rules, machine learning, as well as deep learning. Each method has advantages and disadvantages. The methods based on multi-strategy hybrid became more popular in recent years. [Limitations] We reviewed previous literature on text sentiment analysis from the perspective of macro-technical methods. More research is needed to compare and elaborate the technical details of sentiment analysis algorithms. [Conclusions] The development of artificial intelligence technology (big data and deep learning) will further improve text sentiment analysis, and benefit business decision making applications.
钟佳娃,刘巍,王思丽,杨恒. 文本情感分析方法及应用综述*[J]. 数据分析与知识发现, 2021, 5(6): 1-13.
Zhong Jiawa,Liu Wei,Wang Sili,Yang Heng. Review of Methods and Applications of Text Sentiment Analysis. Data Analysis and Knowledge Discovery, 2021, 5(6): 1-13.
(Chen Long, Guan Ziyu, He Jinhong, et al. A Survey on Sentiment Classification[J]. Journal of Computer Research and Development, 2017,54(6):1150-1170.)
[2]
Joshi M, Prajapati P, Shaikh A, et al. A Survey on Sentiment Analysis[J]. International Journal of Computer Applications, 2017,163(6):34-38.
[3]
Liu B. Sentiment Analysis and Opinion Mining[M]. San Rafael, CA : Morgan & Claypool Publishers, 2012.
(Mei Lili, Huang Heyan, Zhou Xinyu, et al. A Survey on Sentiment Lexicon Construction[J]. Journal of Chinese Information Processing, 2016,30(5):19-27.)
[6]
Zhang L, Wang S, Liu B. Deep Learning for Sentiment Analysis: A Survey[J]. Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery, 2018,8(4):e1253.
[7]
Minaee S, Kalchbrenner N, Cambria E, et al. Deep Learning Based Text Classification: A Comprehensive Review[OL]. arXiv Preprint, arXiv: 2004.03705.
[8]
Mikolov T, Chen K, Corrado G S, et al. Efficient Estimation of Word Representations in Vector Space[OL]. arXiv Preprint, arXiv: 1301.3781.
[9]
Awwalu J, Bakar A A, Yaakub M R. Hybrid N-Gram Model Using Naive Bayes for Classification of Political Sentiments on Twitter[J]. Neural Computing and Applications, 2019,31(12):9207-9220.
doi: 10.1007/s00521-019-04248-z
[10]
Balakrishnan V, Khan S, Arabnia H R. Improving Cyberbullying Detection Using Twitter Users’ Psychological Features and Machine Learning[J]. Computers & Security, 2020,90:101710.
doi: 10.1016/j.cose.2019.101710
(Ren Zhongjie, Zhang Peng, Lan Yuexin, et al. Emotional Tendency Prediction of Emergencies Based on the Portraits of Weibo Users——Taking “8·12” Accident in Tianjin as an Example[J]. Journal of Intelligence, 2019,38(11):126-133.)
(Lei Ming, Zhu Ming. Applications of Sentiment Analysis in Movie Recommendation System[J]. Computer Engineering and Application, 2016,52(10):59-63, 107.)
(He Xueqin, Yang Wenzhong, Wushouer · Silamu, et al. Sentiment Analysis of Tourist Reviews Combined with Syntactic Rules and CNN[J]. Computer Engineering and Design, 2019,40(11):3306-3312.)
[15]
Griffith J, Najand M, Shen J C. Emotions in the Stock Market[J]. Journal of Behavioral Finance, 2020,21(1):42-56.
doi: 10.1080/15427560.2019.1588275
[16]
Chen L C, Lee C M, Chen M Y. Exploration of Social Media for Sentiment Analysis Using Deep Learning[J]. Soft Computing, 2020,24(11):8187-8197.
doi: 10.1007/s00500-019-04402-8
[17]
Pan D H, Yuan J L, Li L, et al. Deep Neural Network-Based Classification Model for Sentiment Analysis[C]// Proceedings of the 6th International Conference on Behavioral, Economic and Socio-Cultural Computing. New York, USA: IEEE, 2019. DOI: 10.1109/BESC48373.2019.8963171.
[18]
Joshi A, Bhattacharyya P, Ahire S. Sentiment Resources: Lexicons and Datasets[A]//Cambria E, Das D, Bandyopadhyay S, et al. A Practical Guide to Sentiment Analysis[M]. Cham: Springer International Publishing, 2017: 85-106.
[19]
Deng S Y, Sinha A P, Zhao H M. Adapting Sentiment Lexicons to Domain-Specific Social Media Texts[J]. Decision Support Systems, 2017,94:65-76.
doi: 10.1016/j.dss.2016.11.001
(Zhao Yanyan, Qin Bing, Shi Qiuhui, et al. Large-scale Sentiment Lexicon Collection and Its Application in Sentiment Classification[J]. Journal of Chinese Information Processing, 2017,31(2):187-193.)
(Li Yongshuai, Wang Liming, Chai Yumei, et al. Research on Construction Method of Dynamic Sentiment Dictionary Based on Bidirectional LSTM[J]. Journal of Chinese Computer Systems, 2019,40(3):503-509.)
(Wan Qi, Yu Zhonghua, Chen Li, et al. Improving Emotion Expression Extraction in Chinese Microblogs via New Words Detection[J]. Journal of University of Science and Technology of China, 2017,47(1):63-69.)
[23]
Ahmed M, Chen Q, Li Z H. Constructing Domain-Dependent Sentiment Dictionary for Sentiment Analysis[J]. Neural Computing and Applications, 2020,32(18):14719-14732.
doi: 10.1007/s00521-020-04824-8
[24]
Taboada M, Brooke J, Tofiloski M, et al. Lexicon-Based Methods for Sentiment Analysis[J]. Computational Linguistics, 2011,37(2):267-307.
doi: 10.1162/COLI_a_00049
(Dong Lili, Zhao Fanrong, Zhang Xiang. Analysing Propensity of Product Reviews Based on Domain Ontology and Sentiment Lexicon[J]. Computer Applications and Software, 2014,31(12):104-108, 194.)
[26]
Asghar M Z, Khan A, Ahmad S, et al. Lexicon-Enhanced Sentiment Analysis Framework Using Rule-Based Classification Scheme[J]. PLoS One, 2017,12(2):e0171649.
doi: 10.1371/journal.pone.0171649
[27]
Han H Y, Zhang J P, Yang J, et al. Generate Domain-Specific Sentiment Lexicon for Review Sentiment Analysis[J]. Multimedia Tools and Applications, 2018,77(16):21265-21280.
doi: 10.1007/s11042-017-5529-5
(Hu Zhaoya, Zhang Shunxiang. Sentiment Calculation of Chinese Microblog Based on Key Sentences Extraction[J]. Journal of Fuyang Normal University (Natural Science), 2019,36(3):92-96.)
(Wu Jiesheng, Lu Kui. Chinese Weibo Sentiment Analysis Based on Multiple Sentiment Lexicons and Rule Sets[J]. Computer Applications and Software, 2019,36(9):93-99.)
(Wang Zhitao, Yu Zhiwen, Guo Bin, et al. Sentiment Analysis of Chinese Micro Blog Based on Lexicon and Rule Set[J]. Computer Engineering and Application, 2015,51(8):218-225.)
[32]
Neethu M S, Rajasree R. Sentiment Analysis in Twitter Using Machine Learning Techniques[C]// Proceedings of the 4th International Conference on Computing, Communications and Networking Technologies. DOI: 10.1109/ICCCNT.2013.6726818.
(Liu Li, Yue Yawei. Cross-Grained Sentiment Analysis Oriented to College Student Microblog[J]. Application Research of Computers, 2019,36(6):1618-1622.)
(Tang Li, Liu Chen. Extraction of Feature and Sentiment Word Pair Based on Conditional Random Fields and HITS Algorithm[J]. Computer Technology and Development, 2019,29(7):71-75.)
[35]
Bandhakavi A, Wiratunga N, Padmanabhan D, et al. Lexicon Based Feature Extraction for Emotion Text Classification[J]. Pattern Recognition Letters, 2017,93:133-142.
doi: 10.1016/j.patrec.2016.12.009
(Yang Li, Wang Min, Cheng Yu. Microblog Sentiment Analysis of Jiangsu Environmental Public Service Based on LDA and XGBoost Models[J]. Journal of Nanjing University of Posts and Telecommunications (Social Science), 2019,21(6):23-39.)
(Peng Min, Xi Junjie, Dai Xinyuan, et al. Collaborative Filtering Recommendation Based on Sentiment Analysis and LDA Topic Model[J]. Journal of Chinese Information Processing, 2017,31(2):194-203.)
(Xie Lixing, Zhou Ming, Sun Maosong. Hierarchical Structure Based Hybrid Approach to Sentiment Analysis of Chinese Micro Blog and Its Feature Extraction[J]. Journal of Chinese Information Processing, 2012,26(1):73-83.)
(Liu Baoqin, Niu Yun. Multi-Hierarchy Emotion Analysis of Chinese Microblog[J]. Computer Technology and Development, 2015,25(11):23-26.)
[40]
Wawre S V, Deshmukh S N. Sentiment Classification Using Machine Learning Techniques[J]. International Journal of Science and Research, 2016,5(4):819-821.
[41]
Huq M R, Ali A, Rahman A. Sentiment Analysis on Twitter Data Using KNN and SVM[J]. International Journal of Advanced Computer Ence and Applications, 2017,8(6):19-25.
[42]
Kaur S, Sikka G, Awasthi L K. Sentiment Analysis Approach Based on N-Gram and KNN Classifier[C]// Proceedings of the 1st International Conference on Secure Cyber Computing and Communications. 2018: 13-16.
(Xu Jianzhong, Zhu Jun, Zhao Rui, et al. Sentiment Analysis of Aerospace Microblog Using SVM[J]. Journal of Information Security Research, 2017,3(12):1129-1133.)
(Li Rui, Zhang Qian, Liu Jiayong. Microblog Sentiment Analysis Based on Weighted Word2vec[J]. Communications Technology, 2017,50(3):502-506.)
[45]
Rathor A S, Agarwal A, Dimri P. Comparative Study of Machine Learning Approaches for Amazon Reviews[J]. Procedia Computer Science, 2018,132:1552-1561.
doi: 10.1016/j.procs.2018.05.119
[46]
Yadav A, Vishwakarma D K. Sentiment Analysis Using Deep Learning Architectures: A Review[J]. Artificial Intelligence Review, 2020,53(6):4335-4385.
doi: 10.1007/s10462-019-09794-5
[47]
Krizhevsky A, Sutskever I, Hinton G E. ImageNet Classification with Deep Convolutional Neural Networks[J]. Communication of the ACM, 2017,60(6):84-90.
doi: 10.1145/3065386
[48]
Pennington J, Socher R, Manning C. GloVe: Global Vectors for Word Representation[C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014: 1532-1543.
(Sun Min, Li Yang, Zhuang Zhengfei, et al. Sentiment Analysis Based on BGRU and Self-Attention Mechanism[J]. Journal of Jianghan University(Natural Science Edition), 2020,48(4):80-89.)
[50]
Peters M, Neumann M, Iyyer M, et al. Deep Contextualized Word Representations[OL]. arXiv Preprint, arXiv: 1802.05365.
[51]
Devlin J, Chang M W, Lee K, et al. BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding[OL]. arXiv Preprint, arXiv: 1810.04805.
(Fang Yinglan, Sun Jixiang, Han Bing. Research on Text Sentiment Analysis Method Based on BERT[J]. Information Technology and Informatization, 2020 (2):108-111.)
(Zeng Ziming, Wan Pinyu. Sentiment Analysis of Public Safety Events in Micro-blog Based on Double-layered Attention and Bi-LSTM[J]. Information Science, 2019,37(6):23-29.)
(Su Xiaoying, Meng Huanjian. Sentiment Analysis of Micro-blog Based on Neural Networks[J]. Computer Technology and Development, 2015,25(12):161-164, 168.)
(Zhang Ying, Zheng Qiusheng. Sentiment Classification of the Short Texts on Internet Based on Convolutional Neural Networks[J]. Journal of Zhongyuan University of Technology, 2016,27(6):82-86.)
(Sun Xiao, Peng Xiaoqi, Hu Min, et al. Extended Multi-Modality Features and Deep Learning Based Microblog Short Text Sentiment Analysis[J]. Journal of Electronics & Information Technology, 2017,39(9):2048-2055.)
[58]
Zeng J F, Ma X, Zhou K. Enhancing Attention-Based LSTM with Position Context for Aspect-Level Sentiment Classification[J]. IEEE Access, 2019,7:20462-20471.
doi: 10.1109/ACCESS.2019.2893806
[59]
Heikal M, Torki M, El-Makky N. Sentiment Analysis of Arabic Tweets Using Deep Learning[C]// Proceedings of the 4th Annual International Conference on Arabic Computational Linguistics. 2018: 114-122.
(Feng Xingjie, Zhang Zhiwei, Shi Jinchuan. Text Sentiment Analysis Based on Convolutional Neural Networks and Attention Model[J]. Application Research of Computers, 2018,35(5):1434-1436.)
(Chen Ke, Xie Bo, Zhu Xingtong. Sentiment Analysis Method Based on Sentiment Lexicon and Transformer[J]. Journal of Nanjing University of Posts and Telecommunications(Natural Science Edition), 2020,40(1):55-62.)
[63]
Lu K, Wu J S. Sentiment Analysis of Film Review Texts Based on Sentiment Dictionary and SVM[C]// Proceedings of the 3rd International Conference on Innovation in Artificial Intelligence. 2019: 73-77.
[64]
Fu X H, Liu W W, Xu Y Y, et al. Combine Hownet Lexicon to Train Phrase Recursive Autoencoder for Sentence-Level Sentiment Analysis[J]. Neurocomputing, 2017,241:18-27.
doi: 10.1016/j.neucom.2017.01.079
[65]
Mukwazvure A, Supreethi K P. A Hybrid Approach to Sentiment Analysis of News Comments[C]// Proceedings of the 4th International Conference on Reliability, Infocom Technologies and Optimization. DOI: 10.1109/ICRITO.2015.7359282.
[66]
Rohini V, Thomas M, Latha C A. Domain Based Sentiment Analysis in Regional Language-Kannada Using Machine Learning Algorithm[C]// Proceedings of IEEE International Conference on Recent Trends in Electronics, Information and Communication Technology. 2016: 503-507.
(Zhang Ling, Tan Yi, Zhu Lijun, et al. Analyzing the Features of Negative Sentiment Microblog[J]. Information Studies: Theory & Application, 2019,42(7):132-137, 170.)
(Li Hui, Chai Yaqing. Fine-Grained Sentiment Analysis Based on Convolutional Neural Network[J]. Data Analysis and Knowledge Discovery, 2019,3(1):95-103.)
(Zhang Yangsen, Zheng Jia, Huang Gaijuan, et al. Microblog Sentiment Analysis Method Based on a Double Attention Model[J]. Journal of Tsinghua University (Science and Technology), 2018,58(2):122-130.)