Please wait a minute...
Data Analysis and Knowledge Discovery  2019, Vol. 3 Issue (4): 71-79    DOI: 10.11925/infotech.2096-3467.2018.0516
Current Issue | Archive | Adv Search |
Text Sentiment Classification Based on Deep Belief Network
Qingqing Zhang1(),Xingshi He2,Huimin Wang2,Shengjun Meng3
1School of Management, Xi’an Polytechnic University, Xi’an 710048, China
2School of Science, Xi’an Polytechnic University, Xi’an 710048, China
3School of Journalism and New Media, Xi’an Jiaotong University, Xi’an 710049, China
Download: PDF (1516 KB)   HTML ( 3
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper focused on Chinese text sentiment classification based on deep belief network, especially the parameter selection and performance analysis of the network. [Methods] Chinese e-commercial reviews are as the object of the study, the unigram, bigram, POS, simple dependency label, sentiment score and triple dependency features are extracted and used as the input of deep belief network by setting different layers and different input numbers to compute the accuracy of sentiment classification. [Results] The results demonstrate that the triple dependency features as the input got better classification performance than the other features, but the number of hidden layers doesn’t have an effect on the classification accuracy. [Limitations] The methods aren’t conducted and verified on other deep learning models. [Conclusions] Deep learning has a good performance for sentiment analysis, but how to set up parameters still need to be further considered.

Key wordsDeep Belief Network      Text Sentiment Classification      Parameter Selection     
Received: 08 May 2018      Published: 29 May 2019

Cite this article:

Qingqing Zhang,Xingshi He,Huimin Wang,Shengjun Meng. Text Sentiment Classification Based on Deep Belief Network. Data Analysis and Knowledge Discovery, 2019, 3(4): 71-79.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2018.0516     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2019/V3/I4/71

[1] Liu B.Sentiment Analysis and Opinion Mining[M]. Morgan & Claypool Publishers, 2012.
[2] Cui Z Y, Cao Z J, Yang J Y, et al. Hierarchical Recognition System for Target Recognition from Sparse Representations[J]. Mathematical Problems in Engineering, 2015: Article ID 527095.
[3] 张庆庆, 刘西林. 基于依存句法关系的文本情感分类研究[J]. 计算机工程与应用, 2015, 51(22): 28-32.
[3] (Zhang Qingqing, Liu Xilin.Sentiment Analysis Based on Dependency Sytactic Relation[J]. Computer Engineering and Applications, 2015, 51(22): 28-32.)
[4] Balahur A, Turchi M.Comparative Experiments Using Supervised Learning and Machine Translation for Multilingual Sentiment Analysis[J]. Computer Speech & Language, 2014, 28(1): 56-75.
[5] Mleczko W K, Kapuscinski T, Nowicki R K.Rough Deep Belief Network - Application to Incomplete Handwritten Digits Pattern Classification[J]. Information and Software Technologies, 2015, 538: 400-411.
[6] Zhao Q N, Ma J J, Gong M G, et al.Three-Class Change Detection in Synthetic Aperture Radar Images Based on Deep Belief Network[J]. Journal of Computational and Theoretical Nanoscience, 2016, 13(6): 3757-3762.
[7] Dahl G E, Yu D, Deng L, et al.Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition[J]. IEEE Transactions on Audio, Speech, and Language Processing, 2012, 20(1): 30-42.
[8] Zhou G, Zeng Z, Huang J X, et al.Transfer Learning for Cross-Lingual Sentiment Classification with Weakly Shared Deep Neural Networks[C]// Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy. New York, USA: ACM, 2016: 245-254.
[9] Mikolv T, Chen K, Corrado G, et al. Efficient Estimation of Word Representation in Vector Space[OL]. arXiv Preprint, arXiv:1301.3781, 2013.
[10] Ruangkanokman P, Achalakul T, Akkarajitsakul K.Deep Belief Networks with Feature Selection for Sentiment Classification[C]// Proceedings of the 7th International Conference on Intelligent Systems, Modelling and Simulation. 2016: 25-27.
[11] Hinton G E, Salakhutdinov R R.Reducing the Dimensionality of Data with Neural Networks[J]. Science, 2006, 313(5786): 504-507.
[12] Zeng N, Wang Z, Zhang H, et al.Deep Belief Networks for Quantitative Analysis of a Gold Immunochromatograpghic Strip[J]. Cognitive Computation, 2016, 8(4): 684-692.
[13] Hinton G E.A Practical Guide to Training Restricted Boltzmann Machines[J]. Neural Networks: Tricks of the Trade, 2012, 7700: 599-619.
[14] Hinton G E.Training Products of Experts by Minimizing Contrastive Divergence[J]. Neural Computation, 2002, 14(8): 1771-1800.
[15] Rumelhart D E .Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations[J]. Language, 1986, 63(4): 45-76.
[1] Zhang Qingqing,Liu Xilin. Classifying Sentiments Based on BPSO Random Subspace[J]. 数据分析与知识发现, 2017, 1(5): 71-81.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn