[Objective] This paper presents a new model for public opinion monitoring system based on Hadoop to retrieve and analyze information from the micro-blog platforms. [Methods] We first surveyed the existing technology of the public opinion monitoring systems and proposed a new model with modified algorithm. Then, we built a big data analysis platform with Hadoop to examine the model’s feasibility through experimental simulations. [Results] The proposed model can detect and retrieve public opinion data effectively. [Limitations] The Hadoop cluster was relatively small. We did not compare our model with other clustering algorithms to discuss their advantages and disadvantages. [Conclusions] The proposed model can conduct public opinion analysis with micro-blog data and provide scientific information for the policy makers to improve crisis management.
杨爱东,刘东苏. 基于Hadoop的微博舆情监控系统模型研究[J]. 现代图书情报技术, 2016, 32(5): 56-63.
Yang Aidong,Liu Dongsu. Hadoop Based Public Opinion Monitoring System for Micro-blogs. New Technology of Library and Information Service, 2016, 32(5): 56-63.
(Lan Yuexin, Dong Xilin, Su Guoqiang, et al.Research on Micro-blog Public Opinion Information Interaction Model Under the Background of Big Data[J]. New Technology of Library and Information Service, 2015(5): 24-33.)
(Tian Zhanwei, Sui Yang.The Empirical Analysis of Micro-blog Information Flow Based on Complex Network Theory[J]. Library and Information Service, 2012, 56(8): 42-46.)
(Gao Chengshi, Rong Xing, Chen Yue.Research on Public Opinion Monitoring Index- system in Micro-blogging[J]. Journal of Information, 2011, 30(9): 66-70.)
(Pan Fang, Zhang Xia, Zhong Weijun.Precautionary Monitoring of the Sudden Burst of Public Opinion in Weibo Community on Internet Based on BP Neural Network[J]. Journal of Information, 2014, 33(5): 125-128.)
[10]
Hadoop [EB/OL]. [2016-01-12]. .
[11]
HDFS User Guide [EB/OL]. [2016-01-12]. .
[12]
Dean J, Ghemawat S.MapReduce: Simplified Data Processing on Large Clusters[J]. Communications of the ACM, 2004, 51(1): 107-113.
[13]
George L.HBase: The Definitive Guide[M]. O’Reilly Media, 2011.
[14]
Song Y, Cai D F, Zhang G P, et al.Approach to Chinese Word Segmentation Based on Character-Word Joint Decoding[J]. Journal of Software, 2009, 20(9): 2366-2375.