Please wait a minute...
New Technology of Library and Information Service  2015, Vol. 31 Issue (11): 33-40    DOI: 10.11925/infotech.1003-3513.2015.11.06
Current Issue | Archive | Adv Search |
Hot Topic Extraction from E-commerce Microblog Based on EM-LDA Integrated Model
Wu Wankun1, Wu Qinglie1, Gu Jinjiang1,2
1 School of Economics and Management, Southeast University, Nanjing 211189, China
2 Department of Information Technology, Jiangsu Institute of Commerce, Nanjing 211168, China
Export: BibTeX | EndNote (RIS)      

[Objective] Extract hot topics from e-commerce microblog in social marketing.[Methods] This paper proposes an integrated model, EM-LDA (E-commerce Microblog-LDA) to extract hot topics from e-commerce microblog. The integrated model contains two submodels, that is, ET-LDA model and IT-LDA model. The former is to extract hot topics from those e-commerce microblog with Hashtag, and the latter is to extract hot topics from those e-commerce microblog without Hashtag.[Results] The standard LDA model and EM-LDA integrated model are both used to extract hot topics from e-commerce microblog text after the number of topics is determined. Compared with the standard LDA model, EM-LDA model extract hot topics more accurately and effectively, also can improve interpretability.[Limitations] ET-LDA model is not considered about the relationship between microblog contacts, that is, user feature is neglected. IT-LDA model does not concern how to deal with those e-commerce microblog both belong to conversation and retweet.[Conclusions] According to the special features of e-commerce microblog text, EM-LDA integrated model ameliorates the standard LDA model to improve the accuracy of hot topic extraction from e-commerce microblog.

Received: 27 May 2015      Published: 06 April 2016
:  TP393  

Cite this article:

Wu Wankun, Wu Qinglie, Gu Jinjiang. Hot Topic Extraction from E-commerce Microblog Based on EM-LDA Integrated Model. New Technology of Library and Information Service, 2015, 31(11): 33-40.

URL:     OR

[1] Wei X, Croft W B. LDA-based Document Models for Ad-hoc Retrieval [C]. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2006: 178-185.
[2] 张晨逸, 孙建伶, 丁轶群. 基于MB-LDA模型的微博主题挖掘[J]. 计算机研究与发展, 2011, 48(10): 1795-1802. (Zhang Chenyi, Sun Jianling, Ding Yiqun. Topic Mining for Microblog Based on MB-LDA Model [J]. Journal of Computer Research and Development, 2011, 48(10): 1795-1802.)
[3] 张晓艳, 王挺, 梁晓波. LDA模型在话题追踪中的应用[J]. 计算机科学, 2011, 38(10A): 136-139, 152. (Zhang Xiaoyan, Wang Ting, Liang Xiaobo. Use of LDA Model in Topic Tracking [J]. Computer Science, 2011, 38(10A): 136-139, 152.)
[4] 张培晶, 宋蕾. 基于LDA的微博文本主题建模方法研究述评[J]. 图书情报工作, 2012, 56(24): 120-126. (Zhang Peijing, Song Lei. Overview on Topic Modeling of Microblogs Text Based on LDA [J]. Library and Information Service, 2012, 56(24): 120-126.)
[5] Weng J, Lim E P, Jiang J, et al. TwitterRank: Finding Topic-sensitive Influential Twitterers [C]. In: Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. ACM, 2010: 261-270.
[6] Hong L, Davison B D. Empirical Study of Topic Modeling in Twitter [C]. In: Proceedings of the 1st Workshop on Social Media Analytics. ACM, 2010: 80-88.
[7] Rosen-Zvi M, Griffiths T, Steyvers M, et al. The Author-topic Model for Authors and Documents [C]. In: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 2004: 487-494.
[8] Zhao W X, Jiang J, Weng J, et al. Comparing Twitter and Traditional Media Using Topic Models [C]. In: Proceedings of the 33rd European Conference on Informatin Retrieval. Springer Berlin Heidelberg, 2011: 338-349.
[9] Ramage D, Hall D, Nallapati R, et al. Labeled LDA: A Supervised Topic Model for Credit Attribution in Multi-labeled Corpora [C]. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing. 2009: 248-256.
[10] 唐晓波, 向坤. 基于LDA模型和微博热度的热点挖掘[J]. 图书情报工作, 2014, 58(5): 58-63. (Tang Xiaobo, Xiang Kun. Hotspot Mining Based on LDA Model and Microblog Heat [J]. Library and Information Service, 2014, 58(5): 58-63.)
[11] 朱颖. 基于微博的热点话题发现[D]. 重庆: 西南大学, 2014. (Zhu Ying. Hot Topic Extraction from Microblogs [D]. Chongqing: Southwest University, 2014.)
[12] Blei D M, Ng A Y, Jordan M I. Latent Dirichlet Allocation [J]. Journal of Machine Learning Research, 2003, 3: 993-1022.
[13] Rosen-Zvi M, Chemudugunta C, Griffiths T, et al. Learning Author-topic Models from Text Corpora [J]. ACM Transactions on Information Systems, 2010, 28(1): Article No.4.
[14] Zhao W X, Jiang J, He J, et al. Topical Keyphrase Extraction from Twitter [C]. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. 2011: 379-388.
[15] Ramage D, Dumais S T, Liebling D J. Characterizing Microblogs with Topic Models [C]. In: Proceedings of the 4th International Conference on Weblogs and Social Media. 2010.
[16] 王星. 大数据分析: 方法与应用[M]. 北京: 清华大学出版社, 2013: 287-289. (Wang Xing. Big Data Analysis: Methods and Applications [M]. Beijing: Tsinghua University Press, 2013: 287-289.)
[17] 数据堂. 50条热门微博的所有转发和评论[EB/OL]. [2015-03-29]. (Datatang. All Retweets and Comments of 50 Hot Microblogs [EB/OL]. [2015-03-29].
[18] 数据堂. 63641个用户的新浪微博数据集[EB/OL]. [2015-03-30]. (Datatang. Sina Microblog Datasets of 63641 Users [EB/OL]. [2015-03-30].
[19] Toyabe T, Asai S. Analytical Models of Threshold Voltage and Breakdown Voltage of Short-channel MOSFET's Derived from Two-dimensional Analysis [J]. IEEE Transactions on Electron Devices, 1979, 26(4): 453-461.
[20] Cao J, Xia T, Li J, et al. A Density-based Method for Adaptive LDA Model Selection [J]. Neurocomputing, 2009, 72(7-9): 1775-1781.

[1] Chen Jie,Ma Jing,Li Xiaofeng. Short-Text Classification Method with Text Features from Pre-trained Models[J]. 数据分析与知识发现, 2021, 5(9): 21-30.
[2] Li Wenna,Zhang Zhixiong. Research on Knowledge Base Error Detection Method Based on Confidence Learning[J]. 数据分析与知识发现, 2021, 5(9): 1-9.
[3] Sun Yu, Qiu Jiangnan. Research on Influence of Opinion Leaders Based on Network Analysis and Text Mining [J]. 数据分析与知识发现, 0, (): 1-.
[4] Wang Qinjie, Qin Chunxiu, Ma Xubu, Liu Huailiang, Xu Cunzhen. Recommending Scientific Literature Based on Author Preference and Heterogeneous Information Network[J]. 数据分析与知识发现, 2021, 5(8): 54-64.
[5] Li Wenna, Zhang Zhixiong. Entity Alignment Method for Different Knowledge Repositories with Joint Semantic Representation[J]. 数据分析与知识发现, 2021, 5(7): 1-9.
[6] Wang Hao, Lin Kerou, Meng Zhen, Li Xinlei. Identifying Multi-Type Entities in Legal Judgments with Text Representation and Feature Generation[J]. 数据分析与知识发现, 2021, 5(7): 10-25.
[7] Yang Hanxun, Zhou Dequn, Ma Jing, Luo Yongcong. Detecting Rumors with Uncertain Loss and Task-level Attention Mechanism[J]. 数据分析与知识发现, 2021, 5(7): 101-110.
[8] Xu Yuemei, Wang Zihou, Wu Zixin. Predicting Stock Trends with CNN-BiLSTM Based Multi-Feature Integration Model[J]. 数据分析与知识发现, 2021, 5(7): 126-138.
[9] Huang Mingxuan,Jiang Caoqing,Lu Shoudong. Expanding Queries Based on Word Embedding and Expansion Terms[J]. 数据分析与知识发现, 2021, 5(6): 115-125.
[10] Wang Xiwei,Jia Ruonan,Wei Yanan,Zhang Liu. Clustering User Groups of Public Opinion Events from Multi-dimensional Social Network[J]. 数据分析与知识发现, 2021, 5(6): 25-35.
[11] Ruan Xiaoyun,Liao Jianbin,Li Xiang,Yang Yang,Li Daifeng. Interpretable Recommendation of Reinforcement Learning Based on Talent Knowledge Graph Reasoning[J]. 数据分析与知识发现, 2021, 5(6): 36-50.
[12] Liu Tong,Liu Chen,Ni Weijian. A Semi-Supervised Sentiment Analysis Method for Chinese Based on Multi-Level Data Augmentation[J]. 数据分析与知识发现, 2021, 5(5): 51-58.
[13] Chen Wenjie,Wen Yi,Yang Ning. Fuzzy Overlapping Community Detection Algorithm Based on Node Vector Representation[J]. 数据分析与知识发现, 2021, 5(5): 41-50.
[14] Zhang Guobiao,Li Jie. Detecting Social Media Fake News with Semantic Consistency Between Multi-model Contents[J]. 数据分析与知识发现, 2021, 5(5): 21-29.
[15] Yan Qiang,Zhang Xiaoyan,Zhou Simin. Extracting Keywords Based on Sememe Similarity[J]. 数据分析与知识发现, 2021, 5(4): 80-89.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938