Please wait a minute...
Data Analysis and Knowledge Discovery
Current Issue | Archive | Adv Search |
IMTS: Fake review detection method by fusing image and text semantics
Shi Yunmei,Yuan Bo,Zhang Le,lv Xueqiang
(Beijing Key Laboratory of Internet Culture and Digital Dissemination Research, Beijing Information Science and Technology University, Beijing 100101, China) (School of computer science, Beijing Information Science and Technology University, Beijing 100101, China)
Download:
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective]Aiming at the problem of the proliferation of fake comment information published by "Internet Water Army" on e-commerce websites, a fake comment detection method (IMTS) that integrates image information and text semantics for Chinese e-commerce website comments is integrated.

[Methods]The IMTS method uses the text convolutional neural network (TextCNN) and the Bert pre-training model to extract the features of the text review information, and obtain the corresponding feature vectors. The reviewer features are then integrated, and the model's capture of the overall semantic information is further enhanced by splicing the review text semantics and the output features of the reviewer ID. Then use Residual Network (ResNet) to extract features from pictures posted by users in comments to obtain corresponding visual features, and finally perform multimodal fusion of text features and visual features to detect false comments.

[Results]The IMTS method achieves 96.36% accuracy, 96.35% recall and 96.35% F1 value on the self-built multimodal Chinese fake comment dataset.

[Limitations]Due to the limitation of computing power, the dataset in this paper is small in scale, and the Bert pre-training model is used in the text processing stage. In the case of large-scale data computing, the time cost is high.

[Conclusions] It is effective to use multi-modal thinking and feature fusion method to supplement the fake comment text to detect fake comments. This method can effectively improve the overall detection accuracy of fake comments.

Key words False comment      Multimodal      Text      Image      Bert      
Published: 29 March 2022
ZTFLH:  TP393  

Cite this article:

Shi Yunmei, Yuan Bo, Zhang Le, lv Xueqiang. IMTS: Fake review detection method by fusing image and text semantics . Data Analysis and Knowledge Discovery, 0, (): 1-.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2021-1245     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y0/V/I/1

[1] Zhao Meng, Wang Hao, Li Xiaomin. Recognition of Emotions and Analysis of Emotional Changes in Chinese Folk Songs[J]. 数据分析与知识发现, 2023, 7(7): 111-124.
[2] Cheng Quan, Dong Jia. Hierarchical Multi-label Classification of Children's Literature for Graded Reading[J]. 数据分析与知识发现, 2023, 7(7): 156-169.
[3] Liu Meiling, Shang Yue, Zhao Tiejun, Zhou Jiyun. Unbalanced Fake Review Processing Model Based on Cost-Sensitive Learning[J]. 数据分析与知识发现, 2023, 7(6): 113-122.
[4] Shi Guoliang, Zhou Shu, Wang Yunfeng, Shi Chunjiang, Liu Liang. Generating Patent Text Abstracts Based on Improved Multi-head Attention Mechanism[J]. 数据分析与知识发现, 2023, 7(6): 61-72.
[5] Xu Guixian, Zhang Zixin, Yu Shaona, Dong Yushuang, Tian Yuan. Tibetan News Text Classification Based on Graph Convolutional Networks[J]. 数据分析与知识发现, 2023, 7(6): 73-85.
[6] Xu Kang, Yu Shengnan, Chen Lei, Wang Chuandong. Linguistic Knowledge-Enhanced Self-Supervised Graph Convolutional Network for Event Relation Extraction[J]. 数据分析与知识发现, 2023, 7(5): 92-104.
[7] Ben Yanyan, Pang Xueqin. Identifying Medical Named Entities with Word Information[J]. 数据分析与知识发现, 2023, 7(5): 123-132.
[8] Liu Yang, Zhang Wen, Hu Yi, Mao Jin, Huang Fei. Hotel Stock Prediction Based on Multimodal Deep Learning[J]. 数据分析与知识发现, 2023, 7(5): 21-32.
[9] Ye Guanghui, Li Songye, Song Xiaoying. Text Classification Method for Urban Portrait Based on Multi-Label Annotation Learning[J]. 数据分析与知识发现, 2023, 7(5): 60-70.
[10] Pan Huali, Xie Jun, Gao Jing, Xu Xinying, Wang Changzheng. A Deep Reinforcement Learning Recommendation Model with Multi-modal Features[J]. 数据分析与知识发现, 2023, 7(4): 114-128.
[11] Zhang Yu, Zhang Haijun, Liu Yaqing, Liang Kejin, Wang Yueyang. Multimodal Sentiment Analysis Based on Bidirectional Mask Attention Mechanism[J]. 数据分析与知识发现, 2023, 7(4): 46-55.
[12] Li Jialei, An Peijun, Xiao Xiantao. Review of Methods for Interdisciplinary Topic Identification[J]. 数据分析与知识发现, 2023, 7(4): 1-15.
[13] Lv Qi, Shangguan Yanhong, Zhang Lin, Huang Ying. Interdisciplinary Measurement Based on Automatic Classification of Text Content[J]. 数据分析与知识发现, 2023, 7(4): 56-67.
[14] Li Daifeng, Lin Kaixin, Li Xuting. Identifying Named Entities of Adverse Drug Reaction with Adversarial Transfer Learning[J]. 数据分析与知识发现, 2023, 7(3): 121-130.
[15] Zhao Chaoyang, Zhu Guibo, Wang Jinqiao. The Inspiration Brought by ChatGPT to LLM and the New Development Ideas of Multi-modal Large Model[J]. 数据分析与知识发现, 2023, 7(3): 26-35.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn