Please wait a minute...
Data Analysis and Knowledge Discovery  2018, Vol. 2 Issue (10): 77-83    DOI: 10.11925/infotech.2096-3467.2018.0114
Current Issue | Archive | Adv Search |
Recognizing Metaphor with Convolution Neural Network and SVM
Huang Xiaoxi, Li Hanyu(), Wang Rongbo, Wang Xiaohua, Chen Zhiqun
Institute of Cognitive and Intelligent Computing, Hangzhou Dianzi University, Hangzhou 310018, China
Download: PDF (576 KB)   HTML ( 2
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper presents a new method to recognize metaphor, from the Chinese and English datasets. [Methods] First, we mapped the experimental dataset to vector space, which was also input to a convolutional neural network along with the property and keyword features. Then, we extracted the needed features with the help of convolutional and pooled layers, as well as classified them using SVM. Finally, we combined the Max-Pooling and Mean-Pooling to improve the extracted features’ accuracy. [Results] Compared with the traditional models, our method increased the accuracy of extracted features from the corpus of English verb-object, English adjective-noun and Chinese metaphor by 4.12%, 0.84% and 4.50% respectively. [Limitations] The Chinese word segmentation affects the training of word vector model. We need to add more layers to the convolutional neural networks. [Conclusions] The proposed method could effectively identify metaphor from Chinese and English corpus.

Key wordsMetaphor Recognition      Convolution Neural Network      Support Vector Machines      Feature Extraction     
Received: 29 January 2018      Published: 12 November 2018
ZTFLH:  TP391  

Cite this article:

Huang Xiaoxi,Li Hanyu,Wang Rongbo,Wang Xiaohua,Chen Zhiqun. Recognizing Metaphor with Convolution Neural Network and SVM. Data Analysis and Knowledge Discovery, 2018, 2(10): 77-83.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2018.0114     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2018/V2/I10/77

Verb Noun Class Relation
See development
Live dream
Envy eat
Break window
Boy cry
Paint dry
Metaphorical
Metaphorical
Metaphorical
Literal
Literal
Literal
VO
VO
SV
VO
SV
SV
Metaphorical Literal
bright smile
bushy eyebrows
cautious smile
dark history
deep faith
desolate beauty
economic battle
fading memory
faint impression
blue fence
blinding light
biting dog
bright sun
bright light
burning tree
burning arm
dark face
dirty hands
实验 准确率
CNN-sentence-eng 81.80%
CNN_SVM -sentence-eng 87.23%
CNN-Word/Pos-eng 86.00%
CNN_SVM -Word/Pos-eng 90.12%
CNN-AN-eng 86.36%
CNN_SVM -AN-eng 87.20%
Rei等[13] 83.00%
实验 准确率
CNN-sentence-ch 72.5%
CNN_SVM -sentence-ch 77.00%
[1] Wilks Y.A Preferential, Pattern-seeking, Semantics for Natural Language Inference[A]// Words and Intelligence I. Text, Speech and Language Technology[M]. Springer, 2007.
[2] Fass D.Met*: A Method for Discriminating Metonymy and Metaphor by Computer[J]. Computational Linguistics, 1991, 17(1): 49-90.
[3] Neuman Y, Assaf D, Cohen Y, et al.Metaphor Identification in Large Texts Corpora[J]. PLoS One, 2013, 8(4): e62343.
doi: 10.1371/journal.pone.0062343 pmid: 3639214
[4] Shutova E, Sun L, Korgonen A.Metaphor Identification Using Verb and Nouns Clustering[C]// Proceedings of the 23rd International Conference on Computational Linguistics. 2010.
[5] Hovy D, Srivastava S, Kumar S, et al.Identifying Metaphorical Word Use with Tree Kernels[C]// Proceedings of the 1st Workshop on Metaphor in NLP. 2013.
[6] Rai S, Chakraverty S, Tayal D K.Supervised Metaphor Detection Using Conditional Random Fields[C]// Proceedings of the 4th Workshop on Metaphor in NLP. 2016.
[7] Tsvetkov Y, Boytsov L, Gershman A, et al.Metaphor Detection with Cross-Lingual Model Transfer[C]// Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 2014.
[8] Kalchbrenner N, Grefenstette E, Blunsom P.A Convolutional Neural Network for Modelling Sentences[OL]. arXiv Preprint, arXiv: 1404.2188.
[9] Graves A, Fernández S, Schmidhuber J.Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition[A]// Artificial Neural Networks: Formal Models and Their Applications[M]. Springer, 2005.
[10] Graves A, Schmidhuber J.Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures[J]. Neural Networks, 2005, 18:602-610.
doi: 10.1016/j.neunet.2005.06.042 pmid: 16112549
[11] Dinh E L D, Gurevych I. Token-Level Metaphor Detection Using Neural Networks[C]// Proceedings of the 4th Workshop on Metaphor in NLP. 2016.
[12] Bizzoni Y, Chatzikyriakidis S, Ghanimifard M.“Deep” Learning: Detecting Metaphoricity in Adjective-Noun Pairs[C]// Proceedings of the Workshop on Stylistic Variation. 2017: 43-52.
[13] Rei M, Bulat L, Kiela D, et al.Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection[C]// Proceedings of EMNLP. 2017: 1537-1546.
[14] 王治敏, 王厚峰, 俞士汶. 基于机器学习方法的汉语名词隐喻识别[J]. 高技术通讯, 2006, 17(6): 575-580.
doi: 10.3321/j.issn:1002-0470.2007.06.005
[14] (Wang Zhimin, Wang Houfeng, Yu Shiwen.Chinese Nominal Metaphor Recognition Based on Machine Learning[J]. Chinese High Technology Letter, 2006, 17(6): 575-580.)
doi: 10.3321/j.issn:1002-0470.2007.06.005
[15] 徐扬. 基于最大熵模型的汉语隐喻现象识别[J]. 计算机工程和科学, 2007, 29(4): 95-103.
[15] (Xu Yang.Recognition of the Chinese Metaphor Phenomena Based on the Maximum Entropy Model[J]. Computer Engineering and Science, 2007, 29(4): 95-103.)
[16] 李斌, 于丽丽, 石民, 等. “像”的明喻计算[J]. 中文信息学报, 2008, 22(6): 27-32.
[16] (Li Bin, Yu Lili, Shi Min, et al.Computation of Chinese Simile with “Xiang”[J]. Journal of Chinese Information Processing, 2008, 22(6): 27-32.)
[17] 黄孝喜. 隐喻机器理解的若干关键问题研究[D]. 杭州: 浙江大学, 2009.
[17] (Huang Xiaoxi.Research on Some Key Issues of Metaphor Computation[D]. Hangzhou: Zhejiang University, 2009.)
[18] Kim Y.Convolutional Neural Networks for Sentence Classification [OL]. arXiv Preprint, arXiv: 1408.5882.
[19] Mikolov T, Chen K, Corrado G, et al.Efficient Estimation of Word Representations in Vector Space[OL]. arXiv Preprint, arXiv: 1301.3781.
[20] Mikolov T, Sutskever I, Chen K, et al.Distributed Representations of Words and Phrases and Their Com- positionality[A]// Advances in Neural Information Processing Systems[M]. Springer, 2013.
[21] Lécun Y, Bottou L, Bengio Y, et al.Gradient-based Learning Applied to Document Recognition[J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
doi: 10.1109/5.726791
[22] 李航. 统计学习方法[M]. 第1版. 北京: 清华大学出版社, 2016: 95-123.
[22] (Li Hang.Statistical Learning Method[M]. The 1st Edition. Beijing: Tsinghua University Publishing House, 2016: 95-123.)
[1] Zheng Xinman, Dong Yu. Constructing Degree Lexicon for STI Policy Texts[J]. 数据分析与知识发现, 2021, 5(10): 81-93.
[2] Zhang Dongyu,Cui Zijuan,Li Yingxia,Zhang Wei,Lin Hongfei. Identifying Noun Metaphors with Transformer and BERT[J]. 数据分析与知识发现, 2020, 4(4): 100-108.
[3] Su Chuandong,Huang Xiaoxi,Wang Rongbo,Chen Zhiqun,Mao Junyu,Zhu Jiaying,Pan Yuhao. Identifying Chinese / English Metaphors with Word Embedding and Recurrent Neural Network[J]. 数据分析与知识发现, 2020, 4(4): 91-99.
[4] Cai Jingxuan,Wu Jiang,Wang Chengkun. Predicting Usefulness of Crowd Testing Reports with Deep Learning[J]. 数据分析与知识发现, 2020, 4(11): 102-111.
[5] Hui Nie,Huan He. Identifying Implicit Features with Word Embedding[J]. 数据分析与知识发现, 2020, 4(1): 99-110.
[6] Gang Li,Huayang Zhou,Jin Mao,Sijing Chen. Classifying Social Media Users with Machine Learning[J]. 数据分析与知识发现, 2019, 3(8): 1-9.
[7] Xiaofeng Li,Jing Ma,Chi Li,Hengmin Zhu. Identifying Commodity Names Based on XGBoost Model[J]. 数据分析与知识发现, 2019, 3(7): 34-41.
[8] Jiao Yan,Jing Ma,Kang Fang. Computing Text Semantic Similarity with Syntactic Network of Co-occurrence Distance[J]. 数据分析与知识发现, 2019, 3(12): 93-100.
[9] Qinghong Zhong,Xiaodong Qiao,Yunliang Zhang,Mengjuan Weng. Cross-media Fusion Method Based on LDA2Vec and Residual Network[J]. 数据分析与知识发现, 2019, 3(10): 78-88.
[10] Guijun Yang,Xue Xu,Fuqiang Zhao. Predicting User Ratings with XGBoost Algorithm[J]. 数据分析与知识发现, 2019, 3(1): 118-126.
[11] Zhou Lixin,Lin Jie. Extracting Product Features with NodeRank Algorithm[J]. 数据分析与知识发现, 2018, 2(4): 90-98.
[12] Li Weiqing,Wang Weijun. Building Product Feature Dictionary with Large-scale Review Data[J]. 数据分析与知识发现, 2018, 2(1): 41-50.
[13] Li Changbing,Pang Chongpeng,Li Meiping. Extracting Product Features with Weight-based Apriori Algorithm[J]. 数据分析与知识发现, 2017, 1(9): 83-89.
[14] Du Siqi, Li Honglian, Lv Xueqiang. Research of Chinese Chunk Parsing in Application of the Product Feature Extraction[J]. 现代图书情报技术, 2015, 31(9): 26-30.
[15] Lu Yonghe, Liang Minghui. Improvement of Text Feature Extraction with Genetic Algorithm[J]. 现代图书情报技术, 2014, 30(4): 48-57.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn