Please wait a minute...
Data Analysis and Knowledge Discovery  2018, Vol. 2 Issue (10): 77-83    DOI: 10.11925/infotech.2096-3467.2018.0114
Current Issue | Archive | Adv Search |
Recognizing Metaphor with Convolution Neural Network and SVM
Xiaoxi Huang,Hanyu Li(),Rongbo Wang,Xiaohua Wang,Zhiqun Chen
Institute of Cognitive and Intelligent Computing, Hangzhou Dianzi University, Hangzhou 310018, China
Download: PDF(576 KB)   HTML
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper presents a new method to recognize metaphor, from the Chinese and English datasets. [Methods] First, we mapped the experimental dataset to vector space, which was also input to a convolutional neural network along with the property and keyword features. Then, we extracted the needed features with the help of convolutional and pooled layers, as well as classified them using SVM. Finally, we combined the Max-Pooling and Mean-Pooling to improve the extracted features’ accuracy. [Results] Compared with the traditional models, our method increased the accuracy of extracted features from the corpus of English verb-object, English adjective-noun and Chinese metaphor by 4.12%, 0.84% and 4.50% respectively. [Limitations] The Chinese word segmentation affects the training of word vector model. We need to add more layers to the convolutional neural networks. [Conclusions] The proposed method could effectively identify metaphor from Chinese and English corpus.

Key wordsMetaphor Recognition      Convolution Neural Network      Support Vector Machines      Feature Extraction     
Received: 29 January 2018      Published: 12 November 2018

Cite this article:

Xiaoxi Huang,Hanyu Li,Rongbo Wang,Xiaohua Wang,Zhiqun Chen. Recognizing Metaphor with Convolution Neural Network and SVM. Data Analysis and Knowledge Discovery, 2018, 2(10): 77-83.

URL:

http://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2018.0114     OR     http://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2018/V2/I10/77

Verb Noun Class Relation
See development
Live dream
Envy eat
Break window
Boy cry
Paint dry
Metaphorical
Metaphorical
Metaphorical
Literal
Literal
Literal
VO
VO
SV
VO
SV
SV
Metaphorical Literal
bright smile
bushy eyebrows
cautious smile
dark history
deep faith
desolate beauty
economic battle
fading memory
faint impression
blue fence
blinding light
biting dog
bright sun
bright light
burning tree
burning arm
dark face
dirty hands
实验 准确率
CNN-sentence-eng 81.80%
CNN_SVM -sentence-eng 87.23%
CNN-Word/Pos-eng 86.00%
CNN_SVM -Word/Pos-eng 90.12%
CNN-AN-eng 86.36%
CNN_SVM -AN-eng 87.20%
Rei等[13] 83.00%
实验 准确率
CNN-sentence-ch 72.5%
CNN_SVM -sentence-ch 77.00%
[1] Wilks Y.A Preferential, Pattern-seeking, Semantics for Natural Language Inference[A]// Words and Intelligence I. Text, Speech and Language Technology[M]. Springer, 2007.
[2] Fass D.Met*: A Method for Discriminating Metonymy and Metaphor by Computer[J]. Computational Linguistics, 1991, 17(1): 49-90.
[3] Neuman Y, Assaf D, Cohen Y, et al.Metaphor Identification in Large Texts Corpora[J]. PLoS One, 2013, 8(4): e62343.
doi: 10.1371/journal.pone.0062343 pmid: 3639214
[4] Shutova E, Sun L, Korgonen A.Metaphor Identification Using Verb and Nouns Clustering[C]// Proceedings of the 23rd International Conference on Computational Linguistics. 2010.
[5] Hovy D, Srivastava S, Kumar S, et al.Identifying Metaphorical Word Use with Tree Kernels[C]// Proceedings of the 1st Workshop on Metaphor in NLP. 2013.
[6] Rai S, Chakraverty S, Tayal D K.Supervised Metaphor Detection Using Conditional Random Fields[C]// Proceedings of the 4th Workshop on Metaphor in NLP. 2016.
[7] Tsvetkov Y, Boytsov L, Gershman A, et al.Metaphor Detection with Cross-Lingual Model Transfer[C]// Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 2014.
[8] Kalchbrenner N, Grefenstette E, Blunsom P.A Convolutional Neural Network for Modelling Sentences[OL]. arXiv Preprint, arXiv: 1404.2188.
[9] Graves A, Fernández S, Schmidhuber J.Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition[A]// Artificial Neural Networks: Formal Models and Their Applications[M]. Springer, 2005.
[10] Graves A, Schmidhuber J.Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures[J]. Neural Networks, 2005, 18:602-610.
doi: 10.1016/j.neunet.2005.06.042 pmid: 16112549
[11] Dinh E L D, Gurevych I. Token-Level Metaphor Detection Using Neural Networks[C]// Proceedings of the 4th Workshop on Metaphor in NLP. 2016.
[12] Bizzoni Y, Chatzikyriakidis S, Ghanimifard M.“Deep” Learning: Detecting Metaphoricity in Adjective-Noun Pairs[C]// Proceedings of the Workshop on Stylistic Variation. 2017: 43-52.
[13] Rei M, Bulat L, Kiela D, et al.Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection[C]// Proceedings of EMNLP. 2017: 1537-1546.
[14] 王治敏, 王厚峰, 俞士汶. 基于机器学习方法的汉语名词隐喻识别[J]. 高技术通讯, 2006, 17(6): 575-580.
doi: 10.3321/j.issn:1002-0470.2007.06.005
[14] (Wang Zhimin, Wang Houfeng, Yu Shiwen.Chinese Nominal Metaphor Recognition Based on Machine Learning[J]. Chinese High Technology Letter, 2006, 17(6): 575-580.)
[15] 徐扬. 基于最大熵模型的汉语隐喻现象识别[J]. 计算机工程和科学, 2007, 29(4): 95-103.
[15] (Xu Yang.Recognition of the Chinese Metaphor Phenomena Based on the Maximum Entropy Model[J]. Computer Engineering and Science, 2007, 29(4): 95-103.)
[16] 李斌, 于丽丽, 石民, 等. “像”的明喻计算[J]. 中文信息学报, 2008, 22(6): 27-32.
[16] (Li Bin, Yu Lili, Shi Min, et al.Computation of Chinese Simile with “Xiang”[J]. Journal of Chinese Information Processing, 2008, 22(6): 27-32.)
[17] 黄孝喜. 隐喻机器理解的若干关键问题研究[D]. 杭州: 浙江大学, 2009.
[17] (Huang Xiaoxi.Research on Some Key Issues of Metaphor Computation[D]. Hangzhou: Zhejiang University, 2009.)
[18] Kim Y.Convolutional Neural Networks for Sentence Classification [OL]. arXiv Preprint, arXiv: 1408.5882.
[19] Mikolov T, Chen K, Corrado G, et al.Efficient Estimation of Word Representations in Vector Space[OL]. arXiv Preprint, arXiv: 1301.3781.
[20] Mikolov T, Sutskever I, Chen K, et al.Distributed Representations of Words and Phrases and Their Com- positionality[A]// Advances in Neural Information Processing Systems[M]. Springer, 2013.
[21] Lécun Y, Bottou L, Bengio Y, et al.Gradient-based Learning Applied to Document Recognition[J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
doi: 10.1109/5.726791
[22] 李航. 统计学习方法[M]. 第1版. 北京: 清华大学出版社, 2016: 95-123.
[22] (Li Hang.Statistical Learning Method[M]. The 1st Edition. Beijing: Tsinghua University Publishing House, 2016: 95-123.)
[1] Lixin Zhou,Jie Lin. Extracting Product Features with NodeRank Algorithm[J]. 数据分析与知识发现, 2018, 2(4): 90-98.
[2] Weiqing Li,Weijun Wang. Building Product Feature Dictionary with Large-scale Review Data[J]. 数据分析与知识发现, 2018, 2(1): 41-50.
[3] Changbing Li,Chongpeng Pang,Meiping Li. Extracting Product Features with Weight-based Apriori Algorithm[J]. 数据分析与知识发现, 2017, 1(9): 83-89.
[4] Du Siqi, Li Honglian, Lv Xueqiang. Research of Chinese Chunk Parsing in Application of the Product Feature Extraction[J]. 现代图书情报技术, 2015, 31(9): 26-30.
[5] Lu Yonghe, Liang Minghui. Improvement of Text Feature Extraction with Genetic Algorithm[J]. 现代图书情报技术, 2014, 30(4): 48-57.
[6] Tang Xiaobo, Xiao Lu. Research of Text Feature Extraction on Dependency Parsing Network[J]. 现代图书情报技术, 2014, 30(11): 31-37.
[7] You Guirong, Wu Wei, Qian Yuntao. Feature Extraction Method for Detecting Spam in Electronic Commerce[J]. 现代图书情报技术, 2014, 30(10): 93-100.
[8] Xu Jian, Wen Haosheng. Study on Talents Description Web Page Automatic Recognition System[J]. 现代图书情报技术, 2011, 27(6): 20-26.
[9] Yang Zhizhuo,Han Xie. An Algorithm of Text Information Filtering Based on Feature Extraction[J]. 现代图书情报技术, 2008, 24(4): 29-34.
[10] Ying Wei,Wang Zhengou,An Jinlong. Research on Two Classes Text Categorization Method Based on an Improved Support Vector Machine[J]. 现代图书情报技术, 2005, 21(12): 44-47.
[11] Jin Yi,Huang Min. Study on the Melody Based Retrieval of Music——Input Recognition of Melodic Features[J]. 现代图书情报技术, 2004, 20(1): 41-45.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn