Please wait a minute...
Data Analysis and Knowledge Discovery  2019, Vol. 3 Issue (5): 86-92    DOI: 10.11925/infotech.2096-3467.2018.0818
Current Issue | Archive | Adv Search |
Extracting Relationship of Agricultural Financial Texts with Attention Mechanism
Yuemin Wu,Ganggui Ding,Bin Hu()
College of Information Science and Technology, Nanjing Agricultural University, Nanjing 210095, China
Download: PDF (710 KB)   HTML ( 19
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper proposes a new method to extract relations from Chinese texts automatically. [Methods] We retrieved annual reports of 224 listed agricultural companies from 2015 to 2017. Then we adopted the Gated Recurrent Unit algorithm based on double attention mechanism to extract the needed data. [Results] The average accuracy of our model on the agricultural financial dataset reached 78%. Compared with the Recurrent Neural Network algorithm, the average accuracy of the new model increased by about 12%. [Limitations] We only studied data from 224 companies, which needs to be expanded. [Conclusions] The proposed model can effectively extract relationship from agricultural financial texts.

Key wordsAttention Mechanism      Relationship Extraction      Agricultural Finance     
Received: 24 July 2018      Published: 03 July 2019

Cite this article:

Yuemin Wu,Ganggui Ding,Bin Hu. Extracting Relationship of Agricultural Financial Texts with Attention Mechanism. Data Analysis and Knowledge Discovery, 2019, 3(5): 86-92.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2018.0818     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2019/V3/I5/86

[1] 董静, 孙乐, 冯元勇, 等. 中文实体关系抽取中的特征选择研究[J]. 中文信息学报, 2007, 21(4): 80-91.
[1] (Dong Jing, Sun Le, Feng Yuanyong, et al.Chinese Automatic Entity Relation Extraction[J]. Journal of Chinese Information Processing, 2007, 21(4): 80-91.)
[2] 贾真, 冶忠林, 尹红风, 等. 基于Tri-training与噪声过滤的弱监督关系抽取[J]. 中文信息学报, 2016, 30(4): 142-149.
[2] (Jia Zhen, Ye Zhonglin, Yin Hongfeng, et al.Weakly Supervised Relation Extraction Based on Tri-training and Noise Filtering[J]. Journal of Chinese Information Processing, 2016, 30(4): 142-149.)
[3] 黄蓓静. 深度学习技术在中文人物关系抽取中的应用研究[D]. 上海:华东师范大学, 2017.
[3] (Huang Beijing.Study on the Application of Deep Learning Technology in Chinese Personal Relation Extraction[D]. Shanghai: East China Normal University, 2017.)
[4] Culotta A, McCallum A, Betz J. Integrating Probabilistic Extraction Models and Data Mining to Discover Relations and Patterns in Text[C]// Proceedings of the Main Conference on Human Language Technology. 2006: 296-303.
[5] 韩冰, 林鸿飞. 基于支撑向量机的人物关系抽取[C]// 第七届中文信息处理国际会议. 北京: 电子工业出版社, 2007.
[5] (Han Bing, Lin Hongfei.Characters Extraction Based on Support Vector Machine[C]// Proceedings of the 7th International Conference on Chinese Information Processing. Beijing: Publishing House of Electronics Industry, 2007.)
[6] Zhao S, Grishman R.Extracting Relations with Integrated Information Using Kernel Methods[C]// Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics. 2005: 419-426.
[7] Bunescu R C, Mooney R J.Subsequence Kernels for Relation Extraction[C]// Proceedings of the 2006 International Conference on Neural Information Processing Systems. MIT Press, 2006: 171-178.
[8] 车万翔, 刘挺, 李生. 实体关系自动抽取[J]. 中文信息学报, 2005, 19(2): 2-7.
[8] (Che Wanxiang, Liu Ting, Li Sheng.Automatic Entity Relation Extraction[J]. Journal of Chinese Information Processing, 2005, 19(2): 2-7.)
[9] Mintz M, Bills S, Snow R, et al.Distant Supervision for Relation Extraction Without Labeled Data[C]// Proceedings of the 4th International Joint Conference on Natural Language Processing of the AFNLP. 2009: 1003-1011.
[10] Socher R, Huval B, Manning C D, et al.Semantic Compositionality Through Recursive Matrix-Vector Spaces[C]// Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. 2012: 1201-1211.
[11] Zeng D, Liu K, Lai S, et al.Relation Classification via Convolutional Deep Neural Network[C]// Proceedings of the 25th International Conference on Computational Linguistics. 2014: 2335-2344.
[12] Zhang D, Wang D.Relation Classification via Recurrent Neural Network[OL]. arXiv Preprint. arXiv: 1508. 01006.
[13] Zhou P, Shi W, Tian J, et al.Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification[C]// Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 2016: 207-212.
[14] Lin Y, Shen S, Liu Z, et al.Neural Relation Extraction with Selective Attention over Instances[C]// Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 2016: 2124-2133.
[15] Cho K, Van Merrienboer B, Gulcehre C, et al.Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation[OL]. arXiv Preprint. arXiv: 1406. 1078.
[16] Santos C N, Xiang B, Zhou B.Classifying Relations by Ranking with Convolutional Neural Networks[OL]. arXiv Preprint. arXiv: 1504. 06580.
[1] Yang Hanxun, Zhou Dequn, Ma Jing, Luo Yongcong. Detecting Rumors with Uncertain Loss and Task-level Attention Mechanism[J]. 数据分析与知识发现, 2021, 5(7): 101-110.
[2] Xie Hao,Mao Jin,Li Gang. Sentiment Classification of Image-Text Information with Multi-Layer Semantic Fusion[J]. 数据分析与知识发现, 2021, 5(6): 103-114.
[3] Yin Pengbo,Pan Weimin,Zhang Haijun,Chen Degang. Identifying Clickbait with BERT-BiGA Model[J]. 数据分析与知识发现, 2021, 5(6): 126-134.
[4] Han Pu,Zhang Zhanpeng,Zhang Mingtao,Gu Liang. Normalizing Chinese Disease Names with Multi-feature Fusion[J]. 数据分析与知识发现, 2021, 5(5): 83-94.
[5] Duan Jianyong,Wei Xiaopeng,Wang Hao. A Multi-Perspective Co-Matching Model for Machine Reading Comprehension[J]. 数据分析与知识发现, 2021, 5(4): 134-141.
[6] Wang Yuzhu,Xie Jun,Chen Bo,Xu Xinying. Multi-modal Sentiment Analysis Based on Cross-modal Context-aware Attention[J]. 数据分析与知识发现, 2021, 5(4): 49-59.
[7] Dai Zhihong, Hao Xiaoling. Extracting Hypernym-Hyponym Relationship for Financial Market Applications[J]. 数据分析与知识发现, 2021, 5(10): 60-70.
[8] Jiang Cuiqing,Wang Xiangxiang,Wang Zhao. Forecasting Car Sales Based on Consumer Attention[J]. 数据分析与知识发现, 2021, 5(1): 128-139.
[9] Huang Lu,Zhou Enguo,Li Daifeng. Text Representation Learning Model Based on Attention Mechanism with Task-specific Information[J]. 数据分析与知识发现, 2020, 4(9): 111-122.
[10] Yin Haoran,Cao Jinxuan,Cao Luzhe,Wang Guodong. Identifying Emergency Elements Based on BiGRU-AM Model with Extended Semantic Dimension[J]. 数据分析与知识发现, 2020, 4(9): 91-99.
[11] Shi Lei,Wang Yi,Cheng Ying,Wei Ruibin. Review of Attention Mechanism in Natural Language Processing[J]. 数据分析与知识发现, 2020, 4(5): 1-14.
[12] Xue Fuliang,Liu Lifang. Fine-Grained Sentiment Analysis with CRF and ATAE-LSTM[J]. 数据分析与知识发现, 2020, 4(2/3): 207-213.
[13] Qi Ruihua,Jian Yue,Guo Xu,Guan Jinghua,Yang Mingxin. Sentiment Analysis of Cross-Domain Product Reviews Based on Feature Fusion and Attention Mechanism[J]. 数据分析与知识发现, 2020, 4(12): 85-94.
[14] Xu Tongtong,Sun Huazhi,Ma Chunmei,Jiang Lifen,Liu Yichen. Classification Model for Few-shot Texts Based on Bi-directional Long-term Attention Features[J]. 数据分析与知识发现, 2020, 4(10): 113-123.
[15] Yuman Li,Zhibo Chen,Fu Xu. Classifying Texts with KACC Model[J]. 数据分析与知识发现, 2019, 3(10): 89-97.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn