[Objective] This paper proposes a new method to recognize emergency elements based on a modified BiGRU-AM model, aiming to improve the poor interpretation of recurrent neural networks for information features with different degrees of importance.[Methods] First, we trained the text corpus to create word vectors, which were connected to semantic features like dependent syntactic relations. Then, we extracted contextual information features with BiGRU. We also introduced attention mechanism to the BiGRU network to extract diversified features. Finally, we activated the learned features with softmax function to generate needed elements.[Results] We examined the modified BiGRU-AM model with the CEC dataset and found its F-value was 2%-21% higher than algorithms of shallow machine learning.[Limitations] The proposed model’s ablilty to decide semantic relations, the accuracy of word segmentation tool, and the hyper parameters need to be improved.[Conclusions] The BiGRU-AM model with extended semantic dimension could effectively extract emergency elements.
尹浩然,曹金璇,曹鲁喆,王国栋. 扩充语义维度的BiGRU-AM突发事件要素识别研究*[J]. 数据分析与知识发现, 2020, 4(9): 91-99.
Yin Haoran,Cao Jinxuan,Cao Luzhe,Wang Guodong. Identifying Emergency Elements Based on BiGRU-AM Model with Extended Semantic Dimension. Data Analysis and Knowledge Discovery, 2020, 4(9): 91-99.
( Xia Yan, He Lin, Pan Yunlai, et al. Research on Recognition of Sudden Events on Web Based on Combination of Rules and Statistical Method[J]. New Technology of Library and Information Service, 2010(10):65-69.)
[3]
Zhong Z Y, Jin L W, Feng Z Y. Multi-font Printed Chinese Character Recognition Using Multi-pooling Convolutional Neural Network[C] //Proceedings of the 13th International Conference on Document Analysis and Recognition. DOI: 10.1109/ICDAR.2015.7333733.
( Jiang Deliang. Research on Extraction of Emergency Event Information Based on Rules Matching[J]. Computer Engineering and Design, 2010,31(14):3294-3297.)
( Yao Zhanlei, Xu Xin. Research on the Detection of Sudden Events in News Stories of Online Information[J]. New Technology of Library and Information Service, 2011(4):52-57.)
( Tang Huihui, Wang Hao, Zhang Zixuan, et al. Extracting Names of Historical Events Based on Chinese Character Tags[J]. Data Analysis and Knowledge Discovery, 2018,2(7):89-100.)
[8]
黎红. 基于深度学习的维吾尔语文本事件信息的抽取与分析[D]. 乌鲁木齐: 新疆大学, 2018.
[8]
( Li Hong. Extraction and Analysis of Event Information in Uyghur Language Based on Deep Learning[D]. Urumqi: Xinjiang University, 2018.)
( Shi Zheer, Chen Jinxiu. Event Detection via Recurrent and Convolutional Networks Based on Language Model[J]. Journal of Xiamen University (Natural Science), 2019,58(3):442-448.)
[10]
Liu K, Sun Z S, Jiang J F, et al. A Combined Events Recognition Scheme Using Hybrid Features in Distributed Optical Fiber Vibration Sensing System[J]. IEEE Access, 2019. DOI: 10.1109/ACCESS.2019.2932187.
doi: 10.1109/ACCESS.2019.2958985
pmid: 31942279
( Huang Xifeng. Event Extraction via Dynamic Masked Attention[J/OL]. Application Research of Computers. [2019-07-27]. https://doi.org/10.19734/j.issn.1001-3695.2018.12.0927.)
( Tu Ming, Liu Xiang, Liu Shuchun. Natural Language Processing: Core Technology and Algorithm with Python[M]. Beijing: China Machine Press, 2018.)
[15]
Mikolov T, Sutskever I, Chen K, et al. Distributed Representations of Words and Phrases and Their Compositionality[C] //Proceedings of the 26th International Conference on Neural Information Processing Systems. 2013: 3111-3119.
[16]
Mikolov T, Chen K, Corrado G, et al. Efficient Estimation of Word Representations in Vector Space[OL]. arXiv Preprint, arXiv: 1301.3781.
[17]
Cho K, van Merrienboer B, Gulcehre C, et al. Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation[OL]. arXiv Preprint, arXiv: 1406.1078.
[18]
Mnih V, Heess N, Graves A, et al. Recurrent Models of Visual Attention[C] //Proceedings of 2014 Advances in Neural Information Processing Systems. 2014: 2204-2212.
[19]
Bahdanau D, Cho K, Bengio Y. Neural Machine Translation by Jointly Learning to Align and Translate[C] //Proceedings of International Conference on Learning Representations, 2015.
[20]
Ahn D. The Stages of Event Extraction[C] //Proceedings of the Workshop on Annotating and Reasoning about Time and Events. 2006: 1-8.
( Qiu Qizhi Zhou Sansan Liu Changfa, et al. Emergency Information Extraction Based on Style and Terminology[J]. Journal of Chinese Information Processing, 2018,32(9):56-65, 74.)
[26]
Yin H R, Cao J X, Cao L Z, et al. Chinese Emergency Event Recognition Using Conv-RDBiGRU Model[J]. Computational Intelligence and Neuroscience, 2020: 7090918.
( Wen Chang, Liu Yu, Gu Jinguang. Evolution Relationship Extraction of Emergency Based on Attention-based Bidirectional Long Short-term Memory Network Model[J]. Journal of Computer Applications, 2019,39(6):1646-1651.)
[28]
Li D Y, Huang L F, Ji H, et al. Biomedical Event Extraction Based on Knowledge-driven Tree-LSTM[C] // Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019: 1421-1430.
[29]
Chen Y, Zhou C J, Li T X, et al. Named Entity Recognition from Chinese Adverse Drug Event Reports with Lexical Feature Based BiLSTM-CRF and Tri-training[J]. Journal of Biomedical Informatics, 2019,96:103252.
doi: 10.1016/j.jbi.2019.103252
pmid: 31323311