|
|
Annotation Method for Extracting Entity Relationship from Ancient Chinese Works |
Wang Yifan1,Li Bo2,Shi Hua3,Miao Wei1( ),Jiang Bin2 |
1School of Northeast Asia Studies, Shandong University, Weihai 264209, China 2School of Mechanical, Electrical & Information Engineering, Shandong University, Weihai 264209, China 3School of Transborder Studies, Arizona State University, Tucson 85257, USA |
|
|
Abstract [Objective] This paper proposes an annotation method for ancient Chinese datasets, aiming to standardize the annotation procedures. [Objective] We proposed a new method integrating logical semantics, deep learning and history knowledge. This model, which is suitable for few-shot learning, includes three principles of “annotation of relationship valence”, “annotation of propositional logic”, “existence of a single relationship”. [Results] We examined the proposed annotation model with the text dataset of Shiji (Historical Records in Chinese), and found its F1 values for the tasks of relationship extraction and the propositional logic extraction reached 42.02% and 34.07% respectively. [Limitations] The proposed method, which did not include the pre-trained models like BERT or ALBERT, only used the classic Word2Vec model for word embedding. The model's performance could be further improved. [Conclusions] Our new annotation method could effectively extract entity relationship from Ancient Chinese works.
|
Received: 10 May 2021
Published: 15 October 2021
|
|
Fund:*National Social Science Fund of China(17VGB005) |
Corresponding Authors:
Miao Wei
E-mail: miaowei@sdu.edu.cn
|
[1] |
石民, 李斌, 陈小荷. 基于CRF的先秦汉语分词标注一体化研究[J]. 中文信息学报, 2010, 24(2):39-45.
|
[1] |
( Shi Min, Li Bin, Chen Xiaohe. CRF Based Research on a Unified Approach to Word Segmentation and POS Tagging for Pre-Qin Chinese[J]. Journal of Chinese Information Processing, 2010, 24(2):39-45.)
|
[2] |
陈小荷. 先秦文献信息处理[M]. 北京: 世界图书出版公司, 2013.
|
[2] |
( Chen Xiaohe. Information Processing of Documents of Pre-Qin Period[M]. Beijing: Word Publishing Corporation, 2013.)
|
[3] |
严顺. 基于CRF的古汉语分词标注模型研究[J]. 江苏科技信息, 2016(8):10-12.
|
[3] |
( Yan Shun. Research on Word Segmentation and Tagging for Ancient Chinese Based on CRF[J]. Jiangsu Science & Technology Information, 2016(8):10-12.)
|
[4] |
王晓玉, 李斌. 基于CRFs和词典信息的中古汉语自动分词[J]. 数据分析与知识发现, 2017, 1(5):62-70.
|
[4] |
( Wang Xiaoyu, Li Bin. Automatically Segmenting Middle Ancient Chinese Words with CRFs[J]. Data Analysis and Knowledge Discovery, 2017, 1(5):62-70.)
|
[5] |
杨世超, 纪月, 赵立鹏. 基于条件随机场的古汉语分词研究[J]. 电脑知识与技术, 2017, 13(22):183-184.
|
[5] |
( Yang Shichao, Ji Yue, Zhao Lipeng. Study of Ancient Chinese Word Segmentation Based on Conditional Random Field[J]. Computer Knowledge and Technology, 2017, 13(22):183-184.)
|
[6] |
俞敬松, 魏一, 张永伟, 等. 基于非参数贝叶斯模型和深度学习的古文分词研究[J]. 中文信息学报, 2020, 34(6):1-8.
|
[6] |
( Yu Jingsong, Wei Yi, Zhang Yongwei, et al. Word Segmentation for Ancient Chinese Texts Based on Nonparametric Bayesian Models and Deep Learning[J]. Journal of Chinese Information Processing, 2020, 34(6):1-8.)
|
[7] |
黄水清, 王东波, 何琳. 基于先秦语料库的古汉语地名自动识别模型构建研究[J]. 图书情报工作, 2015, 59(12):135-140.
|
[7] |
( Huang Shuiqing, Wang Dongbo, He Lin. Research on Constructing Automatic Recognition Model for Ancient Chinese Place Names Based on Pre-Qin Corpus[J]. Library and Information Service, 2015, 59(12):135-140.)
|
[8] |
崔丹丹, 刘秀磊, 陈若愚, 等. 基于Lattice LSTM的古汉语命名实体识别[J]. 计算机科学, 2020, 47(S2):18-22.
|
[8] |
( Cui Dandan, Liu Xiulei, Chen Ruoyu, et al. Named Entity Recognition in Field of Ancient Chinese Based on Lattice LSTM[J]. Computer Science, 2020, 47(S2):18-22.)
|
[9] |
Marrero M, Urbano J, Sánchez-Cuadrado S, et al. Named Entity Recognition: Fallacies, Challenges and Opportunities[J]. Computer Standards & Interfaces, 2013, 35(5):482-489.
doi: 10.1016/j.csi.2012.09.004
|
[10] |
Kumar S. A Survey of Deep Learning Methods for Relation Extraction[OL]. arXiv Preprint, arXiv: 1705.03645.
|
[11] |
Zheng S, Wang F, Bao H, et al. Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme [C]// Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 2017.
|
[12] |
曹明宇, 杨志豪, 罗凌, 等. 基于神经网络的药物实体与关系联合抽取[J]. 计算机研究与发展, 2019, 56(7):1432-1440.
|
[12] |
( Cao Mingyu, Yang Zhihao, Luo Ling, et al. Joint Drug Entities and Relations Extraction Based on Neural Networks[J]. Journal of Computer Research and Development, 2019, 56(7):1432-1440.)
|
[13] |
Zeng X R, Zeng D J, He S Z, et al. Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism [C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 2018: 506-514.
|
[14] |
Devlin J, Chang M, Lee K, et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding [C]//Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics. 2019: 4171-4186.
|
[15] |
Lan Z Z, Chen M D, Goodman S, et al. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations [C]//Proceedings of the International Conference on Learning Representations. 2020.
|
[16] |
唐晓波, 刘志源. 金融领域文本序列标注与实体关系联合抽取研究[J]. 情报科学, 2021, 39(5):3-11.
|
[16] |
( Tang Xiaobo, Liu Zhiyuan. Research on Text Sequence Tagging and Joint Extraction of Entity and Relation in Financial Field[J]. Information Science, 2021, 39(5):3-11.)
|
[17] |
吴赛赛, 梁晓贺, 谢能付, 等 面向领域实体关系联合抽取的标注方法[J]. 计算机应用, https://kns.cnki.net/kcms/detail/51 .
|
[17] |
( Wu Saisai, Liang Xiaohe, Xie Nengfu, et al. Annotation Method for Joint Extraction of Domain-Oriented Entity and Relation. Journal of Computer Applications https://kns.cnki.net/kcms/detail/51 )
|
[18] |
张坤丽, 赵旭, 关同峰, 等. 面向医疗文本的实体及关系标注平台的构建及应用[J]. 中文信息学报, 2020, 34(6):36-44.
|
[18] |
( Zhang Kunli, Zhao Xu, Guan Tongfeng, et al. A Platform for Entity and Entity Relationship Labeling in Medical Texts[J]. Journal of Chinese Information Processing, 2020, 34(6):36-44.)
|
[19] |
Montague R. Universal Grammar[J]. Theoria, 1970, 36(3):373-398.
doi: 10.1111/(ISSN)1755-2567
|
[20] |
朱水林. 逻辑语义学研究[M]. 上海: 上海教育出版社, 1992.
|
[20] |
( Zhu Shuilin. The Study of Logical Semantics[M]. Shanghai: Shanghai Educational Publishing House, 1992.)
|
[21] |
周国光, 张国宪. 汉语的配价语法理论研究[J]. 语文建设, 1994(9):33-36.
|
[21] |
( Zhou Guoguang, Zhang Guoxian. Study on the Theory of Valence Grammar in Chinese[J]. Language Planning, 1994(9):33-36.)
|
[22] |
周国光. 汉语配价语法论略[J]. 南京师大学报(社会科学版), 1994(4):103-106, 121.
|
[22] |
( Zhou Guoguang. A Brief Study on Chinese Valence Grammar[J]. Journal of Nanjing Normal University(Social Science Edition), 1994(4):103-106, 121.)
|
[23] |
靳光瑾, 陆汝占. 从汉语句子中提取逻辑函子的一种方法[J]. 软件学报, 1998, 9(6):444-447.
|
[23] |
( Jin Guangjin, Lu Ruzhan. A Method for Extracting Logical Functors from Chinese Sentences[J]. Journal of Software, 1998, 9(6):444-447.)
|
[24] |
司马迁. 史记[M]. 北京: 中华书局, 1959.
|
[24] |
( Sima Qian. Shiji[M]. Beijing: Zhonghua Book Company, 1959.)
|
[25] |
李冬梅, 张扬, 李东远, 等. 实体关系抽取方法研究综述[J]. 计算机研究与发展, 2020, 57(7):1424-1448.
|
[25] |
( Li Dongmei, Zhang Yang, Li Dongyuan, et al. Review of Entity Relation Extraction Methods[J]. Journal of Computer Research and Development, 2020, 57(7):1424-1448.)
|
[26] |
Mikolov T, Chen K, Corrado G S, et al. Efficient Estimation of Word Representations in Vector Space [C]//Proceedings of the 1st International Conference on Learning Representations. 2013.
|
[27] |
Miwa M, Bansal M. End-to-End Relation Extraction Using LSTMs on Sequences and Tree Structures [C] //Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. 2016: 1105-1116.
|
[28] |
Pennington J, Socher R, Manning C. GloVe: Global Vectors for Word Representation [C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014: 1532-1543.
|
[29] |
Levy O, Goldberg Y, Dagan I. Improving Distributional Similarity with Lessons Learned from Word Embeddings[J]. Transactions of the Association for Computational Linguistics, 2015, 3:211-225.
doi: 10.1162/tacl_a_00134
|
[30] |
Cho K, van Merrienboer B, Gulcehre C, et al. Learning Phrase Representations Using RNN Encoder-decoder for Statistical Machine Translation[OL]. arXiv Preprint, arXiv: 1406.1078.
|
[31] |
Lafferty J D, McCallum A, Pereira F C N. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data [C]//Proceedings of the 18th International Conference on Machine Learning. 2001: 282-289.
|
[32] |
Nakagawa T, Inui K, Kurohashi S, et al. Dependency Tree-based Sentiment Classification Using CRFs with Hidden Variables [C]//Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. 2010: 786-794.
|
[33] |
Bahdanau D, Cho K, Bengio Y, et al. Neural Machine Translation by Jointly Learning to Align and Translate [C]//Proceedings of the 3rd International Conference on Learning Representations. 2015.
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|