[Objective] This study aggregates the global information of knowledge graph through a weighted graph convolutional neural network and a relational induction mechanism, aiming to enhance the quality of the knowledge graph representation and completion. [Methods] We proposed an end-to-end learning model for the knowledge graph completion task, which included a neighborhood information aggregation module, an entity relationship fusion module, an interaction module, as well as a prediction module. This new model aggregates the neighborhood information of entities to enrich their representations. It also enhances the interaction between entities and relationship representations with a core tensor. [Results] We examined the new model with the FB15K237, WN18RR, Kinship, and UMLS datasets. Compared with traditional knowledge graph completion models, the Hits@1 indicators of the proposed model increased by 4.1%, 3.9%, 17.8%, and 5.3% on the four datasets, respectively. [Limitations] We did not explore the performance of our new model on information retrieval and recommendation systems. [Conclusions] The proposed model significantly improves the effectiveness of the knowledge graph completion, which helps us identify missing information in knowledge graphs and may benefit information retrieval and automatic Q&A applications.
张贞港, 余传明. 基于实体与关系融合的知识图谱补全模型研究*[J]. 数据分析与知识发现, 2023, 7(2): 15-25.
Zhang Zhengang, Yu Chuanming. Knowledge Graph Completion Model Based on Entity and Relation Fusion. Data Analysis and Knowledge Discovery, 2023, 7(2): 15-25.
(Sun Tan, Liu Zheng, Cui Yunpeng, et al. Analysis and Design of a New Generation of Open Knowledge Service System Integrating Knowledge Organization and Cognitive Computing[J]. Journal of Library Science in China, 2019, 45(3): 38-48.)
(Zhai Xing, Wang Tao, Han Fangfang. Research on Architecture Design and Key Technologies of Health Care Intelligent Knowledge Service System Based on Knowledge Graph[J]. Journal of Information Resources Management, 2020, 10(3): 36-48.)
doi: 10.4018/IRMJ
(Sun Jianjun. Link Analysis: Knowledge Base, Research Agents, Research Focus and Frontier Review Based on Knowledge Mapping[J]. Journal of the China Society for Scientific and Technical Information, 2014, 33(6): 659-672.)
(Tan Xiao, Li Hui, Xu Haiyun. Research on Knowledge Discovery Based on Deep Integration of Multidimensional Data Knowledge Content and Relevance in Big Data Environment[J]. Scientific Information Research, 2021, 3(4): 58-68.)
(Lv Hong. Visualization Analysis on the Research Topics of Information Policy and Regulation Based on Mapping Knowledge Domain[J]. Scientific Information Research, 2021, 3(4): 45-57.)
(Hong Liang, Song Rui, Zhu Liya, et al. Study on Big Knowledge Graph of Cultural Heritage Based on the Perspective of Knowledge Association: Theories, Methods and Trends[J]. Documentation, Information & Knowledge, 2022, 39(2): 133-143.)
(Li Guangjian, Luo Liqun. Towards Knowledge Fusion: The Development Trend of Information Science in Big Data Environment[J]. Journal of Library Science in China, 2020, 46(6): 26-40.)
(Yu Chuanming, Wang Feng, An Lu. Research on the Domain Knowledge Alignment Model Based on Deep Learning: The Knowledge Graph Perspective[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(6): 641-654.)
(Chen Jinghao, Zeng Zhen, Li Gang. A Question Answering System for “the Belt and Road” Investment Based on Knowledge Graph[J]. Library and Information Service, 2020, 64(12): 95-105.)
doi: 10.13266/j.issn.0252-3116.2020.12.011
(Li He, Liu Jiayu, Li Shiyu, et al. Optimizing Automatic Question Answering System Based on Disease Knowledge Graph[J]. Data Analysis and Knowledge Discovery, 2021, 5(5): 115-126.)
(Yu Chuanming, Wang Feng, Zhang Zhengang, et al. Research on Knowledge Graph Question Answering Model Based on Representation Learning[J]. Scientific Information Research, 2021, 3(1): 56-70.)
(Liu Huan, Liu Liu, Wang Dongbo. Research on Automatic Question Answering of Domain Knowledge Graph from the Perspective of Digital Humanities[J]. Scientific Information Research, 2022, 4(1): 46-59.)
(Li Gang, Wang Shiyun, Mao Jin, et al. Construction of National Security Event Map and Its Application for Situation Awareness[J]. Journal of the China Society for Scientific and Technical Information, 2021, 40(11): 1164-1175.)
(Liu Zhenghao, Zeng Xi, Zhang Zhijian. Research on Construction and Analysis of Financial Emergencies Knowledge Graph with Event Logical for Emergency Management[J]. Journal of Information Resources Management, 2022, 12(3): 137-151.)
(Ouyang Jian, Liang Zhufang, Ren Shuhuai. Research on the Construction of Knowledge Graph of Large-scale Chinese Ancient Books[J]. Library and Information Service, 2021, 65(5): 126-135.)
doi: 10.13266/j.issn.0252-3116.2021.05.013
[18]
Bizer C, Lehmann J, Kobilarov G, et al. DBpedia-A Crystallization Point for the Web of Data[J]. Journal of Web Semantics, 2009, 7(3): 154-165.
doi: 10.1016/j.websem.2009.07.002
[19]
Bollacker K, Cook R, Tufts P. Freebase: A Shared Database of Structured General Human Knowledge[C]// Proceedings of the 22nd National Conference on Artificial Intelligence-Volume 2. 2007: 1962-1963.
[20]
Miller G A. WordNet: Alexical Database for English[J]. Communications of the ACM, 1995, 38(11): 39-41.
[21]
Suchanek F M, Kasneci G, Weikum G. YAGO: A Large Ontology from Wikipedia and Wordnet[J]. Journal of Web Semantics, 2008, 6(3): 203-217.
doi: 10.1016/j.websem.2008.06.001
(Yu Chuanming, Zhang Zhengang, Kong Lingge. Comparing Knowledge Graph Representation Models for Link Prediction[J]. Data Analysis and Knowledge Discovery, 2021, 5(11): 29-44.)
[23]
Bordes A, Usunier N, Garcia-Durán A, et al. Translating Embeddings for Modeling Multi-relational Data[C]// Proceedings of the 26th International Conference on Neural Information Processing Systems- Volume 2. 2013: 2787-2795.
[24]
Wang Z, Zhang J W, Feng J L, et al. Knowledge Graph Embedding by Translating on Hyperplanes[C]// Proceedings of the 28th AAAI Conference on Artificial Intelligence. 2014: 1112-1119.
[25]
Lin Y K, Liu Z Y, Sun M S, et al. Learning Entity and Relation Embeddings for Knowledge Graph Completion[C]// Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015: 2181-2187.
[26]
Ji G L, He S Z, Xu L H, et al. Knowledge Graph Embedding via Dynamic Mapping Matrix[C]// Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1:Long Papers). 2015: 687-696.
[27]
Nayyeri M, Cil G M, Vahdati S, et al. Trans4E: Link Prediction on Scholarly Knowledge Graphs[J]. Neurocomputing, 2021, 461: 530-542.
doi: 10.1016/j.neucom.2021.02.100
[28]
Nickel M, Tresp V, Kriegel H P. A Three-Way Model for Collective Learning on Multi-Relational Data[C]// Proceedings of the 28th International Conference on Machine Learning. 2011: 809-816.
[29]
Yang B S, Yih W T, He X D, et al. Embedding Entities and Relations for Learning and Inference in Knowledge Bases[OL]. arXiv Preprint, arXiv: 1412.6575.
[30]
Trouillon T, Welbl J, Riedel S, et al. Complex Embeddings for Simple Link Prediction[C]// Proceedings of the 33rd International Conference on Machine Learning. 2016: 2071-2080.
[31]
Sun Z Q, Deng Z H, Nie J Y, et al. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space[OL]. arXiv Preprint, arXiv: 1902.10197.
[32]
Balažević I, Allen C, Hospedales T M. TuckER: Tensor Factorization for Knowledge Graph Completion[OL]. arXiv Preprint, arXiv:1901.09590.
[33]
Dettmers T, Minervini P, Stenetorp P, et al. Convolutional 2D Knowledge Graph Embeddings[C]// Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018: 1811-1818.
[34]
Nguyen D Q, Nguyen T D, Nguyen D Q, et al. A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network[C]// Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, Volume 2 (Short Papers). 2018: 327-333.
[35]
Jiang X T, Wang Q, Wang B. Adaptive Convolution for Multi-Relational Learning[C]// Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, Volume 1 (Long and Short Papers). 2019: 978-987.
[36]
Balažević I, Allen C, Hospedales T M. Hypernetwork Knowledge Graph Embeddings[C]// Proceedings of International Conference on Artificial Neural Networks. 2019: 553-565.
[37]
Ren F L, Li J C, Zhang H H, et al. Knowledge Graph Embedding with Atrous Convolution and Residual Learning[C]// Proceedings of the 28th International Conference on Computational Linguistics. 2020: 1532-1543.
[38]
Yu C M, Zhang Z G, An L, et al. A Knowledge Graph Completion Model Integrating Entity Description and Network Structure[J]. Aslib Journal of Information Management. DOI: 10.1108/AJIM-01-2022-0031.
doi: 10.1108/AJIM-01-2022-0031
[39]
Schlichtkrull M, Kipf T N, Bloem P, et al. Modeling Relational Data with Graph Convolutional Networks[C]// Proceedings of European Semantic Web Conference. 2018: 593-607.
[40]
Shang C, Tang Y, Huang J, et al. End-to-End Structure-Aware Convolutional Networks for Knowledge Base Completion[C]// Proceedings of the AAAI Conference on Artificial Intelligence. 2019: 3060-3067.
[41]
Zeb A, Saif S, Chen J, et al. Complex Graph Convolutional Network for Link Prediction in Knowledge Graphs[J]. Expert Systems with Applications, 2022, 200: 116796.
doi: 10.1016/j.eswa.2022.116796
Wu Y T, Liu X, Feng Y S, et al. Relation-Aware Entity Alignment for Heterogeneous Knowledge Graphs[C]// Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019: 5278-5284.
[44]
Liu S T, Chen L W, Dong H Z, et al. Higher-Order Weighted Graph Convolutional Networks[OL]. arXiv Preprint, arXiv:1911.04129.
[45]
Zhu R B, Ma M, Wang P. RAGA: Relation-Aware Graph Attention Networks for Global Entity Alignment[C]// Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2021: 501-513.
[46]
Gao T Y, Yao X C, Chen D Q. SimCSE: Simple Contrastive Learning of Sentence Embeddings[OL]. arXiv Preprint, arXiv:2104.08821.
[47]
Hafidi H, Ghogho M, Ciblat P, et al. Negative Sampling Strategies for Contrastive Self-supervised Learning of Graph Representations[J]. Signal Processing, 2022, 190: 108310.
doi: 10.1016/j.sigpro.2021.108310
[48]
Kok S, Domingos P. Statistical Predicate Invention[C]// Proceedings of the 24th International Conference on Machine Learning. 2007: 433-440.
[49]
Lin X V, Socher R, Xiong C M. Multi-hop Knowledge Graph Reasoning with Reward Shaping[C]// Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2018:1-12.
[50]
Akrami F, Saeef M S, Zhang Q H, et al. Realistic Re-evaluation of Knowledge Graph Completion Methods: An Experimental Study[C]// Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. 2020: 1995-2010.
[51]
Hu S, Zou L, Yu J X, et al. Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs[J]. IEEE Transactions on Knowledge and Data Engineering, 2018, 30(5): 824-837.
doi: 10.1109/TKDE.2017.2766634
[52]
Xiong H B, Wang S T, Tang M R, et al. Knowledge Graph Question Answering with Semantic Oriented Fusion Model[J]. Knowledge-Based Systems, 2021, 221: 106954.
doi: 10.1016/j.knosys.2021.106954
[53]
Guo X B, Lin W F, Li Y R, et al. DKEN: Deep Knowledge-Enhanced Network for Recommender Systems[J]. Information Sciences, 2020, 540: 263-277.
doi: 10.1016/j.ins.2020.06.041
[54]
Chen J Y, Yu J, Lu W J, et al. IR-Rec: An Interpretive Rules-Guided Recommendation over Knowledge Graph[J]. Information Sciences, 2021, 563: 326-341.
doi: 10.1016/j.ins.2021.03.004