|
|
Knowledge Representation Based on Deep Learning:Network Perspective |
Chuanming Yu1(),Haonan Li2,Manyi Wang2,Tingting Huang2,Lu An3 |
1School of Information and Security Engineering, Zhongnan University of Economics and Law,Wuhan 430073, China 2School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan 430073, China 3School of Information Management, Wuhan University, Wuhan 430072, China |
|
|
Abstract [Objective] This paper explores better representation models for the semantic relationship among knowledge objects.[Methods] Based on the existing algorithm of network representation learning, we proposed a combined knowledge network representation learning model (CKNRL), with integrated learning and deep learning techniques.[Results] We examined our new model with the knowledge network link prediction task of Chinese and English news parallel corpus. The AUC value of the CKNRL model was 0.929, which was higher than those of the traditional algorithms, i.e. DeepWalk(0.925), Node2Vec(0.926) and SDNE(0.899).[Limitations] Our study was based on the word co-occurrence network, and more research is needed to examine the CKNRL model for link prediction on more types of knowledge networks.[Conclusions] The semantic relationship among knowledge objects can be better represented by the proposed fusion model.
|
Received: 14 May 2019
Published: 14 March 2020
|
|
Corresponding Authors:
Chuanming Yu
E-mail: yucm@zuel.edu.cn
|
[1] |
Perozzi B, Al-Rfou R, Skiena S. DeepWalk: Online Learning of Social Representations [C]// Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.ACM, 2014: 701-710.
|
[2] |
Tang J, Qu M, Wang M, et al. LINE: Large-scale Information Network Embedding [C]// Proceedings of the 24th International Conference on World Wide Web. 2015: 1067-1077.
|
[3] |
Grover A, Leskovec J. Node2Vec: Scalable Feature Learning for Networks [C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2016: 855-864.
|
[4] |
Wang D, Cui P, Zhu W. Structural Deep Network Embedding [C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.ACM, 2016: 1225-1234.
|
[5] |
郑彦宁, 许晓阳, 刘志辉 . 基于关键词共现的研究前沿识别方法研究[J]. 图书情报工作, 2016,60(4):85-92.
|
[5] |
( Zheng Yanning, Xu Xiaoyang, Liu Zhihui . Study on the Method of Identifying Research Fronts Based on Keywords Co-occurrence[J]. Library and Information Service, 2016,60(4):85-92.)
|
[6] |
商宪丽, 王学东 . 图书情报知识[J]. 图书情报知识,2016(3):80-88.
|
[6] |
( Shang Xianli, Wang Xuedong . A Feature Selection Method Based on Dynamic Co-Word Network for Microblog Topic Detection[J]. Document, Information & Knowledge, 2016(3):80-88.)
|
[7] |
孙耀吾, 龚晓叶 . 技术标准化主题学术关注度及共词网络演化研究[J]. 情报杂志, 2017,36(9):64-70,37.
|
[7] |
( Sun Yaowu, Gong Xiaoye . The Academic Interest of Technological Standardization Topic and Its Co-Word Network Evolution Research[J]. Journal of Intelligence, 2017,36(9):64-70, 37.)
|
[8] |
马红, 蔡永明 . 共词网络LDA模型的中文文本主题分析:以交通法学文献( 2000 -2016)为例[J]. 现代图书情报技术, 2016(12):17-26.
|
[8] |
( Ma Hong, Cai Yongming . A CA-LDA Model for Chinese Topic Analysis: Case Study of Transportation Law Literature[J]. New Technology of Library and Information Service, 2016(12):17-26.)
|
[9] |
蔡永明, 长青 . 共词网络LDA模型的中文短文本主题分析[J]. 情报学报, 2018,37(3):305-317.
|
[9] |
( Cai Yongming, Chang Qing . Chinese Short Text Topic Analysis by Latent Dirichlet Allocation Model with Co-Word Network Analysis[J]. Journal of the China Society for Scientific and Technical Information, 2018,37(3):305-317.)
|
[10] |
宫雪, 崔雷 . 基于医学主题词共现网络的链接预测研究[J]. 情报杂志, 2018,37(1):66-71,52.
|
[10] |
( Gong Xue, Cui Lei . Link Prediction in MeSH Terms Co-occurring Networks[J]. Journal of Intelligence, 2018,37(1):66-71,52.)
|
[11] |
高继平, 丁堃, 潘云涛 , 等. 共词网络中连线的重要性分析及其应用[J]. 情报理论与实践, 2015,38(2):79-83,70.
|
[11] |
( Gao Jiping, Ding Kun, Pan Yuntao , et al. Importance Analysis and Application of Connections in Co-Word Networks[J]. Information Studies: Theory & Application, 2015,38(2):79-83,70.)
|
[12] |
李纲, 任佳佳, 毛进 , 等. 专利权人合作网络的社群结构分析——以燃料电池电动汽车专利为例[J]. 情报学报, 2014,33(3):267-276.
|
[12] |
( Li Gang, Ren Jiajia, Mao Jin , et al. Analysis of the Community Structure of Patentees’ Collaboration Network——Fuel Cell Electric Vehicle Patents as an Example[J]. Journal of the China Society for Scientific and Technical Information, 2014,33(3):267-276.)
|
[13] |
吕鹏辉, 刘盛博 . 学科知识网络实证研究(Ⅳ)合作网络的结构与特征分析[J]. 情报学报, 2014,33(4):367-374.
|
[13] |
( Lv Penghui, Liu Shengbo . Scientific Knowledge Networks in LIS(IV): Investigation on the Structure and Characteristics of Cooperation Networks[J]. Journal of the China Society for Scientific and Technical Information, 2014,33(4):367-374.)
|
[14] |
陈伟, 李传云, 周文 , 等. 基于新能源汽车的加权专利合作网络研究[J]. 情报学报, 2016,35(6):563-572.
|
[14] |
( Chen Wei, Li Chuanyun, Zhou Wen , et al. Research on the Weighted Patent Cooperation Network Based on New Energy Vehicles[J]. Journal of the China Society for Scientific and Technical Information, 2016,35(6):563-572.)
|
[15] |
范如霞, 曾建勋, 高亚瑞玺 . 基于合作网络的学者动态学术影响力模式识别研究[J]. 数据分析与知识发现, 2017,1(4):30-37.
|
[15] |
( Fan Ruxia, Zeng Jianxun, Gao Yaruixi . Recognizing Dynamic Academic Impacts of Scholars Based on Cooperative Network[J]. Data Analysis and Knowledge Discovery, 2017,1(4):30-37.)
|
[16] |
施晓华, 卢宏涛 . 基于矩阵分解学习的科学合作网络社区发现研究[J]. 数据分析与知识发现, 2017,1(9):49-56.
|
[16] |
( Shi Xiaohua, Lu Hongtao . Detecting Community in Scientific Collaboration Network with Bayesian Symmetric NMF[J]. Data Analysis and Knowledge Discovery, 2017,1(9):49-56.)
|
[17] |
吕鹏辉, 张士靖 . 学科知识网络研究(Ⅰ)引文网络的结构、特征与演化[J]. 情报学报, 2014,33(4):340-348.
|
[17] |
( Lv Penghui, Zhang Shijing . Scientific Knowledge Networks in LIS(I): Case Study on the Structure, Characteristics and Evolution of Citation Networks[J]. Journal of the China Society for Scientific and Technical Information, 2014,33(4):340-348.)
|
[18] |
隗玲, 刘春江, 许海云 , 等. 基于文献关联属性的引文网络主路径识别——以合成生物学领域为例[J]. 情报学报, 2018,37(4):351-361.
|
[18] |
( Wei Ling, Liu Chunjiang, Xu Haiyun , et al. Citation Network Main Path Identification Based on Associated Attributes of Articles: Case Study from Synthetic Biology[J]. Journal of the China Society for Scientific and Technical Information, 2018,37(4):351-361.)
|
[19] |
王忠义, 张鹤铭, 黄京 , 等. 基于社会网络分析的网络问答社区知识传播研究[J]. 数据分析与知识发现, 2018,2(11):80-94.
|
[19] |
( Wang Zhongyi, Zhang Heming, Huang Jing , et al. Studying Knowledge Dissemination of Online Q&A Community with Social Network Analysis[J]. Data Analysis and Knowledge Discovery, 2018,2(11):80-94.)
|
[20] |
范馨月, 崔雷 . 基于网络属性的抗肿瘤药物靶点预测方法及其应用[J]. 数据分析与知识发现, 2018,2(12):98-108.
|
[20] |
( Fan Xinyue, Cui Lei . Predicting Antineoplastic Drug Targets Based on Network Properties[J]. Data Analysis and Knowledge Discovery, 2018,2(12):98-108.)
|
[21] |
余传明, 冯博琳, 安璐 . 基于深度表示学习的跨领域情感分析[J]. 数据分析与知识发现, 2017,1(7):73-81.
|
[21] |
( Yu Chuanming, Feng Bolin, An Lu . Sentiment Analysis in Cross-Domain Environment with Deep Representative Learning[J]. Data Analysis and Knowledge Discovery, 2017,1(7):73-81.)
|
[22] |
李宇琦, 陈维政, 闫宏飞 , 等. 基于网络表示学习的个性化商品推荐[J]. 计算机学报, 2019,42(8):1767-1778.
|
[22] |
( Li Yuqi, Chen Weizheng, Yan Hongfei , et al. Learning Graph-based Embedding for Personalized Product Recommendation[J]. Chinese Journal of Computers, 2019,42(8):1767-1778.)
|
[23] |
张金柱, 于文倩, 刘菁婕 , 等. 基于网络表示学习的科研合作预测研究[J]. 情报学报, 2018,37(2):132-139.
|
[23] |
( Zhang Jinzhu, Yu Wenqian, Liu Jingjie , et al. Predicting Research Collaborations Based on Network Embedding[J]. Journal of the China Society for Scientific and Technical Information, 2018,37(2):132-139.)
|
[24] |
刘姝雯, 徐扬, 王冰璐 , 等. 基于用户表示学习的微博水军识别研究[J]. 情报杂志, 2018,37(7):95-100,87.
|
[24] |
( Liu Shuwen, Xu Yang, Wang Binglu , et al. Water Army Detection of Weibo Using User Representation Learning[J]. Journal of Intelligence, 2018,37(7):95-100,87.)
|
[25] |
樊玮, 韩佳宁, 张宇翔 . 基于网络表示学习的论文影响力预测算法[J/OL]. 计算机工程. .
|
[25] |
( Fan Wei, Han Jianing, Zhang Yuxiang . Paper Influence Prediction Algorithm Based on Network Representation Learning[J/OL]. Computer Engineering. .)
|
[26] |
孙晓玲, 丁堃 . 深度学习中的表示学习研究及其对知识计量的影响[J]. 情报理论与实践, 2018,41(9):118-122.
|
[26] |
( Sun Xiaoling, Ding Kun . Study of Representation Learning in Deep Learning and Its Impact on Knowledge Measurement[J]. Information Studies: Theory & Application, 2018,41(9):118-122.)
|
[27] |
廖祥文, 刘德元, 桂林 , 等. 融合文本概念化与网络表示的观点检索[J]. 软件学报, 2018,29(10):2899-2914.
|
[27] |
( Liao Xiangwen, Liu Deyuan, Gui Lin , et al. Opinion Retrieval Method Combining Text Conceptualization and Network Embedding[J]. Journal of Software, 2018,29(10):2899-2914.)
|
[28] |
刘思, 刘海, 陈启买 , 等. 基于网络表示学习与随机游走的链路预测算法[J]. 计算机应用, 2017,37(8):2234-2239.
|
[28] |
( Liu Si, Liu Hai, Chen Qimai , et al. Link Prediction Algorithm Based on Network Representation Learning and Random Walk[J]. Journal of Computer Applications, 2017,37(8):2234-2239.)
|
[29] |
刘知远, 孙茂松, 林衍凯 , 等. 知识表示学习研究进展[J]. 计算机研究与发展, 2016,53(2):247-261.
|
[29] |
( Liu Zhiyuan, Sun Maosong, Lin Yankai , et al. Knowledge Representation Learning: A Review[J]. Journal of Computer Research and Development, 2016,53(2):247-261.)
|
[30] |
新闻平行语料数据集[EB/OL]. [ 2018- 01- 01]. .
|
[30] |
( News-commentary Corpus[EB/OL]. [ 2018- 01- 01]. )
|
[31] |
Jieba文档[EB/OL]. [2018-01-01]..
|
[31] |
( Jieba Document[EB/OL]. [2018-01-01]..)
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|