1National Science Library, Chinese Academy of Sciences, Beijing 100190, China 2Department of Information Resources Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190, China
【目的】对国内外语义新颖性研究相关进展进行归纳整理,总结相关技术,为后续研究提供参考。【文献范围】利用“novelty of the literature”“semantic novelty”“文献新颖性”等关键词及“语义新颖性and文献评价”等检索式在Web of Science、Elsevier、Springer、谷歌学术及中国知网、万方、维普等数据库中进行文献检索,经过阅读整理并对具有代表性的相关理论进行溯源,最终筛选出70篇文献进行评述。【方法】对国内外语义新颖性相关研究进行梳理,围绕新颖性定义、新颖性评价指标和不同评价方法等分析科技文献语义新颖性评价的发展现状及未来趋势。【结果】语义新颖性评价逐渐受到学界的广泛关注,已有相关研究对语义内容进行挖掘评价,但尚未形成统一的度量指标。【局限】现有的文献新颖性多从外部特征进行评价,直接以语义新颖性为主题的研究文献数量较少,在支撑综述方面存在局限性。【结论】科技文献的语义新颖性评价根本在于语义内容的新颖性,定量研究已成为主流研究方法,但评价指标的计算方式尚需明确,未来的新颖性评价发展方向应结合定性与定量方法全面分析,实现科学、合理的综合学术评价。
[Objective] This paper reviews the research progress on semantic novelty in China and abroad. It explores relevant techniques and provides references for future studies. [Coverage] We used keywords such as “novelty of the literature”, “semantic novelty”, “literature novelty”, and search expressions like “semantic novelty and literature evaluation” to retrieve literature from Web of Science, Elsevier, Springer, Google Scholar, as well as Chinese databases like CNKI, Wanfang, and VIP. A total of 70 representative literature were selected for review. [Methods] We summarized research on semantic novelty, focusing on the definition of novelty, evaluation indicators, and different evaluation methods. We also discussed the current development status and future trends of evaluating semantic novelty in scientific literature. [Results] Semantic novelty evaluation has gradually received widespread attention from the academic community. Related studies have evaluated semantic content without establishing a unified measurement index. [Limitations] Existing evaluation of literature novelty mainly focuses on external features. Fewer research papers directly addressed semantic novelty, limiting support for reviews. [Conclusions] The evaluation of semantic novelty in scientific literature fundamentally lies in the novelty of semantic content. Quantitative research has become the mainstream method, but the calculation method of evaluation indicators needs to be clarified. Future studies on novelty evaluation should combine qualitative and quantitative methods for more comprehensive evaluations.
(Sun Xiaoling. Highlighting New Ideas is the Core of Writing Scientific Paper[J]. Journal of Northwest Normal University(Natural Science), 2007, 43(6):111-114.)
(Suo Chuanjun, Gai Shuangshuang, Zhou Zhichao. Cognitive Computing: A New Perspective for Evaluating the Individual Academic Paper[J]. Journal of Library Science in China, 2018, 44(1): 50-61.)
[3]
曾建勋. 推动科研论文语义评价体系建设[J]. 数字图书馆论坛, 2021(11): 1.
[3]
(Zeng Jianxun. Promote the Construction of Semantic Evaluation System for Scientific Research Papers[J]. Digital Library Forum, 2021(11): 1.)
[4]
Schumpeter J A. The Theory of Economic Development[M]. London: Oxford University Press,1978.
[5]
WIPO. World Intellectual Property Report 2022:The Direction of Innovation[R/OL]. https://www.wipo.int/edocs/pubdocs/en/wipo-pub-944-2022-en-world-intellectual-property-report-2022-the-direction-of-innovation.pdf.
[6]
OECD, Statistical Office of the European Communities. Oslo Manual: Guidelines for Collecting and Interpreting Innovation Data[M]. The 3rd Edition. Paris: OECD, 2005.
[7]
European Commission. Green Paper on Innovation[R]. Publications Office of the European Union, 1995.
(Luo Zhuoran, Lu Wei, Cai Le, et al. Application of Lexical Functions in Novelty Measurement of Academic Papers[J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(7): 720-732.)
(Gao Zilong. Discovery and Evaluation Strategy of Innovative Academic Achievements: Thoughts Based on Editing Practice[J]. Editorial Friend, 2018(1): 81-85.)
(Suo Chuanjun. Study on Obsolescence and Innovation of Academic Papers from Perspective of Knowledge Transfer[J]. Library and Information Service, 2014, 58(5): 5-12.)
[11]
《科技查新教程》编写组. 科技查新教程[M]. 北京: 机械工业出版社, 2001.
[11]
(Science and Technology Novel Search Course Writing Group. Science and Technology Novelty Search Course[M]. Beijing: China Machine Press, 2001.)
(Chen Yongsheng, Sun Changling. The Indicator System for Innovation Verification in Social Sciences: Structural Model & Value Analysis[J]. Information and Documentation Services, 2002(6): 6-8.)
[14]
徐华. 浅谈学术论文的创新[J]. 价值工程, 2013, 32(36): 259-260.
[14]
(Xu Hua. On Academic Paper Innovation[J]. Value Engineering, 2013, 32(36): 259-260.)
(Wei Xuqiu, Shen Lixu. A Research Review of the Academic Paper Innovativeness[J]. Documentation, Information & Knowledge, 2022, 39(4): 68-79.)
[16]
Mishra S, Torvik V I. Quantifying Conceptual Novelty in the Biomedical Literature[J]. D-Lib Magazine, 2016, 22(9-10): 10.1045/september2016-mishra.
[17]
Heinze T, Shapira P, Rogers J, et al. Creativity Capabilities and the Promotion of Highly Innovative Research in Europe and the United States[R]. EU-NEST/CREA-511889, Karlsruhe, 2007.
[18]
Kaplan S, Vakili K. The Double-Edged Sword of Recombination in Breakthrough Innovation[J]. Strategic Management Journal, 2015, 36(10): 1435-1457.
doi: 10.1002/smj.2294
(Huang Hong, Chen Chong, Zhang Jingying. Review on Identifying the Semantics of Scientific Literature Content[J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(9): 991-1002.)
[20]
Nasar Z, Jaffry S W, Malik M K. Information Extraction from Scientific Articles: A Survey[J]. Scientometrics, 2018, 117(3): 1931-1990.
doi: 10.1007/s11192-018-2921-5
(Li Shan, Shan Lei, Cui Lei. Novelty Assessment Methods of Academic Papers[J]. Chinese Journal of Medical Library and Information Science, 2020, 29(8): 71-74.)
(Lu Wanhui, Su Jinyan, Yu Qian. Research on Correlation of Academic Achievement Theme Novelty and Academic Citation[J]. Information and Documentation Services, 2018(6): 68-73.)
(Zhang Zhixiong, Liu Huan, Yu Gaihong. Building an Artificial Intelligence Engine Based on Scientific and Technological Literature Knowledge[J]. Journal of Library and Information Science in Agriculture, 2021, 33(1): 17-31.)
doi: 10.13998/j.cnki.issn1002-1248.20-0797
(Chen Yunwei. Review on Quantitative Methods of Science and Technology Evaluation[J]. Journal of Library and Information Science in Agriculture, 2020, 32(8): 4-11.)
doi: 10.13998/j.cnki.issn1002-1248.2020.08.20-0467
(Lu Chao, Hou Haiyan, Ding Ying, et al. Review of Internationnal Studies on Discovering Emerging Topics[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(1): 97-110.)
[26]
Jarić I, Knežević-Jarić J, Lenhardt M. Relative Age of References as a Tool to Identify Emerging Research Fields with an Application to the Field of Ecology and Environmental Sciences[J]. Scientometrics, 2014, 100(2): 519-529.
doi: 10.1007/s11192-014-1268-9
[27]
González-Alcaide G, Llorente P, Ramos J M. Bibliometric Indicators to Identify Emerging Research Fields: Publications on Mass Gatherings[J]. Scientometrics, 2016, 109(2): 1283-1298.
doi: 10.1007/s11192-016-2083-2
[28]
Funk R J, Owen-Smith J. A Dynamic Network Measure of Technological Change[J]. Management Science, 2017, 63(3): 791-817.
doi: 10.1287/mnsc.2015.2366
[29]
Lee Y N, Walsh J P, Wang J. Creativity in Scientific Teams: Unpacking Novelty and Impact[J]. Research Policy, 2015, 44(3): 684-697.
doi: 10.1016/j.respol.2014.10.007
[30]
Wang J, Veugelers R, Stephan P. Bias Against Novelty in Science: A Cautionary Tale for Users of Bibliometric Indicators[J]. Research Policy, 2017, 46(8): 1416-1436.
doi: 10.1016/j.respol.2017.06.006
[31]
He Y J, Luo J X. Novelty, Conventionality, and Value of Invention[M]// Design Computing and Cognition’16. Cham: Springer, 2017: 23-38.
[32]
Carayol N, Lahatte A, Llopis O. Novelty and Academic Impact[EB/OL]. [2023-02-11]. https://digital.csic.es/bitstream/10261/162613/1/novelty.pdf.
[33]
Trapido D. How Novelty in Knowledge Earns Recognition: The Role of Consistent Identities[J]. Research Policy, 2015, 44(8): 1488-1500.
doi: 10.1016/j.respol.2015.05.007
[34]
Wu L F, Wang D S, Evans J A. Large Teams Develop and Small Teams Disrupt Science and Technology[J]. Nature, 2019, 566: 378-382.
doi: 10.1038/s41586-019-0941-9
(Liu Xiaohui, Liao Yu, Zhu Manman. A Preliminary Study on the Application of Disruption Index to Scientific Research Evaluation[J]. Information Studies: Theory & Application, 2021, 44(12): 34-40.)
[36]
Frigotto M L, Riccaboni M. A Few Special Cases: Scientific Creativity and Network Dynamics in the Field of Rare Diseases[J]. Scientometrics, 2011, 89(1): 397-420.
doi: 10.1007/s11192-011-0431-9
(Wang Junhui, Tan Zongying. A Review of Bibliometric Evaluation Research of Scientific Creativity[J]. Library and Information Service, 2017, 61(3): 131-139.)
doi: 10.13266/j.issn.0252-3116.2017.03.017
[38]
Zhang Y, Tsai F S. Chinese Novelty Mining[C]// Proceedings of the 2009 Conference on Empirical Methods in Natural Language Process. 2009: 1561-1570.
(Yang Jianlin, Qian Lingfei. Topic Novelty Measurement Method Based on Keyword Versus Inverse Document Frequency[J]. Information Studies: Theory & Application, 2013, 36(3): 99-102.)
(Guo Lina, Li Xingchen, Zuo Wenge, et al. A Review of Disruptive Work and Its Bibliometric Identification Methods[J]. Digital Library Forum, 2020(3): 17-24.)
[41]
Allan J, Carbonell J, Doddington G, et al. Topic Detection and Tracking Pilot Study Final Report[C]// Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop.1998.
[42]
Harman D. Overview of the TREC 2002 Novelty Track[C]// Proceedings of Text Retrieval Conference. 2002.
(Lu Wanhui, Tan Zongying. Measuring Novelty of Scholarly Articles[J]. Data Analysis and Knowledge Discovery, 2018, 2(3): 22-29.)
[46]
Tsai F S, Tang W Y, Chan K L. Evaluation of Novelty Metrics for Sentence-Level Novelty Mining[J]. Information Sciences, 2010, 180(12): 2359-2374.
doi: 10.1016/j.ins.2010.02.020
(Wang Ping, Hou Jingrui, Wu Renli. The Novelty Evaluation of Articles on WeChat Subscription Based on Recursive Neural Tensor Network[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(2): 159-169.)
[48]
Luo Z R, Lu W, He J G, et al. Combination of Research Questions and Methods: A New Measurement of Scientific Novelty[J]. Journal of Informetrics, 2022, 16(2): 101282.
doi: 10.1016/j.joi.2022.101282
[49]
褚婧丹. 科技论文创新点原创性测度方法研究[D]. 北京: 中国科学院大学, 2020.
[49]
(Chu Jingdan. Research on the Method of Measuring the Originality of Innovation in Scientific Papers[D]. Beijing: University of Chinese Academy of Sciences, 2020.)
[50]
陈娜. 基于知识组合视角的技术新颖性测度研究[D]. 大连: 大连理工大学, 2021.
[50]
(Chen Na. Research on Technology Novelty Measurement Based on Knowledge Combination Perspective[D]. Dalian: Dalian University of Technology, 2021.)
[51]
Sendhilkumar S, Mahalakshmi G S, Harish S, et al. Assessing Novelty of Research Articles Using Fuzzy Cognitive Maps[M]//Intelligent Informatics. Berlin, Heidelberg: Springer, 2013: 73-79.
(Qin Yan, Dai Jun, Liao Yingchi. Novelty Measurement of Academic Conference Papers—Taking Artificial Intelligence Field of Computer Science as the Example[J]. Information Science, 2021, 39(1): 104-110.)
[53]
Hautamaki V, Karkkainen I, Franti P. Outlier Detection Using K-Nearest Neighbour Graph[C]// Proceedings of the 17th International Conference on Pattern Recognition. 2004: 430-433.
[54]
廖莹驰. 基于论文文本内容角度的学术会议新颖性及影响力评价[D]. 武汉: 武汉大学, 2019.
[54]
(Liao Yingchi. Novelty and Influence Evaluation of Academic Conference Based on the Content of the Text[D]. Wuhan: Wuhan University, 2019.)
[55]
Zhang K, Zi J, Wu L G. New Event Detection Based on Indexing-Tree and Named Entity[C]// Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2007: 215-222.
[56]
Amplayo R K, Hong S L, Song M. Network-Based Approach to Detect Novelty of Scholarly Literature[J]. Information Sciences, 2018, 422: 542-557.
doi: 10.1016/j.ins.2017.09.037
[57]
丁芳媛. 基于新颖性和影响力的论文推荐方法研究[D]. 广州: 华南理工大学, 2020.
[57]
(Ding Fangyuan. Research on Paper Recommendation Algorithm Based on Novelty and Influence[D]. Guangzhou: South China University of Technology, 2020.)
(Ren Haiying, Wang Deying, Wang Feifei. Relationship Between Novelty of Key-Term Combinations and Papers’ Scientific Impact[J]. Library and Information Service, 2017, 61(9): 87-93.)
doi: 10.13266/j.issn.0252-3116.2017.09.011
[59]
Matsumoto K, Shibayama S, Kang B, et al. Introducing a Novelty Indicator for Scientific Research: Validating the Knowledge-Based Combinatorial Approach[J]. Scientometrics, 2021, 126(8): 6891-6915.
doi: 10.1007/s11192-021-04049-z
(Xu Dan, Xu Shuang, Chen Sisi, et al. Document Theme Novelty Detection Research Based on Natural Language Pairs[J]. Library and Information Service, 2018, 62(8): 130-138.)
doi: 10.13266/j.issn.0252-3116.2018.08.017
(Yang Jing, Wang Fang, Bai Rujiang. A Method to Evaluate Academic Papers’ Innovation Based on the Research Theme Comparing[J]. Library and Information Service, 2018, 62(17): 75-83.)
doi: 10.13266/j.issn.0252-3116.2018.17.010
(Zhang Jiyu, Zhang Junsheng. Novelty Evaluation Method of Single Scientific and Technical Literature Considering Time Series[J]. Library and Information Service, 2022, 66(17): 93-105.)
doi: 10.13266/j.issn.0252-3116.2022.17.009
(Qian Jiajia, Luo Zhuoran, Lu Wei. Novelty Measurement and Innovation Type Identification of Scientific Literature Based on Question-Method Combination[J]. Library and Information Service, 2021, 65(14): 82-89.)
doi: 10.13266/j.issn.0252-3116.2021.14.010
(Wang Yanyan, Zhang Junsheng, Qiao Xiaodong, et al. Evaluating Novelty of Scientific Literature Based on Question-Method Matrix[J]. Information Studies: Theory & Application, 2021, 44(2): 90-95.)
(Cao Shujin, Yan Song. Research on Innovative Paragraph Positioning and Functional Sentence Identification Method of Scientific and Technical Papers Based on Semantic Role Information: A Case Study of Papers in the Field of Chinese Intelligence[J]. Information Studies: Theory & Application, 2022, 45(11): 1-9, 20.)
(Zhang Yingyi, Zhang Chengzhi, He Daqing. A Review of Problem and Method Recognition and Relation Extraction in Academic Papers[J]. Library and Information Service, 2022, 66(12): 125-138.)
doi: 10.13266/j.issn.0252-3116.2022.12.012
(Luo Zhuoran, Wang Yuqi, Qian Jiajia, et al. Research Review on Innovation Evaluation of Academic Papers[J]. Journal of the China Society for Scientific and Technical Information, 2021, 40(7): 780-790.)
(Ding Kun, Zhao Xinhang, Lin Yuan, et al. Research on the Paper Profile for Academic Evaluation[J]. Information Studies: Theory & Application, 2022, 45(9): 94-101.)
doi: 10.16353/j.cnki.1000-7490.2022.09.013
(Ministry of Education of the People’s Republic of China. Programme of Work for the Fifth-round of Discipline Assessment[EB/OL]. [2022-11-16]. http://www.moe.gov.cn/jyb_xwfb/moe_1946/fj_2020/202011/t20201102_497819.html.)
(Xie Zhen, Ma Jianxia, Hu Wenjing. Evaluation of Academic Representative Works: Methods Review and Research Prospects[J]. Information Studies: Theory & Application, 2021, 44(12): 190-196.)