Research on Academic Evaluation Based on Fine-Grain Citation Sentimental Quantification
Jiang Lin1,2(),Zhang Qilin3
1School of Economics and Management, Nantong University, Nantong 226019, China 2Jiangsu Key Laboratory of Data Engineering and Knowledge Service, Nanjing University, Nanjing 210023, China 3Southwest University Library, Chongqing 400715, China
[Objective] This paper uses sentiment analysis technology to deeply excavate and quantify the cited sentiment contained in the cited content, to provide a more scientific theoretical basis and data support for the discovery of the intrinsic value of academic literature. [Methods] Taking the journal papers retrieved in CNKI as an example, through the fine-grained sentiment analysis and sentiment quantification of the citation content in the citing literature, the intrinsic academic value of the cited literature was deeply explored and a new academic evaluation method was proposed. [Results] Experiments showed that the dispersion coefficient based on citation sentiment method was 0.12 higher than the traditional method based on cited frequency, and the Spearman correlation coefficient reached 0.981. [Limitations] Because there is no full text citation database in China, it is difficult to obtain experimental data. The sample size in the experiment is small. [Conclusions] The academic evaluation method based on fine-grained citation sentiment quantification has a higher degree of discrimination and can more effectively measure the intrinsic academic value of the literature.
姜霖,张麒麟. 基于引文细粒度情感量化的学术评价研究*[J]. 数据分析与知识发现, 2020, 4(6): 129-138.
Jiang Lin,Zhang Qilin. Research on Academic Evaluation Based on Fine-Grain Citation Sentimental Quantification. Data Analysis and Knowledge Discovery, 2020, 4(6): 129-138.
( Zhao Rongying, Zeng Xianqin, Chen Bikun. Citation in Full-Text: The Development of Citation Analysis[J]. Library and Information Service, 2014,58(9):129-135.)
[3]
Small H. Co-Citation Context Analysis and the Structure of Paradigms[J]. Journal of Documentation, 1980,36(3):183-196.
doi: 10.1108/eb026695
[4]
Moravcsik M J, Murugesan P. Some Results on the Function and Quality of Citations[J]. Social Studies of Science, 1975,5(1):86-92.
doi: 10.1177/030631277500500106
[5]
Ding Y, Zhang G, Chambers T, et al. Content‐Based Citation Analysis: The Next Generation of Citation Analysis[J]. Journal of the Association for Information Science and Technology, 2014,65(9):1820-1833.
doi: 10.1002/asi.23256
( Zhu Qingsong, Leng Fuhai. Topic Identification of Highly Cited Papers Based on Citation Content Analysis[J]. Journal of Library Science in China, 2014,40(1):39-49.)
( Zhao Rongying, Guo Fengjiao, Zeng Xianqin. Empirical Research on Location-based Co-citation Analysis[J]. Journal of the China Society for Scientific and Technical Information, 2016,35(5):492-500.)
( Zhang Chengzhi, Li Zhuo, Zhao Mengyuan, et al. Citing Behavior of Chinese Books Based on Citation Content[J]. Journal of Library Science in China, 2019,45(3):96-109.)
[9]
Teufel S, Siddharthan A, Tidhar D. Automatic Classification of Citation Function [C]//Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing. 2006: 103-110.
[10]
Ikram M T, Afzal M T. Aspect Based Citation Sentiment Analysis Using Linguistic Patterns for Better Comprehension of Scientific Knowledge[J]. Scientometrics, 2019,119(1):73-95.
doi: 10.1007/s11192-019-03028-9
[11]
Yousif A, Niu Z D, Nyamawe A, et al. Improving Citation Sentiment and Purpose Classification Using Hybrid Deep Neural Network Model [C]//Proceedings of the International Conference on Advanced Intelligent Systems and Informatics. 2018: 327-336.
[12]
Catalini C, Lacetera N, Oettl A. The Incidence and Role of Negative Citations in Science[J]. Proceedings of the National Academy of Sciences, 2015,112(45):13823-13826.
doi: 10.1073/pnas.1502280112
( Liu Shengbo, Ding Kun, Zhang Chunbo. Research on Citation Evaluation Based on the Nature of Citation Content[J]. Information Studies: Theory & Application, 2015,38(3):77-81.)
( Geng Shuqing, Yang Jianlin. A Method to Evaluate the Academic Influence of Papers Based on Citation Sentiment[J]. Information Studies: Theory & Application, 2018,41(12):93-98.)
[15]
苏新宁. 面向知识服务的知识组织理论与方法[M]. 第1版. 北京: 科学出版社, 2014.
[15]
( Su Xinning. Knowledge Service Oriented Knowledge Organization Theory and Method[M].The 1st Edition. Beijing: Science Press, 2014.)
[16]
Alag S. Collective Intelligence 实战[M].第1版.腾灵灵,冯飞,译. 北京: 清华大学出版社, 2010.
[16]
( Alag S. Collective Intelligence in Action[M]. The 1st Edition.Translated by Teng Lingling,Feng Fei. Beijing: Tsinghua University Press, 2010.)
[17]
Moilanen K, Pulman S. Sentiment Composition [C]//Proceedings of the Recent Advances in Natural Language Processing. Springer, 2007: 378-382.
[18]
Benamara F, Cesarano C, Picariello A, et al. Sentiment Analysis: Adjectives and Adverbs are Better than Adjectives Alone [C]//Proceedings of the International Conference on Weblogs and Social Media. 2007: 203-206.
( Jiang Lin, Zhang Qilin. Research on the Ranking Method of Academic Retrieval Results Based on Citation Sentiment Interaction[J]. Information Studies: Theory & Application, 2020,43(6):172-179.)
[20]
Velikovich L, Blair-Goldensohn S, Hannan K, et al. The Viability of Web-derived Polarity Lexicons [C]//Proceedings of the 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 2010: 777-785.
( Jiang Lin, Zhang Qilin. Research on Personalized Recommendation Strategy Based on Sentimental Analysis of the Reviews——Taking Film Reviews of douban. com as an Example[J]. Information Studies: Theory & Application, 2017,40(8):99-104.)
( Lin Huang, Guo Shuhui. On the Characteristics, Range and Classification of Adverbs of Degree[J]. Journal of Shanxi University: Philosophy & Social Science, 2003,26(2):71-74.)
( Xu Linhong, Lin Hongfei, Yang Zhihao. Text Orientation Identification Based on Semantic Comprehension[J]. Journal of Chinese Information Processing, 2007,21(1):96-100.)
( Yao Tianfang, Lou Decheng. Research on Semantic Orientation Analysis for Topics in Chinese Sentences[J]. Journal of Chinese Information Processing, 2007,21(5):73-79.)
( Sun Chunhua, Liu Yezheng. A Method for Combining Online Reviews’ Sentiment Orientation Based on Recognition of Relationship Between Product Feature Words[J]. Journal of the China Society for Scientific and Technical Information, 2013,32(8):844-852.)
( Su Limin, He Huishuang. Multiple Attribute Decision Making Method Based on Interval Number Spearman Rank Correlation Coefficient[J]. Statistics & Decision, 2019,35(6):51-53.)
[27]
李喜梅. 等级相关系数在教学质量评价中的应用[J]. 统计与决策, 2003(5):36-37.
[27]
( Li Ximei. Application of Grade Correlation Coefficient in Teaching Quality Evaluation[[J]. Statistics & Decision, 2003(5):36-37.)
( Liu Shengbo, Wang Bo, Tang Delong, et al. Research on Paper Influence Based on Citation Context: A Case Study of the Nobel Prize Winner’s Paper[J]. Library and Information Service, 2015,59(24):109-114.)