1National Science Library, Chinese Academy of Sciences, Beijing 100190, China 2University of Chinese Academy of Sciences, Beijing 100049, China 3Institutes of Science and Development, Chinese Academy of Sciences, Beijing 100190, China
[Objective] This paper studies the characteristics of the Altmetrics for high quality journal articles, including their correlations with citation numbers, differences in disciplines, and the contribution of sub-indicators. These Altmetrics are also compared with previous results. [Methods] We selected 68 journals from Nature Index as data sources, and used machine learning method to classify papers published by them. Then, we used Spearman correlation test to find relationship between Altmetrics and traditional citation indexes, as well as the contributions of sub-indicators in various disciplines. Finally, we evaluated the effectiveness of using Altmetrics to identify highly-cited papers, with the help of ROC curve analysis. [Results] There were significant differences in the performance of Altmetrics among disciplines. In high-quality journals, the correlation between Altmetrics and citations were enhanced, and the contributions of News, Blog, and Twitter to the Altmetrics were also increased. Altmetrics could help us identify highly cited papers. [Limitations] The data collection period is short, and the data set needs to be expanded based on the characteristics of the disciplines. [Conclusions] Compared with previous research results of full data sets, Altmetrics for high-quality journal articles are unique, and the correlation between Altmetrics and citations is enhanced.
Bornmann L.Do Altmetrics Point to the Broader Impact of Research? An Overview of Benefits and Disadvantages of Altmetrics[J]. Journal of Informetrics, 2014, 8(4): 895-903.
doi: 10.1016/j.joi.2014.09.005
[2]
Altmetrics Top 100 Articles [DS/OL]. [2017-12-16]..
(Institute of Science and Development, Chinese Academy of Sciences. 2016 The World’s Most Popular Scientific Achievements [R/OL]. (2017-06-17). [2017-12-16].
(Wang Rui, Hu Wenjing, Guo Wei.Research on Academic Influence of High Altmetrics Sci-Tech Papers[J]. Library and Information Service, 2014, 58(21): 92-98.)
doi: 10.13266/j.issn.0252-3116.2014.21.013
(Wei Tongqi, Tan Zongying.The Problems and Challenges of Research on Altmetrics[J]. Library and Information Service, 2015, 59(2): 93-99.)
doi: 10.13266/j.issn.0252-3116.2015.02.015
[7]
Barilan J, Haustein S, Peters I, et al.Beyond Citations: Scholars’ Visibility on the Social Web[OL]. arXiv Preprint, arXiv: 1205.5611.
[8]
Haustein S, Peters I, Sugimoto C R, et al.Tweeting Biomedicine: An Analysis of Tweets and Citations in the Biomedical Literature[J]. Journal of the American Society for Information Science and Technology, 2014, 65(4): 656-669.
doi: 10.1002/asi.23101
[9]
Ortega J L.Relationship Between Altmetric and Bibliometric Indicators Across Academic Social Sites: The Case of CSIC’s Members[J]. Journal of Informetrics, 2015, 9(1): 39-49.
doi: 10.1016/j.joi.2014.11.004
[10]
Sotudeh H, Mazarei Z, Mirzabeigi M.CiteULike Bookmarks are Correlated to Citation at Journal and Author Levels in Library and Information Science[J]. Scientometrics, 2015, 105(3): 2237-2248.
doi: 10.1007/s11192-015-1745-9
[11]
Costas R, Zahedi Z, Wouters P.Do “Altmetrics” Correlate with Citations? Extensive Comparison of Altmetric Indicators with Citations from a Multidisciplinary Perspective[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 2003-2019.
doi: 10.1002/asi.23309
[12]
Costas R, Zahedi Z, Wouters P.The Thematic Orientation of Publications Mentioned on Social Media: Large-Scale Disciplinary Comparison of Social Media Metrics with Citations[J]. Aslib Journal of Information Management, 2015, 67(3): 260-288.
doi: 10.1108/AJIM-12-2014-0173
[13]
Hassan S U, Imran M, Gillani U, et al.Measuring Social Media Activity of Scientific Literature: An Exhaustive Comparison of Scopus and Novel Altmetrics Big Data[J]. Scientometrics, 2017, 113(2): 1037-1057.
doi: 10.1007/s11192-017-2512-x
(You Qingbin, Tang Shanhong.Study on Correlation of Different Article-level Metrics[J]. Library and Information Service, 2014, 58(8): 79-84.)
doi: 10.13266/j.issn.0252-3116.2014.08.013
(Liu Xiaojuan, Zhou Jianhua, You Bin.Study on Correlation Between Altmetrics Indicators and Traditional Scientometric Indicators Based on Mendeley and WoS[J]. Library and Information Service, 2015, 59(3): 112-118.)
doi: 10.13266/j.issn.0252-3116.2015.03.016
(Yu Houqiang.Large Scale Cross-Disciplinary Study of Correlation Between Altmetrics Indicators and Citations-Influence of Data Types, Indicator Types, and User Categories[J]. Journal of the China Society for Scientific and Technical Information, 2017, 36(6): 606-617.)
(Liu Xiaojuan, Song Wanzi.Analysis on the Usability of Altmetrics Indicators Based on PLOS ALM[J]. Library and Information Service, 2016, 60(4): 93-101.)
doi: 10.13266/j.issn.0252-3116.2016.04.013
(Liu Yanmin.The Correlation Research of Altmetrics and Bibliometric Indicators[J]. Journal of Intelligence, 2017, 36(9): 71-77.)
doi: 10.3969/j.issn.1002-1965.2017.09.012
(Liu Xiaojuan, Zai Bingxin.Analysis of Altmetrics Indicators in the Field of Library and Information Science[J]. Library and Information Service, 2015, 59(18): 108-116.)
doi: 10.13266/j.issn.0252-3116.2015.18.017
(You Qingbin, Wei Bo, Tang Shanhong.Evaluation Model Construction to Evaluate Article’s Influence Based on Altmetrics[J]. Library and Information Service, 2014, 58(22): 5-11.)
doi: 10.13266/j.issn.0252-3116.2014.22.001
[22]
时立文. SPSS19.0统计分析从入门到精通[M]. 北京: 清华大学出版社, 2012.
[22]
(Shi Liwen.SPSS19.0 Statistical Analysis from Getting Started to Proficient[M]. Beijing: Tsinghua University Press, 2012.)
(Wang Yan, Guo Shu, Zhang Jianyong.Study on Correlation of Researcher Influence Indicators[J]. Library and Information Service, 2015, 59(3): 106-112,127.)
(Zhang Jianguo.The Basic Principle of ROC Curve Analysis and Application in Physical Fitness and Health Promotion Studies[J]. China Sport Science, 2008, 28(6): 62-66.)
doi: 10.3969/j.issn.1000-677X.2008.06.010
[25]
Baynes R D, Cook J D, Bothwell T H, et al.Serum Transferrin Receptors in Hereditary Hemochromatosis and African Siderosis[J]. American Journal of Hematology, 1994, 45(4): 288-292.
doi: 10.1002/ajh.2830450404
pmid: 8178799
(Yang Liu, Chen Gong.Correlation Study on Evaluation Indicators of Scientific Institution Influence from the Perspective of Altmetrics[J]. Library and Information Service, 2015, 59(15): 106-114, 132.)
doi: 10.13266/j.issn.0252-3116.2015.15.015