|
|
|
| Review on Percentile-based Bibliometric Indicator |
| Zhou Qun, Zuo Wenge, Chen Shiji |
| China Agricultural University Library, Beijing 100193, China |
|
|
|
|
Abstract Percentile is established in bibliometrics as an important alternative to Relative Citation Rate, and then applied to the evaluation of research performance. This paper introduces the background of percentile-based bibliometric indicator and describes the concept and types and advantages of using percentiles in bibliometric. It also elaborates the problems in the calculation of percentiles and further assignment of percentile rank, and further analyzes the application of percentile-based bibliometric indicator.
|
|
Received: 01 July 2013
Published: 02 September 2013
|
|
|
| [1] Opthof T, Leydesdorff L. Caveats for the Journal and Field Normalizations in the CWTS ("Leiden") Evaluations of Research Performance[J]. Journal of Informetrics,2010,4(3):423-430.[2] Bornmann L, Mutz R. Further Steps Towards an Ideal Method of Measuring Citation Performance: The Avoidance of Citation (Ratio) Averages in Field-normalization[J]. Journal of Informetrics,2011,5(1):228-230.[3] Schubert A, Braun T.Cross-field Normalization of Scientometric Indicators[J].Scientometrics,1996, 36(3):311-324.[4] Schubert A, Braun T. Relative Indicators and Relational Charts for Comparative Assessment of Publication Output and Citation Impact[J].Scientometrics,1986,9(5-6):281-291.[5] Glanzel W, Thijs B, Schubert A, et al. Subfield-specific Normalized Relative Indicators and a New Generation of Relational Charts: Methodological Foundations Illustrated on the Assessment of Institutional Research Performance[J].Scientometrics,2009,78(1):165-188.[6] Moed H F, De Bruin R E, Van Leeuwen T N. New Bibliometric Tools for the Assessment of National Research Performance: Database Description, Overview of Indicators and First Applications[J]. Scientometrics,1995, 33(3):381-422.[7] Van Raan A F J. Measuring Science: Capita Selecta of Current Main Issues[A].//Moed H F, Glnzel W, Schmoch U. Handbook of Quantitative Science and Technology Research[M].Springer,2005:19-50.[8] Leydesdorff L, Bornmann L, Mutz R, et al. Turning the Tables on Citation Analysis One More Time: Principles for Comparing Sets of Documents[J]. Journal of the American Society for Information Science and Technology, 2011,62(7):1370-1381.[9] Waltman L, Van Eck N J, Van Leeuwen T N, et al. Towards a New Crown Indicator: An Empirical Analysis[J]. Scientometrics,2011,87(3):467-481.[10] Waltman L, Van Eck N J, Van Leeuwen T N, et al. Towards a New Crown Indicator: Some Theoretical Considerations[J]. Journal of Informetrics,2011,5(1):37-47.[11] Seglen P O. The Skewness of Science[J].Journal of the American Society for Information Science,1992, 43(9):628-638.[12] Seglen P O. Why the Impact Factor of Journals Should not be Used for Evaluating Research[J]. British Medical Journal,1997,314(7079):498-502.[13] Bornmann L.Towards an Ideal Method of Measuring Research Performance: Some Comments to the Opthof and Leydesdorff (2010) Paper[J]. Journal of Informetrics, 2010,4(3):441-443.[14] 吴喜之. 非参数统计[M]. 第二版.北京:中国统计出版社, 2006:85.(Wu Xizhi. Nonparametric Statistics[M].The 2nd Edition. Beijing: China Statistics Press, 2006:85.)[15] 徐建邦, 李培军. 统计学[M]. 第二版.大连:东北财经大学出版社,2006:67.(Xu Jianbang, Li Peijun. Statistics[M]. The 2nd Edition. Dalian: Dongbei University of Finance & Economics Press, 2006:67.)[16] National Science Board. Science and Engineering Indicators:2010[EB/OL].[2013-07-31]. http://www.nsf.gov/statistics/seind10/.[17] Rousseau R. Basic Properties of Both Percentile Rank Scores and the I3 Indicator[J]. Journal of the American Society for Information Science and Technology,2012,63(2):416-420.[18] Leydesdorff L, Bornmann L. Integrated Impact Indicators Compared with Impact Factors: An Alternative Research Design with Policy Implications[J]. Journal of the American Society for Information Science and Technology, 2011,62(11):2133-2146.[19] Bornmann L, Leydesdorff L, Mutz R. The Use of Percentiles and Percentile Rank Classes in the Analysis of Bibliometric Data: Opportunities and Limits[J]. Journal of Informetrics,2013,7(1):158-165.[20] Bornmann L.A Better Alternative to the h Index[J].Journal of Informetrics,2013,7(1):100.[21] Bornmann L, De Moya-Anegón F, Leydesdorff L. The New Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011[J].Journal of Informetrics,2012,6(2):333-335.[22] Leydesdorff L,Bornmann L. Mapping (USPTO) Patent Data Using Overlays to Google Maps[J]. Journal of the American Society for Information Science and Technology,2012,63(7):1442-1458.[23] Leydesdorff L. Alternatives to the Journal Impact Factor: I3 and the top-10% (or top-25%?) of the Most-highly Cited Papers[J].Scientometrics,2012,92(2):355-365.[24] Waltman L, Calero-Medina C, Kosten J, et al. The Leiden Ranking 2011/2012:Data Collection, Indicators, and Interpretation[J].Journal of the American Society for Information Science and Technology,2012, 63(12):2419-2432.[25] Bornmann L, Leydesdorff L. Which Cities Produce More Excellent Papers than Can be Expected? A New Mapping Approach, Using Google Maps, Based on Statistical Significance Testing[J].Journal of the American Society for Information Science and Technology,2011,62(10):1954-1962.[26] StataCorp. 2011. Stata Statistical Software: Release 12[DB]. College Station, TX, USA: Stata Corporation.[27] Schreiber M. Inconsistencies of Recently Proposed Citation Impact Indicators and How to Avoid Them[J]. Journal of the American Society for Information Science and Technology,2012,63(10):2062-2073.[28] InCites[EB/OL].[2013-05-15].http://incites.thomsonreuters.com/.[29] Leydesdorff L. Accounting for the Uncertainty in the Evaluation of Percentile Ranks[J]. Journal of the American Society for Information Science and Technology,2012,63(11):2349-2350.[30] Hazen A. Storage to be Provided in Impounding Reservoirs for Municipal Water Supply[J]. Transactions of American Society of Civil Engineers,1914,77:1539-1640.[31] Harter H L. Another Look at Plotting Positions[J].Communications in Statistics-Theory and Methods,1984, 13(13):1613-1633.[32] Gringorten I I. A Plotting Rule for Extreme Probability Paper[J]. Journal of Geophysical Research,1963, 68(3):813-814.[33] Waltman L, Schreiber M. On the Calculation of Percentile-based Bibliometric Indicators[J]. Journal of the American Society for Information Science and Technology,2013,64(2):372-379.[34] SCImago Research Group. SCImago Institutions Ranking[EB/OL].[2013-07-15]. http://www.scimagoir.com/pdf/SCImago Institutions Rankings IBER en.pdf.[35] National Science Board. Science and Engineering Indicator:2012[EB/OL].[2013-07-31]. http://www.nsf.gov/statistics/seind12/.[36] Centre for Science and Technology Studies, Leiden University, The Netherlands. Leiden Ranking[EB/OL].[2013-07-15]. http://www.leidenranking.com/methodology.aspx.[37] Rousseau R, Leydesdorff L. Non-consistency, Non-cited Items, and the Impact Factor: A Consequence of the Arithmetic[OL]. arXiv Preprint,arXiv:1102.2567,2011.[38] Wagner C S, Leydesdorff L. An Integrated Impact Indicator: A New Definition of "Impact" with Policy Relevance[J]. Research Evaluation,2012,21(3):183-188.[39] Bornmann L, Leydesdorff L. Which are the Best Performing Regions in Information Science in Terms of Highly Cited Papers? Some Improvements of Our Previous Mapping Approaches[J]. Journal of Informetrics, 2012,6(2):336-345.[40] Rafols I, Leydesdorff L. Content-based and Algorithmic Classifications of Journals: Perspectives on the Dynamics of Scientific Communication and Indexer Effects[J]. Journal of the American Society for Information Science and Technology,2009,60(9):1823-1835.[41] 陈仕吉,史丽文,左文革. 基于ESI的学术影响力指标测度方法与实证[J]. 图书情报工作,2013,57(2):97-102,123. (Chen Shiji, Shi Liwen, Zuo Wenge. Theoretical and Empirical Study on Measure Method of Academic Influence Indicator Based on ESI[J]. Library and Information Service,2013,57(2):97-102,123.)[42] Bouyssou D, Marchant T. Ranking Scientists and Departments in a Consistent Manner[J]. Journal of the American Society for Information Science and Technology,2011,62(9):1761-1769.[43] Bornmann L. The Problem of Percentile Rank Scores Used with Small Reference Sets[J]. Journal of the American Society of Information Science and Technology,2013,64(3):650.[44] Boyack K W, Klavans R. Multiple Dimensions of Journal Specificity: Why Journals Can't be Assigned to Disciplines[C].In: Proceedings of the 13th Conference of the International Society for Scientometrics and Informetrics.2011:123-133.[45] Bornmann L. How to Analyze Percentile Citation Impact Data Meaningfully in Bibliometrics: The Statistical Analysis of Distributions, Percentile Rank Classes, and Top-Cited Papers[J]. Journal of the American Society for Information Science and Technology,2013,64(3):587-595.[46] Waltman L, Van Eck N J. A Systematic Empirical Comparison of Different Approaches for Normalizing Citation Impact Indicators[OL]. arXiv Preprint,arXiv:1301.4941, 2013. |
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
