Please wait a minute...
New Technology of Library and Information Service  2013, Vol. 29 Issue (7/8): 82-88    DOI: 10.11925/infotech.1003-3513.2013.07-08.12
Current Issue | Archive | Adv Search |
Review on Percentile-based Bibliometric Indicator
Zhou Qun, Zuo Wenge, Chen Shiji
China Agricultural University Library, Beijing 100193, China
Download: PDF(455 KB)   HTML  
Export: BibTeX | EndNote (RIS)      
Abstract  Percentile is established in bibliometrics as an important alternative to Relative Citation Rate, and then applied to the evaluation of research performance. This paper introduces the background of percentile-based bibliometric indicator and describes the concept and types and advantages of using percentiles in bibliometric. It also elaborates the problems in the calculation of percentiles and further assignment of percentile rank, and further analyzes the application of percentile-based bibliometric indicator.
Key wordsBibliometric      Percentile      Research performance      Citation counts     
Received: 01 July 2013      Published: 02 September 2013



Cite this article:

Zhou Qun, Zuo Wenge, Chen Shiji. Review on Percentile-based Bibliometric Indicator. New Technology of Library and Information Service, 2013, 29(7/8): 82-88.

URL:     OR

[1] Opthof T, Leydesdorff L. Caveats for the Journal and Field Normalizations in the CWTS ("Leiden") Evaluations of Research Performance[J]. Journal of Informetrics,2010,4(3):423-430.

[2] Bornmann L, Mutz R. Further Steps Towards an Ideal Method of Measuring Citation Performance: The Avoidance of Citation (Ratio) Averages in Field-normalization[J]. Journal of Informetrics,2011,5(1):228-230.

[3] Schubert A, Braun T.Cross-field Normalization of Scientometric Indicators[J].Scientometrics,1996, 36(3):311-324.

[4] Schubert A, Braun T. Relative Indicators and Relational Charts for Comparative Assessment of Publication Output and Citation Impact[J].Scientometrics,1986,9(5-6):281-291.

[5] Glanzel W, Thijs B, Schubert A, et al. Subfield-specific Normalized Relative Indicators and a New Generation of Relational Charts: Methodological Foundations Illustrated on the Assessment of Institutional Research Performance[J].Scientometrics,2009,78(1):165-188.

[6] Moed H F, De Bruin R E, Van Leeuwen T N. New Bibliometric Tools for the Assessment of National Research Performance: Database Description, Overview of Indicators and First Applications[J]. Scientometrics,1995, 33(3):381-422.

[7] Van Raan A F J. Measuring Science: Capita Selecta of Current Main Issues[A].//Moed H F, Glnzel W, Schmoch U. Handbook of Quantitative Science and Technology Research[M].Springer,2005:19-50.

[8] Leydesdorff L, Bornmann L, Mutz R, et al. Turning the Tables on Citation Analysis One More Time: Principles for Comparing Sets of Documents[J]. Journal of the American Society for Information Science and Technology, 2011,62(7):1370-1381.

[9] Waltman L, Van Eck N J, Van Leeuwen T N, et al. Towards a New Crown Indicator: An Empirical Analysis[J]. Scientometrics,2011,87(3):467-481.

[10] Waltman L, Van Eck N J, Van Leeuwen T N, et al. Towards a New Crown Indicator: Some Theoretical Considerations[J]. Journal of Informetrics,2011,5(1):37-47.

[11] Seglen P O. The Skewness of Science[J].Journal of the American Society for Information Science,1992, 43(9):628-638.

[12] Seglen P O. Why the Impact Factor of Journals Should not be Used for Evaluating Research[J]. British Medical Journal,1997,314(7079):498-502.

[13] Bornmann L.Towards an Ideal Method of Measuring Research Performance: Some Comments to the Opthof and Leydesdorff (2010) Paper[J]. Journal of Informetrics, 2010,4(3):441-443.

[14] 吴喜之. 非参数统计[M]. 第二版.北京:中国统计出版社, 2006:85.(Wu Xizhi. Nonparametric Statistics[M].The 2nd Edition. Beijing: China Statistics Press, 2006:85.)

[15] 徐建邦, 李培军. 统计学[M]. 第二版.大连:东北财经大学出版社,2006:67.(Xu Jianbang, Li Peijun. Statistics[M]. The 2nd Edition. Dalian: Dongbei University of Finance & Economics Press, 2006:67.)

[16] National Science Board. Science and Engineering Indicators:2010[EB/OL].[2013-07-31].

[17] Rousseau R. Basic Properties of Both Percentile Rank Scores and the I3 Indicator[J]. Journal of the American Society for Information Science and Technology,2012,63(2):416-420.

[18] Leydesdorff L, Bornmann L. Integrated Impact Indicators Compared with Impact Factors: An Alternative Research Design with Policy Implications[J]. Journal of the American Society for Information Science and Technology, 2011,62(11):2133-2146.

[19] Bornmann L, Leydesdorff L, Mutz R. The Use of Percentiles and Percentile Rank Classes in the Analysis of Bibliometric Data: Opportunities and Limits[J]. Journal of Informetrics,2013,7(1):158-165.

[20] Bornmann L.A Better Alternative to the h Index[J].Journal of Informetrics,2013,7(1):100.

[21] Bornmann L, De Moya-Anegón F, Leydesdorff L. The New Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011[J].Journal of Informetrics,2012,6(2):333-335.

[22] Leydesdorff L,Bornmann L. Mapping (USPTO) Patent Data Using Overlays to Google Maps[J]. Journal of the American Society for Information Science and Technology,2012,63(7):1442-1458.

[23] Leydesdorff L. Alternatives to the Journal Impact Factor: I3 and the top-10% (or top-25%?) of the Most-highly Cited Papers[J].Scientometrics,2012,92(2):355-365.

[24] Waltman L, Calero-Medina C, Kosten J, et al. The Leiden Ranking 2011/2012:Data Collection, Indicators, and Interpretation[J].Journal of the American Society for Information Science and Technology,2012, 63(12):2419-2432.

[25] Bornmann L, Leydesdorff L. Which Cities Produce More Excellent Papers than Can be Expected? A New Mapping Approach, Using Google Maps, Based on Statistical Significance Testing[J].Journal of the American Society for Information Science and Technology,2011,62(10):1954-1962.

[26] StataCorp. 2011. Stata Statistical Software: Release 12[DB]. College Station, TX, USA: Stata Corporation.

[27] Schreiber M. Inconsistencies of Recently Proposed Citation Impact Indicators and How to Avoid Them[J]. Journal of the American Society for Information Science and Technology,2012,63(10):2062-2073.

[28] InCites[EB/OL].[2013-05-15].

[29] Leydesdorff L. Accounting for the Uncertainty in the Evaluation of Percentile Ranks[J]. Journal of the American Society for Information Science and Technology,2012,63(11):2349-2350.

[30] Hazen A. Storage to be Provided in Impounding Reservoirs for Municipal Water Supply[J]. Transactions of American Society of Civil Engineers,1914,77:1539-1640.

[31] Harter H L. Another Look at Plotting Positions[J].Communications in Statistics-Theory and Methods,1984, 13(13):1613-1633.

[32] Gringorten I I. A Plotting Rule for Extreme Probability Paper[J]. Journal of Geophysical Research,1963, 68(3):813-814.

[33] Waltman L, Schreiber M. On the Calculation of Percentile-based Bibliometric Indicators[J]. Journal of the American Society for Information Science and Technology,2013,64(2):372-379.

[34] SCImago Research Group. SCImago Institutions Ranking[EB/OL].[2013-07-15]. Institutions Rankings IBER en.pdf.

[35] National Science Board. Science and Engineering Indicator:2012[EB/OL].[2013-07-31].

[36] Centre for Science and Technology Studies, Leiden University, The Netherlands. Leiden Ranking[EB/OL].[2013-07-15].

[37] Rousseau R, Leydesdorff L. Non-consistency, Non-cited Items, and the Impact Factor: A Consequence of the Arithmetic[OL]. arXiv Preprint,arXiv:1102.2567,2011.

[38] Wagner C S, Leydesdorff L. An Integrated Impact Indicator: A New Definition of "Impact" with Policy Relevance[J]. Research Evaluation,2012,21(3):183-188.

[39] Bornmann L, Leydesdorff L. Which are the Best Performing Regions in Information Science in Terms of Highly Cited Papers? Some Improvements of Our Previous Mapping Approaches[J]. Journal of Informetrics, 2012,6(2):336-345.

[40] Rafols I, Leydesdorff L. Content-based and Algorithmic Classifications of Journals: Perspectives on the Dynamics of Scientific Communication and Indexer Effects[J]. Journal of the American Society for Information Science and Technology,2009,60(9):1823-1835.

[41] 陈仕吉,史丽文,左文革. 基于ESI的学术影响力指标测度方法与实证[J]. 图书情报工作,2013,57(2):97-102,123. (Chen Shiji, Shi Liwen, Zuo Wenge. Theoretical and Empirical Study on Measure Method of Academic Influence Indicator Based on ESI[J]. Library and Information Service,2013,57(2):97-102,123.)

[42] Bouyssou D, Marchant T. Ranking Scientists and Departments in a Consistent Manner[J]. Journal of the American Society for Information Science and Technology,2011,62(9):1761-1769.

[43] Bornmann L. The Problem of Percentile Rank Scores Used with Small Reference Sets[J]. Journal of the American Society of Information Science and Technology,2013,64(3):650.

[44] Boyack K W, Klavans R. Multiple Dimensions of Journal Specificity: Why Journals Can't be Assigned to Disciplines[C].In: Proceedings of the 13th Conference of the International Society for Scientometrics and Informetrics.2011:123-133.

[45] Bornmann L. How to Analyze Percentile Citation Impact Data Meaningfully in Bibliometrics: The Statistical Analysis of Distributions, Percentile Rank Classes, and Top-Cited Papers[J]. Journal of the American Society for Information Science and Technology,2013,64(3):587-595.

[46] Waltman L, Van Eck N J. A Systematic Empirical Comparison of Different Approaches for Normalizing Citation Impact Indicators[OL]. arXiv Preprint,arXiv:1301.4941, 2013.
[1] Qiang Liu,Yunwei Chen,Zhiqiang Zhang. Methods and Applications of Norwegian Model for Science and Technology Evaluation[J]. 数据分析与知识发现, 2019, 3(5): 41-50.
[2] Jiang Wu,Guanjun Liu,Xian Hu. An Overview of Online Medical and Health Research: Hot Topics, Theme Evolution and Research Content[J]. 数据分析与知识发现, 2019, 3(4): 2-12.
[3] Pengmin Wu,Ting Chen,Xiaomei Wang. The Correlation Between Altmetrics and Citations[J]. 数据分析与知识发现, 2018, 2(6): 58-69.
[4] Xuanhui Zhang,Yuxiang Zhao. Evolution Path and Hot Topics of Citizen Science Studies[J]. 数据分析与知识发现, 2017, 1(7): 22-34.
[5] Fei Li,Jian Zhang,Zongshui Wang. Review of Social Recommendation with Bibliometrics and Social Network Analysis[J]. 数据分析与知识发现, 2017, 1(6): 22-35.
[6] Zhang Yun, Hua Weina, Yuan Shunbo, Su Baoduo. Research on the Themes Dynamic Evolutions of the Patent Analysis Papers from WoS Database[J]. 现代图书情报技术, 2015, 31(1): 17-23.
[7] Wang Jimin, Lilei Mingzi, Wang Mingxing. Knowledge Mapping Analysis of Mobile Search[J]. 现代图书情报技术, 2012, (9): 29-35.
[8] Chen Shiji, Shi Liwen, Li Dongmei, Zuo Wenge. Review on Normalization Methods of Citation Counts[J]. 现代图书情报技术, 2012, 28(4): 54-60.
[9] Zhang Yun. The Practice on the Development of Software on the Chinese Academic Bibliometrics Based on the Open Source Software[J]. 现代图书情报技术, 2010, 26(4): 87-91.
[10] Chen Yunwei. Trend Mapping of Scientometrics Development: 1978-2008[J]. 现代图书情报技术, 2010, 26(1): 71-76.
[11] Bai Yun,Su Xinning. Academic Influence Analysis on Characteristic of Published and Cited Papers in New Technology of Library and Information Service Based on CSSCI (2004-2006)[J]. 现代图书情报技术, 2008, 24(4): 95-102.
[12] Hua Bolin . Anatomy of Statistic Analysis Technology in Bibliometric and Analytic System via VBA[J]. 现代图书情报技术, 2007, 2(4): 70-74.
[13] Hua Bolin . Implementation of Preprocess Technology in Bibliometric and Analytic Research via VBA[J]. 现代图书情报技术, 2007, 2(3): 69-72.
[14] Fang Xiaorong,Wan Xiumei. Research on Mechanism and Influence of the Mode Transform of the YearDistribution Cited Papers[J]. 现代图书情报技术, 2004, 20(8): 31-33.
[15] Li Jiong,Luo Hong,Ren Xiaoer. Bibliometrical Analysis of the Medline Indexed and China-related Documents[J]. 现代图书情报技术, 2003, 19(5): 71-73.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938