|
|
Using Logstash and ElasticSearch to Achieve Real-time Statistical Analysis of DSpace Logs |
Chen He |
Xiamen University Library, Xiamen 361005, China |
|
|
Abstract [Objective] The real-time statistical analysis system of DSpace logs is designed and implemented to meet the different needs of users, and to make up for lack of DSpace's statistical functions itself. [Context] For the design limitations, the DSpace's statistical functions are simple, rigid form of expression, and can not achieve interactive statistical analysis. [Methods] Use Logstash to collect and analyze DSpace logs, and use ElasticSearch to index the logs. Building QueryDSL to call ElasticSearch Java API to achieve different statistical functions, and show the graphical results with ECharts component. [Results] The real-time statistical analysis system of DSpace logs can get the browse rankings of items, collections and communities, get the download rankings of bitstreams, and get the regional rankings of website access, and so on. The statistics time can be customized by user, and the statistical result can be showed in different forms. [Conclusions] Using Logstash and ElasticSearch to achieve statistical analysis of DSpace logs has many excellences, just like no need to modify the code of DSpace, simple installation and deployment of the components, man-machine interactive query, fast and real-time, and rich forms to show the results.
|
Received: 25 November 2014
Published: 11 June 2015
|
|
[1] 顾立平. 机构知识库评价机制 [EB/OL]. [2014-10-06]. http://ir.las.ac.cn/handle/12502/6368. (Ku Liping. Evaluation for Institutional Repositories Development [EB/OL]. [2014-10-06]. http://ir.las.ac.cn/handle/12502/6368.)
[2] DSpace Statistics [EB/OL]. [2014-10-06]. https://wiki.duras-pace.org/display/DSDOC4x/DSpace+Statistics.
[3] DSpace Discovery [EB/OL]. [2014-10-06]. https://wiki.dura-
space.org/display/DSDOC4x/Discovery.
[4] 祝忠明, 马建霞, 卢利农, 等. 机构知识库开源软件DSpace的扩展开发与应用 [J]. 现代图书情报技术, 2009(7-8): 11-17. (Zhu Zhongming, Ma Jianxia, Lu Linong, et al. Developing an Institutional Repository Platform via Extending DSpace [J]. New Technology of Library and Information Service, 2009(7-8): 11-17.)
[5] 姚晓娜, 祝忠明. 基于分面搜索引擎Solr的机构知识库访问统计 [J]. 现代图书情报技术, 2011(7-8): 37-40. (Yao Xiaona, Zhu Zhongming. Usage Statistics of Institutional Repository Based on Faceted Search Engine Solr [J]. New Technology of Library and Information Service, 2011(7-8): 37-40.)
[6] Development of Usage Statistics for RepositóriUM [EB/OL]. [2014-10-06]. https://repositorium.sdum.uminho.pt/handle/1822/ 4803.
[7] ANU DSpace Statistics Installation Guide [EB/OL]. [2014-10-06]. http://sts.anu.edu.au/drs/downloads/dspace-stats/readme. html.
[8] Logstash [EB/OL]. [2014-10-06]. http://logstash.net/.
[9] Redis [EB/OL]. [2014-10-06]. http://redis.io/.
[10] ElasticSearch [EB/OL]. [2014-10-06]. http://www.elasticsear-ch.org/.
[11] QueryDSL [EB/OL]. [2014-10-06]. http://www.querydsl.com/.
[12] ECharts [EB/OL]. [2014-10-06]. http://echarts.baidu.com/.
[13] MaxMind [EB/OL]. [2014-10-06]. https://www.maxmind.com/. |
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|