Open Metrics on the Cloud

Organisers: Mappet Walker - Frontiers, Jochen Schirrwagen  - University of Bielefeld, Dimitris Pierrakos - Athena Research and Innovation Center, Ross MacIntyre - Jisc IRUS-UK, Joseph Greene, University College Dublin
Duration: 1.5 hours

Impact metrics have a strong influence on the scientific community, affecting the assessment of institutions of higher education and research as well as decisions concerning who gets promoted or hired, who receives grants, and who publishes where. In this situation, it is essential that the methods used to calculate metrics should be transparent, and reproducible and that their integrity should be auditable, and beyond question. This workshop will discuss the limitations of current systems and platforms, presenting a use case from Usage Statistics platform, and the recommendations of creating an open platform for Impact Data.

Workshop abstract

Impact metrics have a strong influence on the scientific community, affecting the assessment of institutions of higher education and research as well as decisions concerning who gets promoted or hired, who receives grants, and who publishes where. In this situation, it is essential that the methods used to calculate metrics should be transparent, and reproducible and that their integrity should be auditable, and beyond question. 

This workshop will discuss the limitations of current systems and platforms and  the recommendations of creating an open platform for Impact Data.

Special focus will be given to usage indicators about scholarly publications and research data by Open Access repositories, research data repositories and publisher platforms as these are not standardized. However they are an important complement to other (traditional and alternative) bibliometric indicators to provide a comprehensive and recent view of the impact of scholarly resources. In particular, usage data from non-traditional output types are often the only source available to calculate indicators on when and how frequently the resources were viewed and downloaded. A key challenge is to generate comparable, consistent, standards based usage statistics across publishing platforms, taking into account different levels of scholarly information: the usage of data sources, the usage of individual items in the context of their resource type, the usage of individual web resources or files and the usage of resources among different repositories.

Workshop overview

To be added soon

Target Audience

Publishers, funders, repository managers, research administrators

Agenda

Demonstrating the benefits of usage statistics
  • standardized comparable usage statistics
  • complementing citation counts, alternative metrics
  • comparing usage on the level of data sources, individual record level, file level
  • usage trends about research topics, research areas
  • enabling evidence-based decision making for libraries and publishers
Hands-on session - how to participate in usage statistics services
Standardization
  • the COUNTER Code of Practice to enable and ensure credible, comparable, consistent usage statistics for e-resources (i.e. COAR Controlled Vocabulary for Resource Types like journal articles, e-books) will be presented
  • the tracker protocol used by IRUS-UK and OpenAIRE
  • approaches and current research on robot filtering will be discussed
  • OpenUP - an H2020 project opening up new methods, indicators, and tools for peer review, impact measurement and dissemination of research results
  • Researcher impact today - the process flow, the user community and the limitations
  • OpenUP recommendation for an Impact Data Services Cloud to collect impact data, give researchers access to the raw data to reproduce current metrics, produce their own and to increase coverage

Speakers

Ross MacIntyre, Head library analytics services, Jisc, UK | IRUS-UK: standardised institutional repository usage statistics
Mappet Walker, Frontiers Media SA | Impact Data Services on the Cloud
Jochen Schirrwagen, OpenAIRE / Bielefeld University Library, Germany | OpenAIRE usage statistics for Open Access content provider
Dimitris Pierrakos, OpenAIRE / Athena Research and Innovation Center| OpenAIRE usage statistics for Open Access content provider

WHEN

DAY 2 - PARALLEL SESSION 4 (14:00-15:30) & 5 (16:00-17:30)

See full programme here.

 

Tags: Open Data Services Platform open metrics usage statistics e-Infstructure usage tracking

Sponsors

Platinum

frontiers h65 w230

gold

Athena Vertical EN h124 w160

Silver

 
   
f1000 h35 w136

 

willey h41 w176

 

fig.share NoSubheadColour h72 w177

 

 Largest resolution RC logo h72 w198

Bronze

Logo C Pub RGB   

mdpi small

 DOAJ h40 w205

 Overleaf h47 w160

 

 PLOS one logo h42 w200

 arpha logo whole 01 h64 w175

TF Group logo blue h45 w246

 logo edp h72 w212

 SN stack logo h60 145