Open Metrics on the Cloud

Workshop abstract

Impact metrics have a strong influence on the scientific community, affecting the assessment of institutions of higher education and research as well as decisions concerning who gets promoted or hired, who receives grants, and who publishes where. In this situation, it is essential that the methods used to calculate metrics should be transparent, and reproducible and that their integrity should be auditable, and beyond question. 

This workshop will discuss the limitations of current systems and platforms and  the recommendations of creating an open platform for Impact Data.

Special focus will be given to usage indicators about scholarly publications and research data by Open Access repositories, research data repositories and publisher platforms as these are not standardized. However they are an important complement to other (traditional and alternative) bibliometric indicators to provide a comprehensive and recent view of the impact of scholarly resources. In particular, usage data from non-traditional output types are often the only source available to calculate indicators on when and how frequently the resources were viewed and downloaded. A key challenge is to generate comparable, consistent, standards based usage statistics across publishing platforms, taking into account different levels of scholarly information: the usage of data sources, the usage of individual items in the context of their resource type, the usage of individual web resources or files and the usage of resources among different repositories.

Workshop overview

To be added soon

Target Audience

Publishers, funders, repository managers, research administrators

Agenda

• Results and recommendations of the EC-High Level Expert Group on Altmetrics

• Current usage statistics initiatives: OpenAIRE, IRUS-UK, others

Demonstrating the benefits of usage statistics

• standardized comparable usage statistics
• complementing citation counts, alternative metrics
• comparing usage on the level of data sources, individual record level, file level
• usage trends about research topics, research areas
• enabling evidence-based decision making for libraries and publishers

Hands-on session - how to participate in usage statistics services

• basics of the protocols for tracking usage data and harvesting usage statistics reports (SUSHI/Lite) will be explained and demonstrated
• workflows of the OpenAIRE usage statistics service and the IRUS-UK service will be presented

Standardization

• the COUNTER Code of Practice to enable and ensure credible, comparable, consistent usage statistics for e-resources (i.e. COAR Controlled Vocabulary for Resource Types like journal articles, e-books) will be presented
• the tracker protocol used by IRUS-UK and OpenAIRE
• approaches and current research on robot filtering will be discussed

• Current usage statistics initiatives: OpenAIRE, IRUS-UK, others Opportunity for an Impact Data Services Cloud

• OpenUP - an H2020 project opening up new methods, indicators, and tools for peer review, impact measurement and dissemination of research results
• Researcher impact today - the process flow, the user community and the limitations
• OpenUP recommendation for an Impact Data Services Cloud to collect impact data, give researchers access to the raw data to reproduce current metrics, produce their own and to increase coverage

Speakers

Ross MacIntyre, Head library analytics services, Jisc, UK | IRUS-UK: standardised institutional repository usage statistics
Mappet Walker, Frontiers Media SA | Impact Data Services on the Cloud
Jochen Schirrwagen, OpenAIRE / Bielefeld University Library, Germany | OpenAIRE usage statistics for Open Access content provider
Dimitris Pierrakos, OpenAIRE / Athena Research and Innovation Center| OpenAIRE usage statistics for Open Access content provider

WHEN

DAY 2 - PARALLEL SESSION 4 (14:00-15:30) & 5 (16:00-17:30)

See full programme here.