Library Help: Office For Open Research

Overview

Responsible metrics refers to the fair, transparent, and context-aware use of quantitative indicators in the assessment of research. This includes citation counts, journal impact factors, h-index, grant income, and other measures often used to evaluate researchers, outputs, or institutions.

The goal is to ensure that metrics:

• Support high-quality research

• Are used appropriately and in context

• Do not unfairly influence hiring, promotion, or funding decisions

Responsible metrics must always be used alongside qualitative evidence, such as peer review, narrative CVs, or statements of impact.
 

What does responsible use look like?

Examples of responsible metric practices include:

• 🔁 Using multiple metrics
  To reduce bias and provide a more balanced view

• 🚫 Avoiding over-reliance on flawed indicators
  Such as the Journal Impact Factor or h-index, which can be misleading when used in isolation

• 🔍 Understanding limitations
  Metrics vary by discipline, career stage, and database—no single indicator works in every context

• 🔓 Being transparent
  About the data sources, tools, and methods used in any analysis or benchmarking

• ⚖️ Contextualising data
  For example, comparing like with like (e.g. field-normalised citation metrics), or recognising the structural inequalities that shape research output and recognition.

What is the Responsible Metrics Movement?

The movement toward more ethical and appropriate use of metrics has been shaped by several key frameworks:

• DORA (San Francisco Declaration on Research Assessment)
  Focuses on eliminating misuse of journal-based metrics in individual evaluation (e.g. impact factor in hiring or promotion)

• The Leiden Manifesto
  Proposes 10 principles for improving research metrics, including transparency, field normalisation, and keeping evaluation open to verification

• The Metric Tide
  A UK report (revised in 2022) that outlines how research metrics should support—not replace—expert judgement, and introduces five principles for responsible metrics use in UK institutions

Responsible metrics at the University of Manchester 

The University of Manchester was one of the first UK signatories of the San Francisco Declaration on Research Assessment (DORA), which was published in 2012. Signing DORA, and introducing an institutional position statement on responsible metrics, demonstrates the University’s commitment to using metrics only in appropriate and responsible ways. The University’s position statement endorses the five principles of responsible metrics which were published in The Metric Tide (2015). 

• Robustness – Use metrics based on the best available data

• Humility – Recognise that quantitative evaluation should support, not supplant, qualitative judgement

• Transparency – Keep data, methods, and assumptions open and clear

• Diversity – Avoid reinforcing narrow definitions of excellence; support varied research outputs and career paths

• Reflexivity – Regularly review and refine practices in light of new evidence.
  
   

Need help applying responsible metrics in practice?

The Office for Open Research provides training, advice, and tools to help researchers and staff apply responsible metrics in a practical context.

📘 Library guide to the responsible use of metrics
Includes frameworks, case studies, recommended tools, and platform-specific guidance.

📞 Contact the Office for Open Research
We can help with:

• Evaluating research responsibly for internal review or funding

• Interpreting citation metrics in context

• Supporting narrative CVs or impact statements