REF2014 Results Analysis

Quickly assess your insitution's REF performance nationally & relative to chosen peers.

Research Intelligence SolutionsRequest a consultation

Congratulations to all of the institutions and individuals involved on what is a great achievement!

Following initial consultations in 2009 through to the deadline for submissions in November 2013, 155 higher education institutions across the UK have dedicated a huge amount of time and resource to this process.

The results published on December 17 highlighted both the quality and non-academic impact of each institution's research, and marked the culmination of years of hard work.

If you'd like to learn more about how Elsevier has supported the REF 2014 and how we support other national assessments, please make sure you look at these two great resources:


REF2014 Results Analysis tool

On the 16 December all of the UK Higher Education Institutions (HEIs) that submitted returns for the REF2014 had two days to analyze their results before they were made publically available.

That's why Elsevier built the REF2014 Results Analysis tool (approved by HEFCE for HEI use) – to allow instant performance assessment both nationally and relative to chosen peers, that helped establish internal and global responses.

The web-based REF2014 Results Analysis tool includes:

  • A comprehensive analysis of the overall results and sub-profiles, including the impact elements
  • Quality, volume, and combined measures
  • Institutional and Unit of Assessment (UoA) level rankings
  • Regional and comparator group analysis
  • Various download options

How it worked

  • 16 December : Individual Institutional results were released and individual HEIs could upload their own results to the tool.
  • 17 December: Each HEI received the sector results and could then use the tool to analyze all results.
  • 18 December: View and rank by proportion of staff submitted as derived from the HESA Contextual Data

Note: This is an initial mockup of the tool with dummy data. The final product may vary in look and functionality.

Overall Summary graphic


FAQs

The HESA Contextual Data was used in the Tool to calculate the Proportion of Staff Submitted. This was available to view, and there was an option to rank submissions by this measure.

We decided not to incorporate Proportion of Staff Submitted into the Quality measures (e.g. GPA x Proportion of Staff Submitted) to create a new metric.

Administrative users were able to create Comparator Groups at any point upon being given access to the Tool. Any groups created continued to be available following removal of the RAE2008 results data and upload of the REF2014 data. When an Administrator created new Comparator Groups, these were accessible to all users within their HEI.

Institutions wishing to view rankings where small, specialist institutions have been removed, were required to create a group locally - the Tool will not include such a comparator group by default.

Yes. We intended to offer the following download options:

Tables .csv
Uploaded raw results .csv
Charts (if delivered) various (e.g. .jpg, .png, .pdf)

The following Comparator Groups were available in the Tool from the outset:

  • Regions
    • UK
    • England
    • Scotland
    • Wales
    • Northern Ireland
  • Mission Groups
    • Russell Group
    • University Alliance
    • Million+
    • CMU
    • Guild HE
    • UKAIDA
  • English Regions
    • London
    • East Midlands
    • East of England
    • North East
    • North West
    • South East
    • South West
    • West Midlands
    • Yorkshire & the Humber

We planned the following model of user roles and rights:

Elsevier created one Administrative account / user per institution (this was the single named contact, whose details you will have provided when signing up for the tool). This user culd:

  • Upload results
  • Create and edit comparator groups
  • Edit weightings / thresholds for the different measures:
    • GPA
    • Quality Index
    • Threshold for number of submissions above a certain GPA
    • Threshold for number of submissions above a certain proportion of 4*/3* activity
  • Create other user accounts within the institution (including other Administrator user accounts if needed)
    • Indefinite number of users
    • Must be created manually, one-by-one
    • Can create a generic institutional account
  • View and download data

Non-Admin users were only able to view and download data – no ability to create comparator groups, change the weightings, etc.