31 January 2019
To everyone working on the REF, the publication of the final 'Guidance of the submissions' and 'Panel criteria' will be something of a welcome relief. Those working on student recruitment, procurement, data protection, planning, research funding and many other areas will be able to attest right now that there is nothing more frustrating to getting on with the job, than working in the dark.
I for one welcome the new REF rules; it is no secret that I was in favour of removing staff selection as a means of removing the ‘gaming’ of the REF exercise. I am glad to see that in the final 'Guidance on submissions', staff circumstances have been retained and enhanced. Although there was a persistent argument that individual circumstances will lead to an increase in burden for institutions, I believe this is a burden worth carrying to ensure that REF has robust measures to promote equality and diversity. My feeling is that the flexible approach to the output pool may well reduce the need for Higher Education Institutions (HEIs) to submit requests for unit reductions and the increased burden of staff circumstances will be far less than anticipated.
That is not to say that the new rules do not come without challenges. There has been much discussion about how the new rules will increase the amount of outputs that will need to be assessed before output selection. This is none more relevant than at my institution, UCL. For REF2014 we submitted 9,416 outputs. As an institution that produces circa 11,500 journal articles alone per annum, the decoupling of staff and outputs will require us to internally assess the vast majority of all outputs we have generated. Some might be tempted to fall back on metrics as an easy evaluation route, and the ongoing challenge to halt the practice of correlating journal impact factors to the merits of a specific authors contributions continues. At UCL we have signed-up to the San Francisco Declaration on Research Assessment (DORA) and as Panel B Chair one of my challenges will be in ensuring that metrics are only used in a responsible and intelligent way that compliments peer review.
Another challenge for Panel B will be the change from four to one Unit of Assessment (UoA) for engineering. Managing units of such scale is always testing. The rule that there will be no multiple submissions in UoA12 was widely discussed both within the sub-panel and nationally (including at a Town Hall meeting at the Royal Academy of Engineering). I think it is a progressive and most welcome development.
This is not to say that the REF is all about challenges. What excites me most is of course the research and getting up-close to the work that makes the UK’s university sector one of the best in the world. I look forward to reading those new impact case studies in Panel B, and also to seeing how those statements presented previously have matured to provide new and even more impressive impact. With research environment, I look forward to seeing the results of institutional infrastructure investment, and progress in early career researcher development and equality and diversity practice.
Good luck to all involved in the next stages of the REF. November 2020 will be upon us all sooner than we imagine!