Episode 18

full
Published on:

30th Mar 2023

James Wilsdon - Replay on metrics & responsible research evaluation

This is a replay of a 2018 conversation with Professor James Wilsdon when he was a Professor of Research Policy in the Department of Politics at the University of Sheffield in the UK. He is now at UCL as a Professor of Research Policy in the Dept for Science, Technology, Engineering and Public Policy (STEaPP). James has been involved in many policy and think tank initiatives. Of particular interest here, he chaired an independent review of the role of metrics in the management of the UK’s research system, publishing a final report in 2015 called The Metric Tide. Connecting to our recent episodes on review practices, we start here at about 19mins into the original recording exploring what is the purpose of research evaluation.

“Metrics are a technology and there is nothing intrinsically good or evil in them, it’s all about how they are used.”

“It is incumbent on us not to indulge processes of evaluation that we know empirically are bad science.”

Full Transcript available here.

Related links:

Original Feb 2018 podcast with James Wilsdon on impacts, responsible metric & evaluation practices

Aricles about James’ move to UCL:

UCL https://www.ucl.ac.uk/steapp/news/2022/dec/metrics-metascience-and-now-ucl-steapp-welcomes-james-wilsdon

Research on Research Institute (RoRI): https://researchonresearch.org/tpost/6283xjy2y1-roris-director-moves-to-ucl - includes links to more recent responsible research evaluation reports James has been involved in.

UK research funding councils – Higher Education Funding Council - http://www.hefce.ac.uk

Research Excellence Framework (REF) - http://www.ref.ac.uk/2014/

The Metric Tide report – https://responsiblemetrics.org/the-metric-tide/

San Francisco Declaration on Research Assessment - http://www.ascb.org/dora/

Leiden Manifesto for Research Metrics - http://www.leidenmanifesto.org



This podcast uses the following third-party services for analysis:

Chartable - https://chartable.com/privacy
Show artwork for Changing Academic Life

About the Podcast

Changing Academic Life
What can we do, individually and collectively, to change academic life to be more sustainable, collaborative and effective? This podcast series offers long-form conversations with academics and thought leaders who share stories and insights, as well as bite-size musings on specific topics drawing on literature and personal experience.
For more information go to https://changingacademiclife.com
Also see https://geraldinefitzpatrick.com to leave a comment.
NOTE: this is an interim site and missing transcripts for the older podcasts. Please contact me to request specific transcripts in the meanwhile.

About your host

Profile picture for Geraldine Fitzpatrick

Geraldine Fitzpatrick

Geraldine Fitzpatrick (Geri Fitz), is an awarded Professor i.R. at TU Wien, with degrees in Informatics, and in Positive Psychology and Coaching Psychology, after a prior career as a nurse/midwife. She has International experience working in academic, research, industry and clinical settings. She is a sought-after facilitator, speaker, trainer and coach who cares about creating environments in which people can thrive, enabling individual growth, and creating collegial collaborative cultures. She works with academics and professionals at all levels, from senior academic leaders, to mid and early career researchers, to PhD students. She is also a mentor for academics and has been/is on various Faculty evaluation panels and various International Advisory Boards. An example of a course is the Academic Leadership Development Course for Informatics Europe, run in conjunction with Austen Rainer, Queens Uni Belfast. She also offers bespoke courses.