Evaluating research ecosystem using SCOPE
Can SCOPE-framework be used in evaluating multidisciplinary research ecosystems?
Conference
Format: Oral 20 Minutes
Topic: 9. Responsibility, Ethics, and Equity, Diversity and Inclusion (EDI) in Research and Innovation
Abstract
Responsible research assessment is important topic for research managers and administrators. Research evaluation is about publications, bibliometrics, research outcomes, impact, knowledge, transparency and about the consequences of evaluating. INORMS Research Evaluation Group designed and published a SCOPE framework to ensure that research evaluation is meaningful, responsible and effective. SCOPE is a step-by-step process designed to help, plan, design, and conduct research evaluations. In this presentation, we demonstrate how SCOPE was used in evaluating an extensive multidisciplinary research ecosystem.
The Research Council of Finland’s Flagship Program supports high-quality research and increases the economic and societal impact emerging from the research. Flagship also requires success in receiving external funding and a strong commitment from host organizations. Aim of the Finnish Flagships is to challenge and innovate the scientific system. INVEST Flagship on Inequalities, Interventions, and New Welfare State was funded in 2019 and it aims to provide a new model for the welfare state. INVEST is functioning under two faculties (Medicine and Social Sciences) at the University of Turku and at the Finnish Institute for Health and Welfare (THL). This unique collaboration facilitates interdisciplinary research that bridges socioeconomic inequality, public health, and welfare state policies.
The internal need for assessment was recognized because the flagship had grown strongly in five years in terms of personnel, funding and multidisciplinary research. Furthermore, the Research Council of Finland’s funding term and organizational funding commitments were coming to an end in 2026. The aim of the assessment was to give information and recommendations on: What kind of entity or organizational unit INVEST should and could be by 2026 in terms of content (research, education and impact) and structure (organization)? An international evaluation group (professor Juho Saari University of Tampere, professor Tina Malti University of Toronto/Leipzig University, professor Stefan Svallfors Institute for Future Studies/Swedish Research Council and PhD Mari Riipinen CSC/University of Turku) was selected to do the assessment by using SCOPE framework.
In this presentation, we will demonstrate how we succeeded in using the SCOPE framework while assessing the entire existence of a research ecosystem.