We work on more than 300 projects every year.
Evaluation study on Excellent Science in the European Framework Programmes for Research and Innovation
Laura Lecluyse
Senior Consultant Innovation, Competitiveness & Sustainability
""
The challenge
IDEA Consult was engaged in the evaluation study of the excellent science aspect of the EU Research & Innovation (R&I) Framework Programmes, the EU’s main instruments for the funding of R&I in Europe.
The study was performed in two phases to provide input for two evaluations: Phase 1 fed into the ex-post evaluation of Horizon 2020, the 8th EU Framework Programme for the period 2014-2020 with a budget of nearly EUR 80 billion. Phase 2 supported the interim evaluation of Horizon Europe, the 9th Framework Programme for the period 2021-2027 with a budget of EUR 95.5 billion.
The process & results
The study designed and applied a dedicated methodology consisting of quantitative (e.g., bibliometric/scientometric analysis, econometric modelling, social network analysis) and qualitative methods (including interviews, case studies and international benchmarking exercises) to answer evaluation questions about European scientific excellence through the EU Framework Programme.
While this study was carried out together with partners, IDEA Consult’s specific contributions were situated in the following areas:
- IDEA was responsible for addressing how effective the Framework Programmes are/were in creating excellent science, and how relevant the Programmes are considering the objectives of the interventions, the needs in society and the EU policy goals and priorities.
- IDEA mainly conducted qualitative evaluation methods, conducted interviews and drafted case studies and benchmarking exercises.
- Furthermore, IDEA was responsible for the meta-analysis of the specific Horizon 2020 programmes: Research Infrastructures, Spreading Excellence and Widening Participation (SEWP) and Science with and for Society (SwafS). For the Horizon Europe, IDEA analysed the European Research Council (ERC), Research Infrastructures, and Widening participation and Spreading Excellence (WIDERA).
The study identified lessons learnt and suggestions for improvement for the short and longer-term of the Framework Programme with respect to fostering Excellent Science.
The link to the H2020 evaluation study for excellent science: https://op.europa.eu/en/publication-detail/-/publication/048c35b7-149e-11ee-806b-01aa75ed71a1/language-en/format-PDF/source-320520294