The study feeds into the back-to-back approach set for the ex-post evaluation of Horizon 2020 and the interim evaluation of Horizon Europe and thus informs the implementation of Horizon Europe in the current Multiannual Financial Framework (MFF, 2021-2027) as well as the design of the next Framework Programme (FP10). [...] The evaluation followed the main principles of theory-based evaluation (Chen 1990; Weiss, 1997; Rogers, 2007; Funnell & Rogers, 2011), and developed theories of change that related 1) the general and specific needs/challenges of the Green Transition, with 2) the interventions of the related parts of the Framework Programmes and the European Partnerships. [...] To analyse to which extent Horizon Europe has induced processes for a Green Transition, the evaluation uses the concept of the Multi-Level Perspective (MLP) and the embedded concept of transformative outcomes, which has been considered as guidance for the analysis of the interventions and operationalised in the survey design and the case studies 9. [...] The report is organised as follows: • An introduction section, to present the objectives, scope, and content of the report • A second section on the Green Transition in Horizon Europe, and the state of play • A third section on the evidence of findings • A fourth section on the contribution of the Framework Programme to a Green Transition • A last section on the overall conclusions and recommendat. [...] 10,000 • Successful in the • The France 2030 • The Programme Board environment and evaluation estimated and the Challenge climate area, from the that 46% of the Directors demonstrate perspective of resources allocated by strong leadership of the beneficiaries the programme have a programme, with an potentially favourable effective balance • Lack of success in R&I impact on the between the Challeng.
Authors
Related Organizations
- Pages
- 112
- Published in
- United Kingdom
Table of Contents
- Executive summary 7
- Evaluation objective and methodology 7
- Overview of the Green Transition in Horizon Europe 7
- Key findings per evaluation criteria 8
- 1. 8
- 2. 8
- 3. 8
- Relevance 8
- Coherence 10
- Effectiveness 11
- Efficiency 12
- EU added value 14
- Contribution of the Framework Programme to the Green Transition 14
- Acronyms 16
- 1. Introduction 20
- 1.1. Objectives and scope of the evaluation 20
- 1.2. Methodological approach 21
- 1.3. Content of the final report 23
- 2. The Green Transition in Horizon Europe, and the state of play 26
- 2.1. The Green Transition in Horizon Europe 26
- 2.2. The state of play 29
- 2.3. Insights from the international benchmarking 34
- 3. Evidence of findings 41
- 3.1. Relevance 41
- 3.1.1. Relevance of the Framework Programme given stakeholder needs and significant issues 41
- 3.1.1.1. Coverage of EU long-term needs and green policy priorities 41
- 3.1.1.2. Implementation of high-level mechanisms to integrate stakeholder needs 42
- 3.1.1.3. Approaches to stakeholder engagement across HE instruments 42
- 3.1.1.4. Key target groups across types of actions and Clusters 43
- 3.1.1.5. Consideration of stakeholder needs and significant issues 44
- 3.1.1.6. Consideration of organisational needs for reducing impacts and developing solutions 46
- 3.1.1.7. Ways to improve consideration of stakeholder needs 48
- 3.1.2. Flexibility and response to developments at national, European, and international levels 49
- 3.1.3. Relevant areas of participation for international partners and associated countries 51
- 3.2. 51
- 3.3. 51
- 3.4. Coherence 54
- 4. 54
- 3.4.1. Coherence of the FP in delivering impact for the Green Transition 54
- 3.4.1.1. Internal coherence in addressing the Green Transition 54
- 3.4.1.2. Coherence of the project portfolio and synergies with instruments within Horizon Europe 55
- 3.4.1.3. Coherence of Horizon Europe and the Horizon Europe Missions 57
- 3.4.2. Positioning of the FP in the area of Green Transition in Europe and internationally 59
- 3.5. 59
- 3.5.1.1. External coherence with other EU funding programmes and the national level 59
- 3.5.2. Coherence of Partnerships: internally and concerning other FP activities 63
- 3.6. Effectiveness 64
- 5. 64
- 3.6.1. The contribution of intended results, outcomes and impacts to the FP objectives, EU priorities and the SDGs 64
- 3.6.1.1. Contribution to the Framework Programme objectives 70
- 3.6.1.2. Key Impact Pathways 71
- 3.6.2. The impact of internal and external factors on the success of programme interventions 74
- 3.7. 74
- 3.7.1.1. Internal factors that influence progress / impact or lack of it 74
- 3.8. 76
- 3.9. 76
- 3.9.1. 76
- 3.9.2. The effectiveness of dissemination, exploitation, and communication 77
- 3.9.3. The impact of international cooperation and association of third countries 79
- 3.10. Efficiency 80
- 6. 80
- 3.10.1. Efficiency of administration and implementation across the project cycle 80
- 3.10.1.1. Efficient implementation processes 80
- 3.10.1.2. Implementation processes by type of Partnership 83
- 3.10.2. Implementation needs, drivers, and barriers: learning from applicants and participants 84
- 3.11. 84
- 3.11.1.1. Co-design process of Horizon Europe 84
- 3.11.1.2. Flexibility of Horizon Europe 84
- 3.11.1.3. Barriers to new applicants, particularly SMEs 84
- 3.11.1.4. Lack of alignment and implementation barriers specific to Partnerships 86
- 3.11.1.5. Implications of market-oriented and stakeholder engagement focuses 87
- 3.11.1.6. Geographical discrepancies 87
- 3.11.2. Cost-effectiveness and proportionality of efforts 87
- 3.12. 87
- 3.12.1.1. Leverage factor 87
- 3.12.1.2. Cost-efficiency goes beyond leverage factor 88
- 3.12.1.3. Proportionality of efforts 89
- 3.12.2. Efficiency of monitoring and evaluation systems and feedback to policy processes 89
- 3.13. 89
- 3.13.1.1. Monitoring & evaluation systems at project & programme levels 89
- 3.13.1.2. Dissemination and exploitation of results 90
- 3.13.1.3. Feedback to policy 92
- 3.14. EU added value 92
- 4. The contribution of the framework programme to the Green Transition 96
- 4.1. Analysis of projects’ contribution to the Green Transition 96
- 4.2. Results of case studies and Partnerships on the Green Transitions 97
- 4.3. Multi-level perspective of the Green Transition 98
- 7. 99
- 8. 99
- 9. 99
- 10. 99
- 4.3.1. Building and Nurturing Niches 99
- 4.3.2. Expanding and mainstreaming niches 100
- 4.3.3. Opening and unlocking regimes 100
- 5. Overall conclusions 101
- 5.1. Relevance 101
- 5.2. Coherence 102
- 5.3. Effectiveness 103
- 5.4. Efficiency 104
- 5.5. EU added value 104
- 5.6. Contribution of the framework programme to the Green Transition 105
- 6. Recommendations 105
- 6.1. Recommendations regarding relevance 106
- 6.2. Recommendations regarding coherence 107
- 6.3. Recommendations regarding effectiveness 108
- 6.4. Recommendations regarding efficiency 109
- 6.5. Recommendations regarding EU added value 110