r google-plus facebook twitter linkedin2 nujij M Monitor Nieuwsbrief pdclogo man met tas twitter boek

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027, Praag

Praag, Tsjechië
© Anton Bussemaker
datum 21 oktober 2020
plaats Praag, Tsjechië
organisatie European Institute of Public Administration (EIPA)

The first part of this 3-day course deals with monitoring tasks, indicators and the Performance Framework. The second part examines how to conduct “evaluations during the programming period”. Senior evaluation consultant-economists with vast programme experience will focus on the two recommended evaluation methods.

Your browser must support JavaScript in order to make a booking.


Month / Day / Year

Check Availability

SKU: 2030206 Categories: EU Policies, Law and Practice, EU Structural Funds Tags: EU Structural and Cohesion Fund, EU Structural and Cohesion Funds

Watch project leader Marco Lopriore explain how Cohesion Policy helps respond to the COVID health crisis in his recent video series.

About this seminar

Member States are now conducting evaluations of their EU Structural and Cohesion Funds projects and programmes. Have they collected the best monitoring data and do they know how to measure impacts? Which evaluation method should be used - theory-based or counter-factual? As new programmes for 2021-2027 are now being prepared and negotiated, are we clear about what the draft New Regulations say about monitoring and evaluation requirements?

This 3-day seminar has two stages:

  • Stage 1 (Day 1) deals with monitoring tasks, indicators and the Performance Framework. A Czech Ministry official will assess the practical challenges of 2014-2020 and the implications of the new requirements for 2021-2027.
  • Stage 2 (Days 2 & 3) examines how to conduct “evaluations during the programming period”. Leading evaluation consultant-economists will focus on the two recommended evaluation methods - theory-based and counterfactual evaluations - and the choices for project / programme evaluations on the ground. We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other large projects.
  • You will also learn how to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current / planned evaluations.

What you will learn in this course

At the end of the seminar, participants should have:

  • a clear understanding of all the evaluation and monitoring requirements for current and future programmes; and
  • a quick general tool kit for undertaking impact evaluations for projects and programmes

Mini-workshops and exercises are used both to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

You are invited to send us your problems, issues and questions before the seminar, if you wish. We will do our best to address the problems / answer the questions during the seminar!

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes in 2014-2020 and in 2021-2027
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.

Marco Lopriore (IT)

EU Funds

Robin Smail

Robin Smail Training & Consultancy

EU Structural Funds

Practical information

Course venue - to be confirmed

Rezidence Dlouhá 17

Dlouhá 17

110 00 Prague

Prague (CZ)

Programme Organiser

Ms Nancy Vermeulen

Tel: +31 43 32 96 212



The fee includes documentation and refreshments, three lunches and a reception. Accommodation and travel costs are at the expense of the participants or their administration.


EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?

Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.


Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.


Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.


Prior payment is a condition for participation.

Cancellation policy

For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.).

The programme



Seminar Stage 1: Monitoring, indicators and the Performance Framework


Registration of participants


Opening of the seminar and meeting the participants: introduction to the objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands


Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027

  • Programme cycle, key monitoring tasks, data requirements and challenges
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework - old and new
  • Reporting in 2014-2020 and 2021-2027: moving to real-time reporting
  • The new OP template

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)


Coffee break


Workshop and discussion: indicators by sector

  • What are we measuring?
  • Programme-specific indicators by sector
  • Fund Regulation Annexes - common indicators

Robin Smail


Management Challenges for Member States in collecting and managing data

  • lessons learned from the first years of implementation
  • data collection, MIS, interpreting data for the AIR
  • problems for the PF, measuring progress

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme - Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic


Lunch break


Management Challenges for Member States in collecting and managing data (contd).

  • programme amendments
  • proposals for 2021-2027

Ing. Helena Viktorie Barbořáková


The new Performance Framework and Reporting

  • the OP template - baselines and setting targets
  • the Reporting template - measuring progress
  • setting targets for the Performance Framework

Robin Smail


Coffee break


Is ESF achieving results?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore


Case study with Performance Framework

  • should we use unit-cost benchmarks?
  • Are the indicators adequate?
  • Benchmarks exercise

Robin Smail


End of first day


DAYS 2 & 3

Seminar Stage 2: Evaluations during the programming period


Registration of participants


Opening of stage 2 seminar: introduction, objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands


Evaluation and measuring impact, 2014-2020

  • the purpose of evaluation - criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation methods, techniques
  • evaluation and monitoring requirements, 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)


Exercise: evaluation questions - by sector

Robin Smail


Coffee break


Exercise: evaluation questions - by sector (contd).

Robin Smail


Evaluation in the context of Programme Management

  • Evaluation and its neighbourhood (discussion)
  • Evaluation types and purposes
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Evaluation Plans and their challenges - The Czech experience
  • Internal, external and mixed team evaluations

Dr. Vladimir Kváča, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society


Lunch break


Workshop: Managing evaluation studies, part 1:

  • the intervention to be evaluated,
  • the purpose of evaluation
  • evaluation stakeholders

Jan Hněvkovský Director, Consultancy Company GovLab.cz, Prague


Evaluation questions

  • Three kinds of evaluation questions (descriptive, normative, causal)
  • Divergent and convergent phase of questions formulation

Jan Hněvkovský


Workshop: Managing evaluation studies, part 2:

  • Asking the right questions; methods

Jan Hněvkovský


Coffee break


Choice of methods and techniques: theory-based and counter-factual evaluations

  • What limits the choice of methods?
  • Theory-based evaluations - an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies

Vladimir Kváča


Workshop: Managing evaluation studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča


End of second day





Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Jan Hněvkovský


Workshop: Counterfactual Evaluations

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča


Coffee break


Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria
  • Deliverables
  • Using the evaluation results

Vladimir Kváča


Lunch break


WORKSHOP: assessing risk in projects


Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis
  • Case study

Robin Smail


Coffee break


Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail


Seminar conclusions, evaluation feedback


Close of seminar



European Institute of Public Administration (EIPA)

Het Europees instituut voor bestuurskunde (beter bekend als The European Institute of Public Administration - ofwel EIPA) streeft ernaar om de kennis van ambtenaren die zich met de EU bezighouden te vergroten door het ontwikkelen en organiseren van trainingen. Het instituut wil wetenschappelijke kennis en praktische 'know–how' met elkaar verbinden. EIPA bestaat al meer dan 35 jaar.

Het hoofdkantoor van EIPA is gevestigd in Maastricht en heeft dependances in Luxemburg en Barcelona. Gemiddeld nemen 14.000 nationale en Europese ambtenaren per jaar deel aan de trainingen. Daarnaast biedt EIPA ook consultancy, onderzoek en op maat gemaakte programma’s/trainingen aan. Bij EIPA werken circa 120 hoogopgeleide medewerkers.


Meer over...

Terug naar boven