Monitoring and Evaluation of PFM Reform Programmes

Course evaluation        

Description

Monitoring and Evaluation of Public Finance Management Reform Programmes provides a useful basis to develop effective frameworks for monitoring and evaluating  PFM reforms based upon a combination of internationally adopted PFM assessment tools, self assessments and systems audits and the application of reviewable milestones.  The primary framework adopted is the logical framework or logframe adopted by a number of bilateral and multilateral donors. It is based on the “results-chain logic”.  The Logframe is a tool that can communicate the essential elements of a complex programme, such as a PFM reform programme, clearly, and succinctly throughout the project cycle.   The Logframe is used to develop the overall design of a project, to improve project implementation monitoring, and to strengthen periodic project evaluation.  In essence the Logframe is a cause and effect model of project interventions to create desired outcomes.  The emphasis on a logical framework approach provides the participant with relevant and effective tools to assess and understand a given country´s PFM reform and adopts a broad range of techniques to measure and evaluate progress over time.

The professional development workshop covers a basic introduction to Monitoring and Evaluation methods and principles.  It presents the reform programme within the framework of a system model that seeks to achieve specified outputs and outcomes within a given time frame and budget using available input resources and defined activities.  It introduces the logframe as a tool for both planning and monitoring reform implementation and explores a number of important risk areas with respect to reform implementation.  Reform implementation is discussed with respect to both the horizontal elements (pertaining to the different sectors) as well as the vertical elements pertaining to the institutional structure of PFM. This in turn informs the basis adopted for monitoring roll out.  The course covers a wide variety of measurement techniques and notes the relationships between activity implementation and output and outcome impacts.    The effects of PFM reform sequencing (or the lack thereof) on output and outcome achievements are considered in depth.

The use of PEFA indicator scores as a basis for monitoring the impacts of a PFM reform effort of PFM performance is covered in some detail.  Other assessment tools introduced include the DeMPA and the OECD/DAC National Procurement Assessment tools.

All indicators employed in a monitoring and evaluation framework require the establishment of base line indicators.  Part of the role of the Monitoring and Evaluation function is to measure progress, and identify bottlenecks and issues that are impeding progress and recommend actions to be taken in order to sustain progress toward the agreed benchmark.   The course will use the case study method to develop skills to identify bottlenecks and implement corrective actions.

Objective

The principal professional workshop objective is to provide participants with the introductory tools to effectively understand as well as develop logframes; and to be able to measure and assess the impact of implemented PFM reform activities on PFM performance.  It provides participants with a basis to monitor and evaluate the implementation of PFM reforms with a special emphasis on the implementation of IFMIS systems.  Further it is to allow discussion and interaction with other participants who may share common challenges.

Audience

The target audience is Government officials and Development advisors involved in the reform of public finance management.  It especially targets staff in Monitoring and Evaluation units of PFM reform management programmes.  

Pre-requisites

This course is designed for people with experience in Public Finance Management and in the institution of PFM reforms.  It will be useful for participants to familiarize themselves with basic PFM reform concepts and terminology prior to attending the course.   Participants should consider taking a course such as P-3 PFM 007 – Public Finance Management: From Assessment to Reform.  

Learning outcomes

By the end of the course participants should:

• Understand the logframe tool to achieve stakeholder consensus; summarise and link the key aspects and anticipated impact of your project; communicate information concisely and unambiguously; identify measurable performance indicators and the means of verifying progress; bring together in one place a statement of all key aspects of the reform project in a systematic, concise and coherent way; and apply it as a framework for monitoring and evaluation where planned and actual results can be compared.

• Understand how such internationally recognized assessment tools such as PEFA, DEMPA and the OECD/DAC National Procurement Assessment indicator scores can be incorporated into a monitoring and evaluation framework.  Defining appropriate complimentary indicator sets as well as learn to specify appropriate reviewable milestones.   Establishing the base line, the targets and the indicators based upon reliable and timely data sources.

• Develop an appreciation of the impact on sequencing of PFM reform activities on PFM performance and consequently understanding the relationship between the implementation of PFM activities and the improvements in measured outputs and outcomes.

• Understand how the log frame approach promotes evidence based policy making; allows for stakeholders to be involved in the policy cycle and process; supports a targeted, sequenced and long term perspective; and supports clear channels of communication.

• Learn how to monitor and evaluate specifically the implementation of an IFMIS project especially in relation to the sequencing and rollout of the different functional components.
• Learn how to link the Logframe to Implementation Planning Tools such as the Work Breakdown Structure, the Gantt and the Responsibility Chart.

Learning methods

The learning methods will include the following

• Introduction to key concepts through the “teaching and discussion” methods
• The use of original source material of key writers/thinkers in the area of monitoring and evaluation and in the application of the logframe tool
• The use of extensive examples from many different countries with different experiences to illustrate the points put across
• The use of exercises (in particular short "buzz-group" sessions) to provoke and consolidate certain points raises
• The use of major case studies –to illustrate in more detail some of the key points of the course.