Results-based public management

1 1 implementation AND MONITORINGE valuationDesignImplementation and MonitoringMODULE 3 DiagnosisResults- based public managementTools for the design and implementation of public rural development programs with a project cycle approach2 results based public ManagementTOOLs fOR ThE DEsIGN AND implementation Of public RURAL DEvELOPMENT PROGRAMs wITh A PROjEcT cycLE APPROAchiIMPLEMENTATION AND MONITORINGE valuationDesignImplementation and MonitoringMODULE 3 DiagnosisU n i t e d n at i o n s F o o d a n d a g R i cU ltU Re o Rg a n i z at i o nS a n t i a g o , 2 0 1 4 Results-based public managementTools for the design and implementation of public rural development programs with a project cycle approachiiResults based public ManagementTOOLs fOR ThE DEsIGN AND implementation Of public RURAL DEvELOPMENT PROGRAMs wITh A PROjEcT cycLE APPROAchThe designations employed and the presentation of material in this informationproduct do not imply the expression of any opinion whatsoever on the part of thefood and Agriculture Organization of the United Nations (fAO) concerning the legalor development status of any country, territory, city or area or of its authorities, orconcerning the delimitation of its frontiers or boundaries.

2 The mention of specificcompanies or products of manufacturers, whether or not these have been patented,does not imply that these have been endorsed or recommended by fAO in preferenceto others of a similar nature that are not views expressed in this information product are those of the author(s) and do notnecessarily reflect the views or policies of 978-92-5-108523-3 (print)E-IsbN 978-92-5-108524-0 (PDf) fAO, 2014fAO encourages the use, reproduction and dissemination of material in this informationproduct. Except where otherwise indicated, material may be copied, downloaded andprinted for private study, research and teaching purposes, or for use in non-commercialproducts or services, provided that appropriate acknowledgement of fAO as the sourceand copyright holder is given and that fAO s endorsement of users views, products orservices is not implied in any requests for translation and adaptation rights, and for resale and other commercialuse rights should be made via or addressed information products are available on the fAO website ( )

3 And can be purchased through AND MONITORINGA cknowledgements ---------------------------------------- ---------------------------------------- ----------------------------------ixPres entation ---------------------------------------- ---------------------------------------- ---------------------------------------- ----xiIntroduction ---------------------------------------- ---------------------------------------- ---------------------------------------- ---xiiiI. implementation and monitoring of a program or project ---------------------------------------- -------1 Chapter 1 Methodology for the execution and monitoring of a program or project ---------------------------------------- 2 budgeting based on results ---------------------------------------- ---------------------------------------- --------3 Regulation ---------------------------------------- ---------------------------------------- -----------------------------8 management evaluation ---------------------------------------- ---------------------------------------- ------------14 Monitoring ---------------------------------------- ---------------------------------------- ---------------------------29 Intermediate performance evaluation ---------------------------------------- ----------------------------------38 Summary

4 ---------------------------------------- ---------------------------------------- ---------------------------------------- -----------42II. Tools ---------------------------------------- ---------------------------------------- ---------------------------------------- ------45 Tool 1 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------46 case study: Terms of reference for the evaluation of the design of a program ---------------------------------------4 6 Tool 2 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------56 case study: Terms of reference for the evaluation of the functioning and implementation of a program -------56 Tool 3 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------65 sampling method for a mini-survey to collect information for monitoring indicators --------------------------------65iiicon tentsivResults based public ManagementTOOLs fOR ThE DEsIGN AND implementation Of public RURAL DEvELOPMENT PROGRAMs wITh A PROjEcT cycLE APPROAchTool 4 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------80 sampling method for the collection of information for monitoring the quality of the service and the follow up on the aid of a program or project

5 ---------------------------------------- -----------------------------------80 Tool 5 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------83 Questionnaire for monitoring the quality of service of a program or project ---------------------------------------- --83 Tool 6 ---------------------------------------- ---------------------------------------- ---------------------------------------- ---------------86 Questionnaire for monitoring the follow up on the aid granted by a program or project ---------------------------86F I g uR E S Figure 1. Project life cycle: implementation and Monitoring ---------------------------------------- ---------------------2 Figure 2. Diagram of the Results-based budgeting process in Mexico ---------------------------------------- ---------5 Figure 3.

6 From the Logical framework to the rules of operation ---------------------------------------- ----------------8 Figure 4. Analysis of the allocation of resources of a public program ---------------------------------------- ---------15 Figure 5. Diagram of monitoring through the Lf ---------------------------------------- ---------------------------------29 Figure 6. spectrum of methods for collecting information ---------------------------------------- ----------------------37 Figure 7. Route of intermediate performance evaluation ---------------------------------------- -----------------------38 Figure 8. characteristics of the Tscs ---------------------------------------- ---------------------------------------- ------66 Figure 9. Example of the area and the five subareas of monitoring ---------------------------------------- -----------81T aB l E S Table 1.

7 Group and types in the budget programmatic structure ---------------------------------------- --------------4 Table 2. Guidelines for going from the Logical framework to the rules of operation of the corresponding programs ---------------------------------------- ---------------------------------------- -------------------------------9 Table 3. Evaluation topics and questions on design evaluation ---------------------------------------- ---------------16 Table 4. Evaluation topics and questions in the area of planning ---------------------------------------- ------------22 Table 5. Evaluation topics and questions in the area of implementation ---------------------------------------- ---24 Table 6. Evaluation topics and questions in the area of monitoring and evaluation ------------------------------26ivvIMPLE MENTATION AND MONITORING Table 7. Relationship between the elements of the Logical framework and monitoring ------------------------30 Table 8.

8 Example of outcome and impact indicators ---------------------------------------- ---------------------------32 Table 9. Example of management indicators ---------------------------------------- ------------------------------------32 Table 10. Example of indicators that present deviation with respect to targets -------------------------------------33 Table 11. Example of indicators that show the meeting of targets ---------------------------------------- ------------34 Table 12. results of the monitoring of the Goal indicator ---------------------------------------- -----------------------35 Table 13. results of monitoring the Purpose indicator ---------------------------------------- --------------------------35 Table 14. results of monitoring the Output indicator ---------------------------------------- ----------------------------36 Table 15. Region and number of municipalities of sampleland ---------------------------------------- ----------------67 Table 16.

9 Approved requests by region of sampleland and cumulative sum ---------------------------------------6 8 Table 17. results of scenario 1 ---------------------------------------- ---------------------------------------- --------------77 Table 18. results of step 2 ---------------------------------------- ---------------------------------------- -------------------77 Table 19. results of step 4 ---------------------------------------- ---------------------------------------- --------------------78 Table 20. LQAs for the calculation of the optimum sample size at a 95% confidence level ---------------------82vviResults based public ManagementTOOLs fOR ThE DEsIGN AND implementation Of public RURAL DEvELOPMENT PROGRAMs wITh A PROjEcT cycLE APPROAcha C Ro n yM SConEV alNational social Development Policy Evaluation councilEuEuropean UnionFaoUnited Nations food and Agriculture OrganizationITInformation TechnologylFLogical frameworklQaSLot Quality Assurance samplingMfRManagement for ResultsnDPNational Development PlanRBBR esults- based budgetSagaRPaMinistry of Agriculture, Livestock, Rural Development.

10 Fishing and foodSIMERThe Monitoring and Evaluation for results systemTSCSTwo-stage cluster samplingviviiIMPLEMENTATION AND MONITORING viiviiiResults based public ManagementTOOLs fOR ThE DEsIGN AND implementation Of public RURAL DEvELOPMENT PROGRAMs wITh A PROjEcT cycLE APPROA chixIMPLEMENTATION AND MONITORING acknowledgementsfor more than ten years, the United Nations food and Agriculture Organization (fAO), through ongoing rural policy evaluation and analysis projects, has provided technical assistance to the Ministry of Agriculture, Livestock, Rural Development, fishing and food (sAGARPA) of Mexico, in the area of evaluation of programs promoting agriculture, fishing and aquaculture production, and rural development. In the framework of this cooperation, methodological tools have been developed jointly for the management of the different phases of a program: sector diagnosis, design, implementation and evaluation.