MONITORING AND EVALUATION OF CLIMATE …

1 MONITORING AND EVALUATION OF CLIMATE change adaptation IN NEPAL: A REVIEW OF national SYSTEMS1 By Susannah Fisher (IIED) and Michelle Slaney (Practical Action Consulting) 1 . The authors would like to thank Mr Batu Uprety, Dr Dinesh Devkota and Mr Teertha Dhakal who commented on earlier versions of this report, as well as all of the interviewees for their time and comments. Any errors and omissions remain our own. 2 TABLE OF CONTENTS LIST OF ACRONYMS .. 4 EXECUTIVE SUMMARY .. 6 1. Introduction .. 7 Purpose and approach of the report and key findings .. 7 CLIMATE vulnerabilities and future predictions .. 9 national approaches to development and policies on CLIMATE change .. 13 Large-scale adaptation interventions .. 16 2. Frameworks, practices and institutions for national MONITORING and EVALUATION systems.

2 19 Institutional arrangements for national M& 19 Methodologies for national M&E .. 22 3. MONITORING and EVALUATION of CLIMATE change adaptation .. 25 M&E within the Ministry of Science, Technology and Environment responsible for CLIMATE change co-ordination .. 26 M&E frameworks for the main adaptation interventions and their position within government institutions .. 28 The alignment of development partner frameworks and national approaches .. 34 The impact of development partner approaches on Government frameworks .. 37 4. M&E of other government initiatives in key socio-economic sectors .. 38 The M&E of major interventions in Ministry of Health, Ministry of Education .. 38 Good practices and the applicability of these to adaptation .. 42 5. Discussion: good practices and current limitations/challenges across the system.

3 43 Capacity for M&E across government ministries .. 44 Data .. 44 Political priority and uptake of results .. 46 Human Resources and co-ordination .. 46 Relevance to CLIMATE change adaptation .. 47 6. Conclusions .. 47 Good practice and lessons learned from this case study .. 47 Challenges and limitations and how they might be addressed .. 48 Ways forward .. 48 REFERENCES .. 49 ANNEX 1: LIST OF STAKEHOLDERS CONSULTED .. 52 ANNEX 2: SUMMARY OF LARGE-SCALE adaptation INTERVENTIONS .. 53 ANNEX 3: LOGIC MODEL FOR THE NCCSP (DRAFT SEP 2012) .. 56 ANNEX 4: GLOBAL CIF INDICATORS .. 57 ANNEX 5: GUIDANCE ON COMPILING THE LOG FRAME FROM THE NPC RBME GUIDELINES (2010) AND A SAMPLE LOG FRAME DEVELOPED FOR THE SOIL CONSERVATION AND WATERSHED PROGRAMME (2007) .. 58 3 Tables Table 1. Information on disasters in Nepal .. 11 Table 2. Development of CLIMATE policies in Nepal.

4 14 Table 3. Example of sectoral MONITORING of implementation in agriculture using the RBME guidelines 24 Table 4. Goals and indicators measured in the Education for All programme .. 42 Figures Figure 1. Vulnerability maps for Nepal .. 12 Figure 2. Institutions to support implementation of CLIMATE change policies in Nepal .. 16 Figure 3. The institutional arrangements for national level M&E .. 21 Figure 4. Representation of main M&E practices in the MoSTE .. 27 Figure 5. Thematic break down of development partner financing for CLIMATE change in Nepal .. 28 Figure 6. Main reporting channels and M&E framework for an external development partner funded project in MoSTE .. 29 Figure 7. Development of the Nepal results based framework .. 32 Figure 8. Different M&E frameworks and their audiences .. 37 Figure 9. MONITORING and reporting system within the Ministry of Health and Population.

5 40 Figure 10. MONITORING and reporting system within the Ministry of Education .. 41 4 LIST OF ACRONYMS ADB Asian Development Bank AEPC Alternative Energy Promotion Centre CARE Cooperative for Assistance and Relief Everywhere CCA CLIMATE change adaptation CCMD CLIMATE change Management Division CCPCC CLIMATE change Programme Coordination Committee CCPRF CLIMATE change Programme Results Framework CDM Clean Development Mechanism CMED Central MONITORING and EVALUATION Division CTEVT Council of Technical Education and Vocational Training DCC District Coordination Committee DDC District Development Committee DfID Department for International Development DHM Department of Hydrology and Meteorology DNA Designated national Authority DOE Department of Education DoHS Department of Health Services DPMAS District Poverty MONITORING Analysis System EDI Education for All Development Index EFA Education for All EFA EMIS

6 Education Management and Information System FECOFUN Federation of Community Forestry Users in Nepal GCMs Global Circulation Models GDP Gross Domestic Product GLOF Glacier Lake Outburst Floods GoN Government of Nepal HMIS Health Management and Information System IFC International Finance Corporation IPCC Inter-governmental Panel on CLIMATE change JARs Joint Annual Reviews LAPA Local adaptation Plan of Action LFA Logical Framework Approach MCCICC Multi-stakeholder CLIMATE change Initiatives Coordination Committee MDAC Ministerial Development Action Committee MDGs Millennium Development Goal MfDR Managing for Development Results 5 NCCSP Nepal CLIMATE change Support Programme NDAC national Development Action Committee NeKSAP Nepal Food Security MONITORING and Analysis System NHSP Nepal Health Sector Programme NITC national Information Technology Centre NLSS national Living Standards Survey NPC national Planning Commission NPCS national Planning Commission Secretariat NSDRM national Strategy for Disaster Risk Management NWP national Water Plan PMAS Poverty MONITORING and Analysis System PPCR Pilot Programme on CLIMATE Resilience PPIS Project Performance Information System PRSP Poverty Reduction Strategy Paper RBME Results Based MONITORING and EVALUATION RCMs Regional CLIMATE Models REDD Reducing Emission from Deforestation and Forest Degradation SPCR Strategic Programme for CLIMATE Resilience SWAp Sector-wide approach TWG Technical Working Group TWGs Thematic Working Groups TYIP Three Year Interim Plan TYP Three Year Plan UNFCCC United Nations Framework Convention on CLIMATE change VDC Village Development Committee WB World Bank WFP World Food Programme WRS

7 Water Resources Strategy WWF World Wide Fund for Nature 6 EXECUTIVE SUMMARY national MONITORING and EVALUATION (M&E) systems in Nepal have been evolving rapidly in the past decade. There have been new guidelines and approaches developed by the national Planning Commission in order to move the government towards results based management and use of sectoral and national indicators. There are examples of improvements and good practice across the government where targets and sectoral approaches are being used and data management systems from the local to the national level are in operation. However, even systems that have extensive data collection and systems for performance management, such as Education and Health, face challenges in moving from MONITORING progress to evaluating performance, and using the data and frameworks to feedback into future planning processes.

8 Within this context, the M&E of CLIMATE change adaptation is a new challenge that has emerged very recently and the government, with the support of the development partners, is trying a range of approaches to adaptation and its M&E. The recent development of the national adaptation Programme of Action (NAPA) in 2009-2010 identified national adaptation priorities and aspects of the NAPA priorities are now being taken forward by various projects supported by the development partners such as the Strategic Progamme on CLIMATE Resilience (SPCR), the Nepal CLIMATE change Support Programme (NCCSP) and the Hariyo Ban programme. These are three of the largest adaptation interventions in Nepal, which are currently in the planning or implementation phase. Outside these adaptation programmes there are many CLIMATE relevant development programmes being undertaken by the Government of Nepal, but these do not yet explicitly address additional CLIMATE risks as a core part of their work.

9 The M&E of CLIMATE change adaptation is coordinated by the Ministry of Science, Technology and Environment (MoSTE) that monitors its own annual programme through budgetary and progress reports to national institutions. The development partner projects on adaptation are co-ordinated within this framework and must report on progress in national formats and processes. They also have their own M&E frameworks, and sometimes also have global indicators for an international programme or a global development partner. These adaptation programmes have also created their own baselines in conjunction with government sources, and developed indicators in consultation with the government. These frameworks are aligned in some ways with government priorities, but some issues have been contentious, such as the relationship of new programmes to the existing NAPA priorities.

10 There are also multiple pressures in designing the M&E frameworks including the data requirements of the development partner for their own reporting, and so often only partial alignment is possible. Data limitations also mean that new sources or additional indicators in national surveys may be needed for CLIMATE change adaptation ; at the moment this extra data is being collected on a project by project basis and not being centrally collated or managed across programmes. There are a number of challenges to successful CLIMATE change adaptation M&E including the lack of capacity, the availability, reliability and management of data, and human resource constraints. However the implementation of these adaptation programmes also provides an opportunity to address these issues from the inception. There are plans to set up a coordinating mechanism for CLIMATE change programmes and their results based frameworks, and this could be the first step towards a more comprehensive approach to the M&E of CLIMATE change adaptation .