Monitoring and Evaluation Manual - FSN) Network

1 Monitoring and Evaluation Manual Prepared for ADRA International Food Security Department Prepared by TANGO International, Inc. March 2007 ADRA Monitoring and Evaluation Manual i Table of Contents Acronyms .. iv Part I. Overview of Monitoring and Evaluation .. 1 1. Introduction .. 1 Purpose of the Monitoring and Evaluation Manual .. 1 Using the Manual .. 2 2. Guiding Principles and Elements of Monitoring and Evaluation .. 3 What is Monitoring and Evaluation ? .. 3 Why Does a Program Need a Monitoring and Evaluation System?

2 5 General Overview of Basic Elements of a M&E System .. 6 Monitoring and Evaluation Framework .. 7 General Overview of Indicators and Indicator Development .. 8 Managing for Impact .. 10 3. Conceptual Frameworks for Programming .. 12 Conceptual Frameworks for Project Design .. 12 The USAID/FFP Expanded Conceptual Framework for Food Security .. 15 Part II. Key Components and Stages of M&E Systems .. 17 4. Vulnerability or Holistic Assessments .. 17 Assessment Preparation .. 17 Defining Assessment Objectives .. 20 Target Area Selection.

3 20 5. Problem Analysis .. 21 Using Cause and Effect Logic in Project Design .. 22 Hierarchical Problem Analysis .. 23 From Problem Analysis to Project Strategy .. 24 6. Program Design and Logical Frameworks .. 27 Establishing SMART Goals and Objectives .. 28 Design Principles for Monitoring and Evaluation .. 29 Logical Frameworks .. 29 General Logical Frameworks: linking indicators to program design .. 30 The Logical Framework Matrix (LogFrame) .. 31 7. Steps to Setup a Monitoring Systems .. 37 Six steps to Setup an M&E System.

4 37 Monitoring for Performance and Participation .. 40 Participatory Monitoring .. 41 Monitoring the Risk and Vulnerability Context .. 43 8. Establishing Indicators and Performance Targets .. 45 What are Indicators and Targets .. 45 Types of Indicators .. 46 Identifying what and how to measure .. 47 Characteristics of Ideal Indicators .. 48 Criteria for selection of sound indicators .. 49 Outcome and impact 49 Performance targets and benchmarks .. 50 Approaches to establishing/setting targets .. 51 Limitations of targets.

5 51 9. Sampling: Key Concepts .. 52 Introduction to Sampling .. 52 Types of Sampling .. 52 Key Definitions .. 53 Sampling Methods/Design .. 54 ADRA Monitoring and Evaluation Manual ii Non-Probability Sampling .. 56 10. Baseline Surveys and Data Management .. 58 Initial considerations in conducting a baseline survey .. 58 Methods of data collection .. 59 Developing a baseline survey .. 60 Data collection process .. 63 Data 65 11. Data Analysis .. 67 Data 67 Quantitative Data Analysis .. 68 Qualitative Data Analysis.

6 70 Data Interpretation and Presentation .. 70 12. Information Sharing .. 72 Part III. M&E Considerations for Sector-Specific Programming .. 76 13. M&E Considerations for Food Security Programs .. 76 Seasonality and Cross-program Comparability .. 76 Food Availability .. 76 Food Access .. 77 Food Utilization .. 79 Market Information .. 80 14. M&E Considerations for Health and Nutrition .. 80 Selection of Indicators .. 80 Integrated Disease Surveillance and Nutrition Surveillance Systems .. 82 Nutrition .. 83 15. M&E Considerations for Micro Enterprise Programs.

7 84 16. M&E Considerations for Reproductive Health Programs .. 85 17. Integrating Cross-Cutting Issues into Data Collection .. 87 HIV/AIDS .. 87 Gender .. 88 Conflict .. 88 References .. 89 Annexes .. 91 Annex 1: Components of a Humanitarian Information System .. 92 Annex 2: Sampling .. 94 Annex 4: Food Security Weathervane Indicators .. 106 Annex 5: Potential Indicators for Use in Health and HIV/AIDS .. 113 Annex 6: Potential Indicators for Use in Micro & Small Enterprise Development .. 114 Annex 9: Example of Topical Outline for Use in Qualitative Assessments.

8 122 Annex 10: Qualitative Assessment Tools .. 127 Annex 11: Example of Community Questionnaire .. 129 Annex 12: Example of Qualitative Data Matrix .. 140 Annex 13: Preparatory Tasks for Vulnerability Assessments .. 142 Annex 14: How to Develop M&E Plan .. 148 ADRA Monitoring and Evaluation Manual iii List of Figures Figure 1: Project Hierarchy .. 6 Figure 2: Monitoring and Evaluation Framework .. 8 Figure 3: Indicators and Targets Along With the Project Hierarchy .. 13 Figure 4: Livelihoods Framework .. 13 Figure 5: USAID/FPP Expanded Conceptual Framework.

9 13 Figure 6: Hierarchical Problem Tree .. 13 Figure 7: The Project Cycle .. 13 Figure 8: Linking the Results Framework to a Logical Framework .. 30 Figure 9: A Logical Framework with indicators .. 31 Figure 10: Indicators for LogFrame .. 13 Figure 11: Partial Results framework for National TB Program .. 13 Figure 12: Definition of Results Based Management .. 13 Figure 13: Factors Influence People s Participation in M&E .. 13 Figure 14: Key Steps in Creating and Selecting Indicators .. 13 Figure 15: Transforming Ideas about Quality into Measures for Which Targets Can Be Set.

10 50 Figure 16: Various Methods of Random Sampling .. 13 Figure 17: Essential Components of a Baseline Survey Plan .. 61 Figure 18: TIPS for Questionnaire Design .. 61 Figure 19: Sample Frequency Table .. 69 Figure 20: Minimum Information Requirements for Food Availability .. 77 Figure 21: Minimum Information Requirements for Food Access .. 77 Figure 22: Information Requirements for Food Utilization .. 77 List of Tables Table 1: Types of Indicators and 9 Table 2: Common Sources of Secondary Data ..18 Table 3: Descriptive Information Obtained through Secondary Data Analysis.