GUIDANCE ON MONITORING AND EVALUATION

1 Clara Hagens, Dominique Morel, Alex Causton and Christina WayGUIDANCE ON MONITORING AND EVALUATIONi Founded in 1943, Catholic Relief Services supports relief and development activities in more than 100 countries. Without regard to race, creed or nationality, CRS provides emergency relief in the wake of natural and man-made disasters. Through development projects in education, peace and justice, agriculture, microfinance, health, HIV and AIDS, CRS works to uphold human dignity and promote better standards of living for the poor and disadvantaged overseas.

2 In Asia, CRS works with several thousand partner organizations, focusing on improving community resilience to disasters, including HIV and AIDS, promoting the dignity and empowerment of women, as well as strengthening agricultural livelihoods, community water management, health and education systems. CRS also works throughout the Unites States to expand the knowledge and action of Catholics and others interested in issues of international peace and justice. Our programs and resources respond to the Bishops call to live in solidarity as one human family across borders, over oceans, and through differences in language, culture and economic conditions.

3 First published in 2008 by the CRS South Asia Regional Office under the title The CRS South Asia M&E GUIDANCE Series Revised October 2012 Developed and written by Clara Hagens Edited by Alex Causton and Dominique Morel based on an original project by Christina Way, then M&E team leader, CRS Pakistan 2008 Catholic Relief Services. Any reproduction, translation, derivation, distribution or other use of this work is prohibited without the express permission of Catholic Relief Services (CRS).

4 Ii Table of Contents Introduction .. 1 PART I: BASIC M&E CONCEPTS Core M&E Standards .. 3 1. M&E systems include need-to-know information only .. 3 2. M&E staff collects reliable data .. 4 3. M&E staff transforms data into information and then into knowledge .. 4 4. M&E staff uses and disseminates results .. 5 Gender and M&E .. 6 1. M&E systems include a comparison of data from women and men .. 6 2. M&E staff collects data from women in culturally appropriate ways .. 7 Project MONITORING .

5 8 1. M&E staff monitors the project and context both formally and informally . 8 2. M&E systems are designed to engage communities in MONITORING .. 9 Annex A. Field trip report .. 12 Community Participation in M&E .. 13 1. M&E systems track the changes most important to communities .. 14 2. Communities participate in data collection for MONITORING and for EVALUATION .. 16 3. Communities contribute to the interpretation of M&E data .. 17 M&E in Emergencies .. 20 1. Early MONITORING systems are simple, use-oriented and flexible to accommodate change in context and activities.

6 20 2. Monitor the relevance, effectiveness and quality of the response to increase accountability to the people we serve .. 25 3. Create a formal M&E system for the overall response as soon as the situation stabilizes .. 27 Annex A. Example of a postdistribution pile-ranking exercise .. 29 Annex B. Distribution MONITORING form with accountability questions .. 31 iii PART II: M&E PLANNING AND IMPLEMENTATION Creating an M&E Plan .. 33 1. Finalize M&E plans within the first quarter of the project.

7 33 2. An M&E plan s level of complexity is appropriate for the scale and time frame of the project .. 34 3. M&E plans include an appropriate balance of qualitative and quantitative data .. 35 Annex A. M&E plan template .. 36 Annex B. M&E plan template GUIDANCE and tips .. 37 Creating an Analysis Plan .. 39 1. M&E systems include analysis plans for MONITORING and for EVALUATION .. 39 2. Analysis plans remain dynamic throughout the life of the project .. 40 Annex A. Key components of an analysis plan.

8 41 Developing Quantitative Tools .. 43 1. Quantitative tools include only need-to-know information .. 43 2. Quantitative tools include only quantitative questions .. 44 3. Field-test quantitative tools and revise as needed prior to use .. 45 Annex A. GUIDANCE for developing and formatting the questionnaire .. 46 Annex B. Tips for developing quantitative questions .. 47 Annex C. Developing quantitative questions common problems and solutions .. 49 Developing Qualitative Tools .. 50 1. Qualitative tools include only need-to-know information.

9 50 2. Qualitative tools include only qualitative questions .. 51 3. Field-test qualitative tools and revise as needed prior to use .. 52 Annex A. Developing qualitative questions common problems and solutions .. 53 Random Sampling .. 54 1. Use random sampling when collecting quantitative data .. 54 2. Use the standard sampling equation to determine a sample size sufficient for generalizing results to represent the target population .. 55 Annex A. Clustering your sample .. 58 Annex B. Selecting sample units with a complete list of units.

10 59 Annex C. Selecting sample units without a complete list of units .. 60 iv Purposeful 61 1. Use purposeful sampling when collecting qualitative data .. 61 2. Include two to three groups or individuals to represent each perspective or comparison group .. 62 Training and Field 64 1. Train the data collection team on survey objectives and tools prior to each data collection exercise .. 64 2. Data collection teams field-test the tool(s) prior to use .. 65 Annex A. Roles and responsibilities of supervisors.