COMMUNITY DEVELOPMENT EVALUATION MANUAL

1 COMMUNITY DEVELOPMENT EVALUATION MANUALA guide to planning and evaluating COMMUNITY DEVELOPMENT work with refugee communities 2 Published by the NSW Service for the Treatment and Rehabilitation of Torture and Trauma Survivors (STARTTS)First published 2012 Text prepared by Emma Pittaway and Georgia Swan STARTTS 2012 All rights reserved. This work is copyright, but permission is given for refugee COMMUNITY organisations and not-for-profit COMMUNITY DEVELOPMENT and refugee settlement service organisations to make copies by photocopying or other duplicating purposes for use within their organisations. This permission does not extend to the making of copies for use outside the organisations, nor for the making of copies for hire, sale or resale to third permission to use these materials outside these guidelines, or to obtain copies of the MANUAL , please contact:NSW Service for the Treatment and Rehabilitation of Torture and Trauma Survivors (STARTTS)152-168 The Horsley DrCarramar NSW 2163 AustraliaPO Box 203 Fairfield NSW 2165T: +61 2 9794 1900F: +61 2 9794 ABN: 151 363 722 48 ISBN: 978-0-646-58385-3 3 ACKNOWLEDGEMENTSThis EVALUATION MANUAL is the product of extensive collaboration with STARTTS staff and external EVALUATION would like to thank the following people for contributing to the production of the material:Paul Bullen for providing valuable EVALUATION expertise.

2 Dayamanthi Muthukumarage for creating the graphics; Antje Rummel for the design; and the many STARTTS colleagues who provided input and support, especially: Susan Maddrell, Samira Hassan, Elizabeth Schaffer, Susan Cunningham, Sussan Omar, Lina Ishu, and Patrick overall support of the concept and process, special thanks to Jorge Aroche, CEO of STARTTS, and Jasmina Bajraktarevic-Hayward, STARTTS COMMUNITY Services 3 Glossary of key terms 6 The purpose of this MANUAL 9 Context of the MANUAL 10 How to use this MANUAL

3 10 Part 1: COMMUNITY DEVELOPMENT 11 The COMMUNITY DEVELOPMENT process 121. Getting to know each other 132. Clarifying roles and skills 133. Grounding practice in COMMUNITY DEVELOPMENT principles 144. Defining the project and its objectives 165. Allowing the project to emerge and evolve 16 COMMUNITY DEVELOPMENT worker good practice checklist 17 STARTTS approach to COMMUNITY DEVELOPMENT 18 Part 2: EVALUATION principles 19 Why evaluate?

4 20 Principles of COMMUNITY DEVELOPMENT EVALUATION 20 Participatory EVALUATION 21 Empowerment EVALUATION 22 Ethical EVALUATION 23 Informed Consent 24 Confidentiality 26 Reciprocal benefit 26 Types of monitoring vs.

5 EVALUATION 27 Participation 27 Monitoring vs. EVALUATION 27 Process, outcomes and impact EVALUATION 28 Part 3: Planning an EVALUATION 31 Step 1: Setting the project goal and objectives 35 Using then logic 37 Step 2.

6 Clarifying EVALUATION purpose and scope 38 Stakeholder engagement 39 Responsibility and resources 40 What type of EVALUATION is appropriate? 41 Ethical considerations 425 Step 3: Defining the EVALUATION questions 43 Step 4: Identifying the information you need 45 Using indicators 46 Step 5: Deciding on data collection methods 48 Qualitative or quantitative data?

7 49 Tri a n g ul ati o n 50 Date collection techniques 51 Data collection timeline 57 Step 6: Deciding on data analysis techniques 59 Qualitative data analysis 60 Quantitative data analysis 62 Step 7.

8 How to report and use the findings 65 Preparing the EVALUATION report 65 Sharing the findings 66 Evaluations with Children and young people 67 Creative methodologies 69 Common challenges in EVALUATION 711. Ensuring meaningful participation 712.

9 Defining and measuring project outcomes 723. Making sure all voices are heard 734. Finding appropriate methodologies 735. Making sure data is valid and reliable 736. Showing causing and effect 747. Reaching consensus 758. Continuing EVALUATION after project completion 75 PART 4: Templates, examples and resources 767-step EVALUATION planning checklist 77 EVALUATION resource list 79 Sample parental permission form 84 Sample parental EVALUATION consent form 85 Sample template.

10 Project goal, objectives and activities 86 Sample goal, objectives and activities Dancing in Harmony 87 Project Goal 87 Sample outcomes indicators 88 Sample focus group questions women s group 89 Focus group to evaluate a women s group 89 Sample participant feedback forms 90 Sample survey 91 Sample qualitative data analysis