Evaluation of the Commonwealth Secretariat’s …

1 FINAL REPORT Evaluation of the Commonwealth secretariat s strategic plan (2013/14 2016/17) An independent Evaluation carried out by the Centre for International Development and Training (CIDT) at the University of Wolverhampton, United Kingdom 27 January 2017 iii Contents Acknowledgements .. iv Acronyms and Abbreviations .. v Executive summary .. ix Overview .. ix Main findings .. ix Lessons .. xv Recommendations .. xvi 1. Introduction .. 1 Background .. 1 Purpose of this Evaluation .. 1 2. Methodology .. 3 Summary of methods used .. 3 Limitations .. 4 3.

2 Findings: Relevance .. 6 strategic plan development .. 6 strategic plan design .. 9 Alignment to broader initiatives .. 16 Organisational reform and restructuring .. 19 4. Findings: Effectiveness and efficiency .. 25 Results-based management (RBM) system .. 25 Gender mainstreaming efforts .. 38 Operations in support of SP delivery .. 42 Partnerships and collaboration .. 50 5. Findings: Results and benefits to member countries .. 56 Satisfaction levels and perceived comparative advantages .. 56 Results of strategic plan implementation .. 58 6. Findings: Sustainability .. 70 Examples of sustainable work and opportunities for sustainability.

3 70 Models and enabling factors of sustainability .. 73 Risks/threats to sustainability .. 74 Recommendations for sustainability .. 76 7. Key lessons 78 8. Recommendations .. 81 9. Conclusion .. 86 Annex A Details of methodology .. 87 Annex B List of Respondents .. 90 Annex C List of documents provided to support the Evaluation .. 104 Annex D Field visit summaries .. 111 Annex E Analysis of internal 120 iv Acknowledgements We would like to thank the many people who have actively guided and supported this Evaluation . First, we acknowledge the strategic Planning and Evaluation Division (SPED) at the Commonwealth secretariat particularly, Nabeel Goheer (Director), Evelyn Ogwal Pederson (Adviser/Head of Evaluation ), Norma MacIsaac (Adviser/Head of Planning) and Katherine Marshall Kissoon (RBM Officer) and Emily Rhoades (Team Administrator).

4 Their clear guidance, proactive communications, and timely support enabled the smooth implementation of the Evaluation . We extend special thanks to Ms Rhoades, as well as Ms Pedersen, for always making themselves available to answer questions and share requested documents, as well as for providing superb support in the scheduling and logistics of the staff interviews and Field Missions. Second, we would like to thank all the internal and external stakeholders, who willingly and openly shared their opinions and experiences with us as respondents in the survey. This includes: a wide range of Commonwealth secretariat staff at the London Headquarters office; long-term experts, consultants and former staff; partners and beneficiaries within member countries; representatives of Commonwealth organisations; and development partners, such as the European Commission and High Commissions at the country level.

5 Finally, we appreciate and recognise the efforts of past evaluators and the individuals involved in preparing the various reports and other resources that were consulted as part of the Document Review. These served as an important source of information, to complement the primary data collection that was conducted for this Evaluation . Ella Haruna (Team Leader) and Kimberly Kane (Principle Evaluator), CIDT v Acronyms and Abbreviations ARR Annual Results Reports ARTEMIS Activity Results Tracking and Expenditure Management System BRICS Major emerging national economies: Brazil, Russia, India, China.

6 South Africa BTOR Back-to-Office Report CARICOM Caribbean Community CCASS Computerised Case Administration System CCP Commonwealth Connects Programme CFTC Commonwealth Fund for Technical Co-operation CFNHRI Commonwealth Forum of National Human Rights Institutions CHOGM Commonwealth Heads of Government Meeting CIDT Centre for International Development and Training CMAG Commonwealth Ministerial Action Group CMDF Commonwealth Media Development Fund COG Commonwealth Observer Group COMM Communications Division COMESA Common Market for Eastern and Southern Africa CSD Corporate Services Division CS-DRMS Commonwealth secretariat s Debt Recording and Management System CYP Commonwealth Youth Programme (fund) DFAT Australian Department of Foreign Affairs and Trade DFID UK Department for International Development DMU Debt Management Unit (of Seychelles) DSG Deputy Secretary-General EC European Commission EPD Economic Policy Division EPG Eminent Persons Group EU European Union FCO Foreign and Commonwealth Office FMIS Finance and Management Information Section FGD focus group discussion G20 Group of Twenty (international forum)

7 GDP gross domestic product vi HEU Health and Education Unit HQ Headquarters HR human resources HRD Human Resources Division HRC Human Rights Commission HRU Human Rights Unit ICT information and communication technology IMF International Monetary Fund IO Intermediate Outcome IT information technology KPI key performance indicator LTE long-term expert MAR Multilateral Aid Review MDG Millennium Development Goal MDR Multilateral Development Review M&E monitoring and Evaluation ME&R monitoring, Evaluation and reporting MTR Mid-Term Review NHRI National Human Rights Institution NGO non-governmental organisation NZ New Zealand OCTA Office of the Chief Trade Adviser (Vanuatu)

8 OIF Organisation Internationale de la Francophonie ONR Oceans and Natural Resources Division OSG Office of the Secretary-General PACER-Plus Pacific Agreement on Closer Economic Relations PDD Project Design Document PMIS Programme Management Information System PCP Primary Contact Point POL Political Affairs Division PMRU Project Management and Referral Unit PRS Performance Rating System PSGU Public Sector Governance Unit RBM results-based management ROL Rule of Law Division vii secretariat Commonwealth secretariat SADC South African Development Community SDGs Sustainable Development Goals SIDS small island developing states SMART specific, measurable, achievable, relevant (or realistic), time-bound (results or indicators)

9 SMG Senior Management Group SO strategic Outcome SP strategic plan SPED strategic Planning and Evaluation Division SRF strategic Results Framework SSI semi-structured interviews SWOT strengths-weaknesses-opportunities-threa ts analysis TAU Technical Assistance Unit ToR Terms of Reference UK United Kingdom UN United Nations UNDP United Nations Development Programme UVP unique value proposition WTO World Trade Organization YTH Youth Division viii ix Executive summary Overview 1. The Commonwealth secretariat commissioned the Centre for International Development and Training (CIDT) of the University of Wolverhampton to evaluate the secretariat s strategic plan (SP) for 2013/14 to 2016/17.

10 This independent Evaluation assessed internal processes used to develop the SP and align the organisational structure, the effectiveness of operational tools and systems in facilitating SP delivery, relevance of the SP to Commonwealth member countries needs, and benefits and results of the secretariat s key projects during the four-year SP implementation period. 2. Evaluation methodology included: extensive document review; interviews with staff and member country stakeholders; field visits to Seychelles (Africa) and Vanuatu (Pacific); and an in-depth review of a representative sample of eight (8) projects.