ROADS for DEVELOPMENT ROADS FOR …

1 R4D ROADS for DEVELOPMENT VANUATU ROADS FOR DEVELOPMENT PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 Disclaimer This publication has been funded by the Australian Government through the Department of Foreign Affairs and Trade. The views expressed in this publication are the author s alone and are not necessarily the views of the Australian Government. R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D ii Contents EXECUTIVE SUMMARY 1. INTRODUCTION Independent Evaluation Purpose Key Evaluation Questions Independent Evaluation Approach and Methodology Acknowledgments Vanuatu Context ROADS for DEVELOPMENT Program Context Limitations Encountered Report outline 2.

2 VANUATU TRANSPORT SECTOR CONTEXT Overview road Sector Sector Context - Donors Sector Context MIPU Sector Context MIPU Budgets Rural ROADS Access Framework Definitions of road Works The Annual Rural road Access Plans road Condition Maintenance Budget and Core Network 3. ROLE AND EFFECTIVENESS OF AUSTRALIAN AID (Research Area A) Introduction Question A1 Question A2 Question A3 Question A4 4. R4D SUCCESS ACHIEVING END-OF-PROGRAM OUTCOME (Research Area B) Introduction Question B1 Question B2 Question B3 5. R4D SUCCESSES ACHIEVING OUTPUTS (Research Area C) Introduction Question C1 Question C2 Question C3 Question C4 Question C5 R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D iii Question C6 Question C7 6.

3 REMAINING NEEDS AND OPPORTUNITIES (Research Area D) Introduction Question D1 Question D2 Question D3 7. SCOPE (Research Area E) Introduction Question E1 Question E2 8. TECHNICAL APPROACHES (Research Area F) Introduction Question F1 Question F2 Question F3 Question F4 9. IMPLEMENTATION ARRANGEMENTS (Research Area G) Introduction Question G1 Question G2 Question G3 Question G4 Question G5 10. CROSSCUTTING ISSUES AND SOCIAL SAFEGUARDS (Research Area H) Introduction Question H1 Question H2 Question H3 11. ENVIRONMENTAL MANAGEMENT (Research Area I) Introduction Question I1 Question I2 12.

4 CONCLUSIONS SUCCESS FACTORS and CHANGES TO MAKE IN DESIGNING A POSSIBLE NEXT ROUND OF ROADS SUBSECTOR SUPPORT Key decisions the independent evaluation is intended to inform Whether to support Vanuatu s rural road sector after R4D finishes on June 30, 2017 Success factors to carry through in designing a next round of rural ROADS subsector support R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D iv Changes to make in designing a possible next round of rural ROADS subsector support Tables Table 1 Vanuatu road Network 2016 Table 2 Current Donor Funded Infrastructure Projects Table 3 Time series data of GoV funding to road Maintenance, Marine and Aviation transport modes 2013-2016 Table 4 RAI.

5 Rural Population and Rural road Length by Province Table 5 road Condition Definitions Table 6 R4D Monitoring and Evaluation Plan January 2016 June 2017 PFM Indicators Table 8 Improvement Works (Island Based Contract) Table 9 Routine and Periodic Maintenance Contracts and Outputs Table 10 Network manager tasks, current status and remaining activities Table 11 Force Account and Outsourcing Table 12 road Maintenance and Improvement Works Table 13 Physical Works Outputs Table 14 PWD Staff Current Level of Competence in Key Technical Skills Table 15 CBC Models 2016 Table 16 Participation by Gender (Worker Day Summary): March 2014 September 2016 Boxes Box 1: Key Evaluation Questions Box 2: MIPU Mission Statement and Objectives 2014 Annexes 1.

6 Independent Evaluation Terms of Reference (29 August 2016) 2. Key Evaluation Questions (From Evaluation Plan 3 November 2016) 3. Documents Reviewed 4. Persons Met 5. Field Visit Report 6. VTSSP/ R4D: Comparing Goal, Outcomes, Outputs (2012-2016) 7 Actual expenditure on road Maintenance by Province over the period of R4D 8. Crosscutting issues, social and environmental safeguards: standards, guides and handbooks R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D v Acronyms and Abbreviations Acronym Full Name AAP Australian Aid Program ADB Asian DEVELOPMENT Bank AHC Australian High Commission (Port Vila) AIP Aid Investment Plan ANAO Australian National Audit Office APPR Aid Program Performance Report AWP Annual Works Plan CBC Community Based Contractors CBP Capacity Building Program CPO Community Partnership Officers CTB Central Tender Board DFA Direct Funding Agreement (between GoA and GoV) DFAT (Australian)

7 Department of Foreign Affairs and Trade DG Director General DM Divisional Manager (PWD) EHC Equipment Hire Contracts EOPO End of Program Outcomes FA Force Account FIDIC F d ration Internationale des Ing nieurs Conseils (International Federation of Consulting Engineers) FSB Financial Services Bureaux FY Financial Year GDP Gross Domestic Product GfG Governance for Growth GoA Government of Australia GoV Government of Vanuatu HIV/AIDS Human Immuno Deficiency Virus/ Acquired Immuno Deficiency Syndrome HR Human Resources HRD Human Resource DEVELOPMENT HO Head Office (of PWD)

8 HSES Household Socio Economic Survey R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D vi Acronym Full Name IBC Island Based Contractors ICB International Competitive Bidding ICT Information and Communications Technology ID Institutional DEVELOPMENT IDA International DEVELOPMENT Association IE Independent Evaluation IFI International Financial Institution IR Interim Review ISP Implementation Service Provider JICA Japan International Cooperation Agency km kilometre(s) LBES Labour based equipment supported LPO Local Purchase Order M&E Monitoring and Evaluation MFEM Ministry of Finance and Economic Management MIS Management Information System MIPU Ministry for Infrastructure and Public Utilities MP Member of Parliament NBC Nationally Based Contractors NCB National Competitive Bidding NGO Non-Government Organisation PACTAM Pacific Technical Assistance Mechanism PER Public Expenditure Review PDD Program Design Document PFM Public Financial Management PFMS Public Financial Management Specialist PSA Performance Situational

9 Analysis PSC Public Service Commission PWD Public Works Department PVUDP Port Vila Urban DEVELOPMENT Project R4D ROADS for DEVELOPMENT (Program) RAI Rural Access Index RFQ Request for Quote R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D vii Acronym Full Name RFT Request for Tender RIMS road Information Management System RRAF Rural ROADS Access Framework RRAP Rural ROADS Access Policy RRAS Rural ROADS Access Strategy RME road Maintenance Engineer (of ISP) RPT road Prioritisation Tool SoS Scope of Services (of the ISP) SRME Senior road Maintenance Engineer SSF Social Safeguards Framework (of MIPU)

10 TA Technical Assistance TBET Tractor Based Equipment Trial TC Pam Tropical Cyclone Pam TL Team Leader ToR Terms of Reference VAIP Vanuatu Aviation Investment Project VBN Vanuatu Broadband Network VIRIP Vanuatu Infrastructure Reconstruction and Improvement Project VTSSP Vanuatu Transport Sector Support Program VT Vanuatu Vatu WB World Bank WHS Work Health and Safety R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D viii R4D PROGRAM INDEPENDENT EVALUATION Final Report 12 April 2017 R4D ix EXECUTIVE SUMMARY Independent Evaluation 1.