TOR for an External Evaluation of EA31/2016

TOR for an External Evaluation of EA31/2016

These Terms of Reference should be adapted to the context. These can also be used as a resource to guide internal reviews.   

TITLE

Catholic Caritas Foundation of Nigeria EA 31/2016/Nigeria/Lake Chad Basin Crisis Final External Evaluation

BACKGROUND

This section should include a brief description of:

-the history of the programme, including its objectives, main activities, budgetary information, duration;

The Emergency Appeal Programme as launched by Caritas Internalis (EA31/2016) was borne out of the huge humanitarian crisis in the Lake Chad Basin of Nigeria, occassioned the massive scale of hostilities orchestrated by some terrorist groups in the North-East of Nigeria, popularly known as Boko Haram. UN OCHA in 2015/2016 reported 2.2 million persons as being displaced by this crisis, with a slight improvement to about 1.7 million persons are still internally displaced as at 2017, there are still large scale displacements in Borno and Admawa States with reports of forced returns of some IDPs to areas that are still not very safe and secure. There have been continuous reports of massive violations of human rights on a daily basis. The food security situation has been extremely concerning, as conflict continues to limit the amount of land under cultivation and 3.7 million persons are expected to face critical levels of food insecurity during the upcoming lean season (June through September 2018).

 

Project Objective: Improved access to Nutrition, Livelihoods, WASH, and Health of 9,000 vulnerable IDPs, returnees and host community members in Hawul and Askira Uba local government areas of Borno State, in North Eastern Nigeria.

 

– The relationship between the programme and past/future interventions;

-The main stakeholders of the programme (e.g. CI MOs; Diocesan Caritas, local Church, local government, the UN, peer agencies etc.); the partnerships and frameworks of collaboration;

The Project is run with support from CI-MOs. Caritas Nigeria is the coordinating body with direct interface with Caritas Internationalis, while JDPC Maiduguri is the direct implementing body. The project is implemented using a vast array of Community mobilizers, Volunteers, Field officers and Extension Agents, who work to ensure overall project success.

-The rationale for the evaluation.

Amongst many reasons, the rationale for the proposed Evaluation includes the following:

  • The reason activities have or have not been implemented as planned or were adapted?
  • Did the intervention have an impact? Why or why not? How and for whom did it have an impact?
  • To what extent can the measured or observed changes be attributed to the intervention?
  • Did the intervention have any unintended consequences?
  • Is the intervention cost effective? Can the cost be compared with alternatives to investment, in other words, could the results have been reached with less input?

 

If the intervention was successful, can it be replicated to other settings and if so, in which settings?  Can it be adapted, replicated or built on to increase its reach or scope (for a larger population or a different region)?

 

OBJECTIVES

The final evaluation will focus on the following key objectives:

  • Assess the relevance, appropriateness, effectiveness, accountability and impact/sustainability of the programme;
  • Assess the effectiveness of the leadership of Caritas Nigeria in coordinating the dioceses and CI MOs within the EA31 2016
  • Identify lessons learned, best practices and recommendations to inform future programme design.

KEY QUESTIONS

Relevance/appropriateness

  • Was programme design based on an impartial assessment of needs? Are needs assessments disaggregated by age, sex and disability? Do they include people’s needs, vulnerabilities and capacities?
  • Did the assistance provided by Caritas Nigeria meet the needs of the affected population? Were the persons most in need identified, selected, and supported by the programme?
  • Which parts of the assistance were the most appropriate and why? Which were least appropriate and why? Were activities aligned with the affected population’s needs and priorities?
  • Were recommendations and learning from past reviews and evaluations applied to the response?

Effectiveness

  • Was the response timely?
  • What internal and external factors affected the speed of the response?
  • Was the internal organizational and managerial structure of the project effective?
  • Were there appropriate systems in place to monitor activities, outputs and outcomes of the programme? Did monitoring outcomes inform programme adjustments/revisions?
  • Did the project activities lead towards the achievement of the expected results/indicators as set in the Results Framework?

Accountability

  • To what extent has the affected population been involved in the design or implementation of the programme?
  • Were appropriate systems of downwards accountability (participation, information sharing and feedback/complaints), put in place and used by project participants? Were project participants aware of the feedback/complaints mechanism?
  • Were project participants and communities aware of selection criteria?
  • Were project participants and communities aware of the assistance they should receive?

Coordination

  • How effective was Caritas Nigeria in coordinating internally?
  • How effective was Caritas Nigeria in coordinating the dioceses and CI MOs?
  • How effective was Caritas Nigeria in coordinating with external stakeholders such as other agencies, organisations, the local and national government?
  • What aspects of coordination could be improved in the future and how?

Impact/Sustainability

  • Has Caritas Nigeria’s response strengthened local capacities?
  • What are the intended and unintended, positive and negative effects of the project?
  • What, if any, aspects of the programme will have a longer-term impact?

METHODOLOGY

Example:

The final evaluation will rely on two main evaluation stages (1) design phase (2) field phase

Design phase

  • The evaluator(s) will undertake a desk review of programme documentation including planning documents, project proposals, situation reports and quarterly reports;
  • The evaluator(s) will also review other relevant documentation such as minutes of decision-making meetings, 3W mappings of Caritas Nigeria’s response, consolidated situation reports of Caritas Nigeria’s response (if applicable);
  • The evaluator(s) will review other monitoring and reporting documents from secondary sources (i.e UNHCR reports).
  • If appropriate, the evaluator(s) will obtain feedback from the CI HD on the most relevant sites to visit.

Field phase

  • After the design phase, the evaluator(s) will conduct fieldwork to collect and analyse data in order to answer the evaluation questions;
  • Data collection methods should be inclusive and utilise a range of methods, including focus group discussions and key informant interviews and with key project stakeholders. The use of surveys and other remote data collection tools should also be explored by the evaluators to maximise data collection;
  • The evaluator(s) should ensure a systematic triangulation of data sources and data collection methods and tools, and seek to validate data through regular exchanges with programme staff where appropriate.
  1. EXPECTED OUTPUTS

The evaluator(s) should produce the following key deliverables:

  • Draft Evaluation Report to be submitted to Caritas Nigeria/ CI support mechanism (if applicable) and the CI Humanitarian Department
  • Final Evaluation Report inclusive of:

 

  • Executive Summary
  • Background
  • Introduction
  • Context
  • Description of Methodology
  • Main findings
  • Conclusions inclusive of best practices and lessons learned

USE OF THE EVALUATION RESULTS

The intended audience for the evaluation are Caritas Nigeria key staff, including senior management, CI MOs who have supported the programme, the Caritas Internationalis Humanitarian Department and the Caritas Confederation. Evaluation findings will be shared with programme participants as appropriate.

REQUIRED COMPETENCIES

The competencies required from the External Evaluator are:

  • Advanced degree in social sciences, political sciences, economics, development or related fields;
  • Experience in leading evaluations, especially in the field of humanitarian response;
  • Ability to use participatory approaches to evaluation;
  • Experience of operational management of humanitarian/development programmes;
  • Good knowledge of the local context;
  • Good analytical skills;
  • Excellent writing skills in a CI Confederation language (EN/FR/ES);
  • Any other appropriate language skills;
  • Understanding of the Catholic Church and Caritas structure and mission.

CONSULTANT’S PROPOSAL 

Proposals should include:

  • Proposed evaluation methodology (if different from above);
  • Description of deliverables and a timeline;
  • A financial proposal including the cost implication for other evaluators if any;
  • CV(s) of evaluator(s).

TIME FRAME

Add as many lines as needed to prepare Time Frame plan

Evaluation phase Activities Dates # of Days
Preparatory Initial Rapid Assessments 11-06-2018 1
2. Stakeholder Consultations 11-06-2018 1
Design Proposal Design 12-06-2018 1
2. Set-up of project control mechanisms 12-06-2018 1
3. Selection of priority sectors and locations 12-06-2018 1
Field phase Project Start-up Sensitization 13-06-2018 1
2. Formation and engagement of Community Implementation  committee. 13-06-2018 1
3. Project implementation 13-06-2018 1
4. Monitoring and Evaluation 13-06-2018 1
5. Coordination meetings 13-06-2018 1
Reporting 1st interim report 14-06-2018 1
2. 2nd interim report 14-06-2018 1
3. 3rd interim report 14-06-2018 1
4. Consolidated Situation Reports 14-06-2018 1
5. Final report 15-06-2018 1
Total 5 days

 

 

 

 

END OF PROJECT EVALUATION – TERMS OF REFERENCE

  1. Summary

Caritas Nigeria seeks the services of a Consultant/Evaluator to perform an end of project evaluation of the CRS Nigeria – funded Institutional Capacity Program (ICS). The evaluation shall be carried out in the period in August 2018.

 

  1. Organizational Background

Caritas Nigeria was established in September 2010, by the Catholic Bishops Conference of Nigeria (CBCN), as the specialized national relief and human development agency with the mandate for overall coordination of development and humanitarian programs on behalf of the Catholic Church in Nigeria. The legal name of the organization is Catholic Caritas Foundation of Nigeria (CCFN), it is known as Caritas Nigeria.  

 

The Catholic Church in Nigeria has a total of 55 dioceses grouped into nine provinces which cover the entire geographical spread of Nigeria. Caritas Nigeria serves as the umbrella organization supporting these regional institutions to implement development-oriented programs based on local needs. As part of the universal mission, Caritas Nigeria targets beneficiaries by rights and need, and not based on creed, race or nationality.

5Mg Online South Africa maximum erectile dysfunction treatment in South Africa Cost Of Cialis In Nigeria

 

Project Background

The Institutional Capacity Strengthening Initiative (ICS) is a five-year project aimed at strengthening the institutional capacity of Catholic Church development structures (specifically JDPC units) for better quality and improved coordination of programs.

This project will further empower the Caritas Nigeria lead Church Dioceses and Provinces in a participatory organizational self-assessment and action planning process through the Holistic Organizational Capacity Assessment Initiative (HOCAI) mechanism. This initiative will be conducted Province by Province over a five years period.

This plan is a core component of Caritas Nigeria’s national mandate as outlined by the Catholic Bishop Conference of Nigeria (CBCN). This mandate provides for Caritas Nigeria to strengthen the institutional capacity of Catholic Church development structures and coordinate programs and interventions.

The first year of the program implementation began in Benin Province, followed by Abuja Province in 2015. 2016 saw the program being implemented in Calabar and Owerri provinces, while Jos and Kaduna Provinces benefitted from the program in 2017. Currently now its fifth and final year, the program will be implemented in Lagos and Ibadan provinces.

To achieve the strategic objective of the program, the following activities are conducted:

  • Baseline Assessment
  • Capacity Building Workshops
  • Resource Mobilization Workshop
  • Disbursement of Small Grant to JDPCs
  • Technical Assistance to Partners
  • Coordination Meetings
  • Monitoring Visit
  • Endline Assessment

 

III. The audience for the Review

The primary audiences for the evaluation are Caritas Nigeria and Catholic Relief Services (CRS). The review will also benefit other stakeholders, including the beneficiaries of the work of Caritas Nigeria (JDPCs).

The results of this evaluation are primarily intended for internal use by Caritas Nigeria to inform future improvements and learning. Results and findings will also be shared with the funder, Catholic Relief Services for accountability purposes.

 

  1. Objectives of the Evaluation

The objectives of this evaluation are to:

  1. Undertake an evaluation to assess the projects:
  2. a) Relevance – the extent to which the objectives were consistent with beneficiaries’ needs and priorities
  3. b) Effectiveness – the extent to which the targeted project objectives were achieved (or are expected to be achieved)
  4. c) Sustainability – the extent to which the benefits are likely to continue after the project e
  5. d) Impact – where possible, the long-term effects produced by the project (directly, indirectly, intended, unintended, positive and negative).

The evaluation should assess the above in relation to two central broad questions:

  1. What changes/ outcomes/achievements have taken place?
  2. How have these changes/ outcomes/achievements been brought about?

 

  1. Methodology

The evaluation should consist of:

(a) Review of project documentation: Review of archived material related to the project. This could include, but is not restricted to: annual and quarterly reports, communications between Caritas Nigeria and Catholic Relief Services, the original project proposal document, the basic ‘logic chain’, all relevant project records and data, training materials etc. this information will be provided to the evaluator by Caritas Nigeria. The evaluator would also be expected to review any other relevant statistics and secondary sources.

(b) Development of an evaluation approach and data collection tools / methods: this should include;

  • Detailed time line and work plan
  • Outline of any proposed changes to the scope of the evaluation
  • Key learning questions
  • Proposed sampling framework
  • Development of associated data collection and evaluation tools

(c) Participate in an inception briefing with Caritas Nigeria: This should take place immediately prior to the development of the inception report

(d) Field visits: Field visits will take place in 5 Catholic Dioceses, and should include an agreed sample of participants and stakeholders. This is expected to require between 2 weeks, depending on the exact methodology.

(e) Submit a draft evaluation report that corresponds to the requirements outlined below in the ‘Deliverables’ section.

(f) Submit a final evaluation report: incorporating any relevant feedback from Caritas Nigeria.

 

  1. Deliverables

Deliverables should include the following:

  • An evaluation work plan, including planned timeline, methodology/approach, data collection and analysis tools, qualitative and quantitative protocols for data collection and analysis
  • Any suggested improvements to existing evaluation scope, as outlined in this document
  • Presentation of preliminary findings
  • One (1) electronic file of the clean (final) qualitative and quantitative data collected
  • Final evaluation report

Reporting

The consultant will report to the Caritas Nigeria ICS Program Manager for all issues related to logistics and fieldwork.

Duration & Deadlines

The duration of the contract will be a total of one month, starting from the first of August 2018 to the end of August 2018.

 

VII. Evaluator’s Competencies

Evaluator competencies

  • Sound understanding of Capacity building; Sound knowledge on program development;
  • Knowledge of evaluation activities;
  • Strong research skills;
  • Both quantitative and qualitative data collection and analysis skills;
  • Academic degree in social sciences and other related fields;
  • Demonstrated technical skills in project evaluations;
  • Ability to produce well written, analytical reports in English
  • Prior experiences of evaluating programs will be an added advantage
DONATE NOW