Final Evaluation Consultant DC-KEN21.01 at Sign of Hope (SoH)

Purpose, Objectives and Use

• The purpose of the evaluation is to provide SoH and MID-P with a comprehensive assessment of the project, conducted systematically and impartially, as well as analyse the implementation and results of the project, propose actions to ensure sustainability of the results, identify lessons learned and information for potential future projects. The study will provide concrete, credible and practical recommendations that will assist with the timely incorporation of the findings into the decision-making process and contribute to the organisational learning of both implementing organisations.
• The study will support the project quality assurance measures implemented by SoH and meet the donor requirements towards the development projects implemented by German private organisations.

The evaluation will address evaluation questions based on the standard OECD/DAC evaluation criteria of relevance, coherence, effectiveness, efficiency, sustainability, and impact (please see https://www.oecd.org/dac/evaluation/revised-evaluation-criteria-dec-2019.pdf).  The objectives of the evaluations are to:

• Assess the extent to which the project has sustainably achieved its objectives and results (see annexe 1), including the extent to which the lives of the project beneficiaries have been improved,
• Identify the strengths and weaknesses in terms of planning, management, implementation and monitoring of the project,
• Evaluate sustainability measures,
• Identify cross-cutting issues addressed through the project, including gender equality, human rights, marginalised groups, inclusion, and other issues,
• Determine the effects of Covid-19 on the project, its activities and implementing organisation,
• Document lessons learned that could contribute to the improvement of the design of future projects.
• Determine effectiveness of the implementation approaches used by the project team considering innovations to ensure smooth running of the project during unforeseen circumstance
• Determine sustainability measures put in place or planned by the project team to enable continuity of key project interventions on exit of project teams.

Duties and Responsibilities

The Evaluation Consultant will work in close cooperation with the responsible SoH Officer and the local implementing partner.

The duties and responsibilities of the Evaluation Consultant will include:

• Develop a work plan outlining the proposed research methodology, geographical coverage and schedule to conduct the study,
• Conduct a desk review of relevant documents,
• Carry out a project site visit to a project location to conduct research, collect data and establish contact with the local implementing partner, project beneficiaries and relevant project stakeholders,
• Review and evaluate available data and existing sources of information, including the project proposal, annual reports, conducted studies and other documents,
• Examine institutional, technical, staffing and financial capacities of the implementing partner as well as its relationship with the target group and other relevant stakeholders.

Expected Deliverables

The study will produce the following deliverables:

• an inception report, including the proposed research methodology and data collection tools, a table of content and timeline of research activities prior to the site visit to the project location,
• a comprehensive report of a maximum of 30 pages with practical recommendations and relevant annexes (including raw data and documented records).

A template will be provided to serve as a guide and may be used to structure the final report.

Study Quality and Ethical Standards

The study team will take all reasonable steps to ensure that the study is designed and conducted to respect and protect the rights and welfare of the people and communities involved. Furthermore, the study should be aligned to the following standards and applicable practices:

• Utility: the study must be useful and used.
• Feasibility: the study must be realistic, diplomatic and managed in a sensible, cost-effective manner.
• Ethics and Legality: the study must be conducted in an ethical and legal manner, with particular regard for the welfare of those involved in and affected by the Study.
• Impartiality and Independence: the study should be impartial, providing a comprehensive and unbiased assessment that takes into account the views of all stakeholders.
• Transparency: the study activities should reflect an attitude of openness and transparency.
• Accuracy: the study should be technically accurate and credible, providing sufficient information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.
• Participation: the Stakeholders should be consulted and meaningfully involved in the study process when feasible and appropriate.
• Collaboration: Collaboration between key operating partners in the study process improves the legitimacy and utility of the study.

The study must be in line with the SoH guiding principles and Code of Conduct.

Process/Timeframe

• The total duration of the assignment is up to 25 working days within the period from 15th January 2024 to 16th February 2024.
• Planning meeting with MIDP, handover of relevant documents 1 day
• Initial document review and inception report preparation 4 days
• Sharing inception report with SoH and MIDP 1 day
• Finalisation of inception report 1 day
• Data collection site visit to a project location 5-10 days
• Data analysis, draft report with annexes 5-10 days
• Incorporating received feedback and report finalisation 3-5 days

Qualifications and Experience

Essential:

• Minimum of 5 years of project evaluation and/or implementation experience in the result-based management framework
• Proven experience of conducting feasibility studies, evaluations and other research projects
• Technical and methodological knowledge to conduct research projects and formulate conclusions based on a solid methodology, assessing projects for relevance, coherence, effectiveness, efficiency, impact and sustainability of projects
• Experience working with non-governmental organisations (NGOs) and partnered projects
• Fluency in written and spoken English

Desirable:

• Experience in the relevant field/sector
• Professional familiarity with the project country/region
• Practical experience of working for and/or evaluating BMZ-funded projects
• Fluency in written and spoken Borana

Academic Background

• An advanced level university degree (Masters’ degree or equivalent) in social sciences, public administration, international development studies, law and/or monitoring and evaluation. A first-level university degree in combination with additional years of qualifying experience may be accepted.
• The Evaluation Consultant is to be independent and impartial with no liabilities to any other organization or government entity regarding this evaluation.