Endline Survey Consultant at HIAS Refugee Trust of Kenya

PURPOSE OF THE CONSULTANCY

• The overall objective of this endline evaluation is to understand how and to what extent project activities achieved the stated outcomes, including contribution of the project to achieving overall protection and inclusion for vulnerable refugees, including LGBTIQI+ persons and the host community in Nairobi. The project will be evaluated against the OECD-DAC criteria of effectiveness, relevance, efficiency, coherence, sustainability, and impact.

Specific Objectives

• To establish endline information against the project’s indicators, and to make a comparison against the baseline information to determine the project impact.
• Assess the outcomes of the project activities under each project objective, including both intended and unintended outcomes.
• Assess and identify critical internal and external factors (including political disruptions) that have contributed to, affected, or impeded project achievements, including how HIAS has managed these factors.
• Identify and articulate lessons learned and good practices to inform future program design for similar projects in this context.
• Provide concrete and actionable recommendations to inform future programming.

The key evaluation questions to be addressed include:

Relevance: -

• To what extent did the project contribute towards the strengthening of community-based structures including the capacity of CBOs to advocate for refugee and LGBTQI+ rights?
• How did the enhanced structures contribute to protection and inclusion of vulnerable refugees including LGBTQI?
• Did the project activities respond to the protection and inclusion needs and priorities of vulnerable refugees including LGBTQI+ and host communities in Nairobi? If so how,
• How were stakeholders involved in the project?

Effectiveness-

• To what extent has the project achieved its objectives and set targets as outlined in the project proposal? To what extent were the planned activities/ objectives achieved?
• What were the major factors influencing achievement or non-achievement of the objectives?
• Did the project contribute to increased levels of knowledge and awareness on GBV and referral mechanisms among the targeted CBOs, refugee, and host communities in Nairobi?
• How effective were the livelihood support and vocational skills development strategies/interventions in contributing to socio-economic well-being of the target beneficiaries

Efficiency

• The extent to which the intervention delivered results in an economic and timely way.

Impact

• To what extent has the project enhanced protection of the target population?
• What are the intended and unintended, positive and negative outcomes/changes as a result of the project?
• Were there changes similar/equal for the different target groups/vulnerable groups? What were the factors for either case.
• What are the changes in the beneficiary community that can be linked to HIAS interventions?

Sustainability

• The extent to which the net benefits of the intervention are likely to be sustained after the project ends.
• Identify the various challenges that may affect the sustainability of the project and suggest solutions?

Coherence

• The compatibility of the intervention with other interventions in Kenya. What lessons can be learned?

SCOPE OF THE ENDLINE STUDY

• The geographical scope of the study will be within Nairobi County; Kayole, Kawangware, and Eastleigh, and surrounding areas. The design and implementation of the endline survey will ensure ethical considerations are put in place, e.g., principles of gender equality, inclusion and non-discrimination are considered and acted upon throughout, and that the meaningful participation of the most vulnerable groups and other key stakeholders is promoted in the design and implementation of the endline.

METHODOLOGY OF THE STUDY

The endline study methodologies will include:

• Secondary documentation: Desk review of project documents, and other studies such as market surveys.
• Quantitative approaches to collecting data, including survey data collection as required to provide information on the status of selected indicators.
• Qualitative approaches, such as focus group discussions, and key informant interviews, observation as needed.
• The endline data collection is to be consistent with SPHERE standards through its emphasis on a rights-based and participatory approach in conducting monitoring and evaluation; the endline survey will be organized in a participatory way, including HIAS staff, refugee community leaders, and project beneficiaries.

EXPECTED OUTPUTS AND DELIVERABLES

The expected key outputs and deliverables are:

• Inception Report: This report will present the detailed methodology, literature review, data collection tools/instruments, and a data analysis plan. The inception report will be discussed with the HIAS endline study team for any input.
• Draft report for stakeholder review—clearly identifying information relevant to the four objectives of the project framework; as well as data gaps and areas that may require further assessment.
• Raw and cleaned final dataset(s) containing all data collected for the endline, including survey responses and KII/FGD transcriptions.
• Final Report (incorporating inputs from the review): The main body of the report should be a maximum of 40 pages in length, excluding the Table of Content, tables, and annexes).
• The findings will be presented in a validation meeting with key HIAS staff and stakeholders.

MANAGEMENT OF THE EVALUATION

HIAS MEAL team will be responsible for the overall coordination of all the evaluation tasks with the consultant to ensure timely and quality outputs. In addition, the Program Managers, Program Director, Regional technical advisors, and Country Director will provide all the necessary technical and operational support required throughout the evaluation process.

HIAS will provide:

• Relevant documentation and background information.
• Contacts of relevant stakeholders and set up meetings.
• Consolidated feedback/guidance on draft reports.

TIMELINES:

• The exercise is expected to begin on 15th of August 2023 and run for a period of 21 days.

QUALIFICATIONS AND REQUIREMENTS

HIAS is looking for a consultant/team with the following skills and qualifications.

• The team leader should possess a postgraduate degree in research-oriented social science or a related discipline with at least 5 years of experience in Monitoring and Evaluation, preferably in humanitarian settings.
• Demonstrable expertise and a good understanding of refugee operations especially in Kenya, refugee protection risks, and relevant international /regional refugee frameworks
• Experience in qualitative & quantitative research methods including participatory approaches data analysis and reporting with a focus on social research and evaluation, preferably in the region.
• Experience in designing and managing endline surveys, delivering agreed outputs on time and on budget.
• Excellent and demonstrated understanding of ethical issues in research.
• Experience in developing data collection tools using KOBO
• Excellent verbal and written communication in English is required.