Terms of Reference End-term Evaluation of PRM Project at Danish Refugee Council

PURPOSE
The purpose of the consultancy is to assess the extent to which the objectives of the ‘Strengthening Protection and Self-Reliance Mechanisms for Refugees in Kenya’ project were met. The findings are expected to highlight lessons, best practices and recommendations that can inform ongoing and future programming by DRC in Kenya and similar contexts.

The specific objectives of the evaluation are to 1) assess relevance, efficiency, effectiveness, impact and sustainability of the project, and 2) generate lessons learned to inform sustainable closure of the projects and the next phase of project design and implementation.

The evaluation should respond to the following key questions:
Relevance/appropriateness:

• To what extent did the interventions implemented meet the expectations of the people concerned (men, women, youth and adolescents)?

Efficiency:

• Was the response timely and cost effective? Did the implementation process take into account value for money considerations? What specific components / strategies demonstrate value for money?

Effectiveness:

• Did the project achieve what it set out to achieve (output/outcome indicator targets set in logframe)?

• To what extent did the response reduce future vulnerabilities of target groups through specific protection and livelihoods interventions?

Impact:

• What were the intended and unintended, positive and negative, lasting and transitory outcomes of the interventions?
• What are key contributing factors affecting the achievement or non-achievement of the intended outcomes?

Sustainability:

• Which aspects/components of the interventions implemented have potential for impact and sustainability beyond the project period?
• Are skills gained being used/likely to continue being used after the project closure?

Accountability to affected populations:

• To what extent did the project adhere to DRC accountability framework, specifically in information sharing, participation of beneficiaries throughout the project cycle (design, implementation, monitoring), gathering and providing feedback to beneficiaries?

Areas for learning (to be refined further at inception stage of the evaluation):

• What aspects of the GBV prevention/response interventions contribute to changes in knowledge, attitudes and practices that mitigate rights violations for women/girls and other vulnerable groups in the community? To what extent are community volunteers / groups able to influence changes in attitudes about GBV?

How has the mentorship programme impacted on at-risk/vulnerable girls in Kakuma? Is it still relevant? If yes, what components can be retained or reviewed for more impact? What other approaches could be used to support at-risk girls and sustain their participation in productive activities?

To what extent does talent development support contribute to sustainable income generating opportunities for youth in the project locations?

For livelihood training beneficiaries (scholarship/apprenticeship), what factors facilitate their access to employment / self-employment (and thereby income generation) on completion of training?

What aspects of the value chain support worked well, and could be potentially scaled up for more impact?

KEY RESPONSIBILITIES
Scope of consultancy
The Consultant/Consultancy firm will undertake the evaluation in Kakuma, Nairobi and Dadaab where the activities were implemented. The evaluation will primarily target direct beneficiaries of the project in both locations, but will include sampling of the 2015/2016 PRM project beneficiaries to provide indication of sustainability of DRC interventions.

Key Tasks The scope of work for this evaluation includes the following:

• Develop an inception report detailing the process, methodologies and tools to be employed to achieve the objective of this consultancy as stated above. It should include a detailed work plan for this exercise, and present the same to DRC for review and further inputs. Inception report to be presented within 5 days of signing the contract
• Undertake a desk review of the relevant project documents that include the Proposal, Results/Logical Frameworks, Implementation Plans, Project Implementation Reports, and any other relevant documents

• Carry out data collection (using mobile platforms where appropriate), entry and analysis and write up end term evaluation report. The format of the report shall include the following:

• Executive Summary (max 2 pages)

• Preliminary pages – Acknowledgment, Acronyms and Table of contents

• Main text, to include:

• Background Information: Brief on the project and context;

• Evaluation purpose and objectives; study limitations

• Methodology: Design, Sampling technique and Sample size
• Findings: Analysis based on objectives and interpretation. Where possibleinclude photos that support findings e.g. illustrating livelihoods outcomes
• Key accomplishments and summary of project assessment
• Lessons learned and opportunities for improvement
• Recommendations

• Appendices: tools, ToR, list of respondents, bibliography, etc.

• Present the draft report to DRC team for review before producing a final document. The report will be deemed finalized when the Country Director signs it off.

• Hold debrief meeting with key stakeholders to reflect on findings (including lessons learned) and recommendations.

• Develop an evaluation lessons learned brief based on a template to be provided by DRC (as per DRC Evaluation Policy, this document will be shared with the Country Director, Regional MEL Advisor and HQ MEL department).

• Submit a Final End Term Evaluation Report to DRC (soft copy in 2 CDs and 4 bound hard copies). The consultant is requested to use participatory approaches to collect information from staff, beneficiaries and other key informants. The information must be qualitative and quantitative.

The evaluators should take all reasonable steps to ensure that the evaluation is designed and conducted to respect and protect the rights and welfare of the people and communities involved and to ensure that the evaluation is technically accurate and reliable, is conducted in a transparent and impartial manner, and contributes to organizational learning and accountability. Any photos and or stories documented should have informed consent of beneficiaries.

Key deliverables/outputs
Inception report

1. Field report (after data collection)
2. Four (4) good quality bound hard copies of the evaluation report (well formatted and printed on good quality paper)
3. Soft copy of the report in two (2) CDs
4. Study materials including soft copies of all data sets both quantitative and qualitative
5. List of respondents to be annexed to the report
6. Final report (20-25 pages) excluding annexes
7. One (1) Lessons learned brief (3 pages max), highlighting two key findings that are relevant for DRC programming in similar contexts. One finding needs to address a best practice and the other finding is to address a challenge or failure that DRC as an organization can learn from

DRC’S RESPONSIBILITIES
DRC will:

• Provide information on the context and project, contact numbers for relevant people
• Accompany the consultant into the project areas in the camps and Nairobi as mutually agreed between DRC and the consultant
• Set up meeting with beneficiaries and non-beneficiaries
• Make arrangements for accommodation in Dadaab and Kakuma; but consultant will be charged for accommodation and meals.
• Make arrangements for travel to and from project sites for data collection
• Provide consolidated feedback/guidance on draft reports

REPORTING ARRANGEMENTS
The Head of Programmes Development is the overall in charge of the consultancy. The review will be supervised by the Monitoring and Evaluation Officer. The consultant will also work closely with the Area Managers in Dadaab, Nairobi and Kakuma when undertaking fieldwork.

DURATION OF THE ASSIGNMENT
The time frame for this consultancy is 20 days, from the time the contract is signed.

EXPECTED PROFILE OF CONSULTANT
Academic
Post-graduate/Bachelor’s degree in social sciences, community development, refugee studies, and humanitarian law or other social sciences related subjects

Experience & skills

• At least seven years of experience in quantitative and qualitative data collection skills and methodologies in completing assessments, reviews and evaluations with the UN, international NGOs and/or NGO sector
• Good research and analytical skills
• Excellent written and spoken English
• Excellent facilitation skills
• Strong report writing, data collection, data analysis skills
• Demonstrated experience with community-based and participatory approaches
• Demonstrate sound knowledge of leading and conducting monitoring, reviews and evaluations
• High level, up-to-date knowledge and understanding of livelihood and protection in refugee/displacement context

TERMS AND CONDITIONS

• The Consultant must be available to commence the end-term review by 7th September 2017 and able to provide a draft report by the 30th September, 2017.
• The consultant should adhere to the UNHCR coordinated security guidelines. DRC does not guarantee security of the consultant and will therefore not be liable for any eventuality. Nevertheless, any relevant security updates will be shared with the consultant when necessary.
• The consultant must abide by DRC security rules and directives
• The consultant must complete work within the stipulated time frame
• The consultant must operate within the budget allocated.
• The consultant must adhere to and sign DRC’s Code of Conduct