Terms of Reference for Project Evaluations (Baseline,Endline and Ex-post) at Hand in Hand Eastern Africa (HiH EA)

Scope of Work

The consultant will be required to undertake at a minimum the following;

• Desk review of the project documents to understand the project design;
• Develop the sample design and strategy for the surveys and any qualitative data collection (for both Kenya and Tanzania)
• Design/adapt/refine (as appropriate) the data collection tools – both quantitative and qualitative;
• Map the relevant evaluation questions and indicators to the data collection tools (e.g. each survey/interview/focus group question must clearly correspond with an evaluation question or indicator);
• Translate the data collection tools as necessary into local languages (usually Swahili)
• Program the survey in Kobo or another approved data collection platform;
• Conduct a pre-test (pilot) of the tools and finalize them, incorporating changes;
• Select and train enumerators and field supervisors for data collection, including developing user guide documentation e.g. enumerator supervision manuals, etc.;
• Plan the field work logistics;
• Supervise survey implementation and ensure quality control, including consistent identification and treatment of non-responses, out-of-range responses, coding errors, and outliers;
• Supervise qualitative data collection, including key informant interviews and focus groups discussions, as relevant.
• Ensure adherence to all ethical guidelines of conducting research, including obtaining informed consent from all respondents and protecting personal data.
• Clean and analyze all quantitative and qualitative datasets;
• Following each evaluation , write/update one evaluation report, using the HiH evaluation report template provided. Subsequent evaluation reports should incorporate findings from the previous report(s) (i.e. the cohort 1 endline will compare against findings from the cohort 1 baseline; the cohort 2 baseline will compare against the cohort 1 baseline), so that by the end of the project we have one final comparative evaluation report bringing together the quantitative and qualitative findings of all cohorts;
• With draft evaluation report, submit raw, cleaned, and worked datasets to HiH in .xlsx or .csv format;
• With draft evaluation report , submit qualitative transcripts/notes to HiH in .xlsx or .docx format;
• Hold a validation workshop (virtual/physical);
• Incorporate feedback from HIHEA and HIHI;
• Submit a final report.

Approach and Methodology

• The evaluator must use a mixed-methods approach, focusing particularly on project effectiveness according to the indicators set forth in the project MEL plan. The evaluator must ensure all relevant project indicators are addressed.

Deliverables (per evaluation phase)

• The inception report (including clear plans for sampling; enumeration selection, training, and supervision; fieldwork logistics; data analysis; and ensuring data quality) along with the validated quantitative and qualitative data collection tools which are mapped to the evaluation questions and indicators (max. 15 pages);
• Post-field work report, describing the sample reached, number of surveys/interviews/FGDs conducted, and any challenges/limitations of data collection (max. 5 pages);
• Draft zero report (soft copy) in word.docx. (max. 30 pages excluding annexes);
• Draft-one report incorporating changes or comments generated in the draft zero. (max. 30 pages excluding annexes);
• The final evaluation report (max. 30 pages excluding annexes); including an Executive Summary of no more than 2 pages – ;
• Include appendices such as data collection tools, indicator construction, data logs, respondent list for KIIs, etc.;
• Raw data sets in an accessible format (.xlsx or .csv);
• Cleaned and worked datasets in an accessible format (.xlsx or .csv);
• Qualitative transcripts/notes in an accessible format (.xlsx or .docx);
• A power point presentation of the report (max 50 slides) .

Submitting Proposals

HiH International requests consultants to submit proposals to respond to this Terms of Reference as outlined above. We expect the consultancy firm to demonstrate the skills and experience outlined below (or equivalent):

• The lead consultant must have a minimum of 10 years’ experience in field research and evaluation of community development, value chain or livelihoods projects;
• The lead consultant must have a Master’s or Ph.D. in statistics, economics, data science, monitoring and evaluation, international development, or a related field.
• The firm must demonstrate evidence of:
  • past relevant evaluation assignments in rural areas of Kenya and Tanzania;
  • previous experience running multi-country evaluations from baseline through endline
  • experience implementing evaluations in rural livelihoods, agriculture, value chains development
• The firm must have a proven track record of enumerator recruitment, selection, training, and supervision, with preference given to firms that already have a roster of qualified local consultants in the project implementation and evaluation areas;
• The firm must have experience in digital data capture (also known as CAPI) and established procedures to ensure high quality data collection;
• The firm must have experience in qualitative and quantitative data analysis, with the ability to clearly present findings in a concise, analytical report.
• Strong attention to detail with excellent communication and interpersonal skills, including the ability to discuss research concepts and data to diverse audience.
• The firm should demonstrate familiarity and experience with gender- and culturally sensitive evaluation approaches. The firm should have a demonstrated understanding of
• small, medium and micro enterprises; women’s economic empowerment; , and agricultural value chains.
• Firms with an established presence in East Africa, ideally in Tanzania or Kenya, will be at an advantage

The proposal should include the following (maximum excluding CVs: 20 pages):

• A short outline of evaluation approach, research design and methodology for the Evaluation (Max. 5 pages);
• A proposed workplan and timeframe for the Evaluation setting out the phases (see phase plan above), the number of consultants and the number of days (Max. 2 pages);
• The anticipated challenges and dependencies likely to affect the implementation of the Evaluation and how these should be addressed (Max. 1 page);
• A description of how to ensure data quality throughout the process/assignment (Max. 2 pages);
• A description of relevant previous assignments, demonstrating the required skills and experience outlines above (Max. 2 pages);
• A summary of the most relevant skills and experience of the proposed evaluation team, and what their respective roles will be throughout this assignment. This should include an allocation of days for each team member.
• CV’s of the lead evaluator as well as other key members of the evaluation team, showing relevant previous assignments and clients. (Annex CVs separately; Max 2 pages per CV);
• A detailed fee quote and rationale for the consultants and an estimate for the operational costs (Max. 2 pages)