Evaluation of the Wings to Fly Program at Equity Group Foundation

Purpose and Scope of the Consultancy:

Equity Group Foundation places great importance on the role of evaluations in providing basis for decision making, learning and implementing quality programs for evidence-based results. It is against this background that the M&E department would like to commission a special study to provide information about the effectiveness of the wraparound services on the wings to fly program.

The scope of the evaluation shall be limited to the current WtF scholars in various secondary schools in Kenya, scholars in all classes [form 1 to form 4], stakeholders in the program including the relevant Government institutions, Equity Bank, Parents/guardians and partners. The evaluation will use mix methods including primary research and secondary research approaches. Academic performance in this context will be regarded as the scholar performance during the internal exams while attending the four year secondary school course and also the performance at the National examinations [KCSE].

Objectives: This special study will provide Equity Group Foundation with details and analyses that will allow for them to assess the effectiveness of certain program interventions against its intended goals and objectives while identifying good practices, key lessons, and areas for improvement. The main purpose of the evaluation is therefore to provide an objective and independent review of the extent to which the wraparound services support the program in achieving its objectives and goals.

More specifically the evaluation seeks to:

• Understand whether there is significant difference in perceptions of students who have received wraparound services when compared with those that have not received
• Understand whether there is a significant difference in self-efficacy in the area of STEM [science, Technology, Engineering, and Mathematics] for scholars who receive wrap around services when compared with others
• Understand whether there is a significant difference in academic performance, completion, transition and incidence rates for scholars who receive wrap around services when compared with others
• Assess whether the wrap around services in supporting the program meet its objectives based on the program documents, project deliverables, and targets;
• Assess the intended and unintended outcomes and impacts of the wraparound services;
• Provide documented lessons learned, good or promising practices, and models of intervention from the project design and experiences in implementation;
• Identify key challenges encountered and how they have been overcome;
• Provide recommendations for improving the program particularly around the adaptability and sustainability of EGF’s approach to provision of wrap around services.

Methodology:

The technical proposal presented by the potential consultancy firms is expected to provide a brief presentation of the methodology to be used in the evaluation including design and justification on the use of the design. It is expected also under the methodology section that a description of the proposed sampling methods and procedures applicable to the evaluation is made. We propose that both these studies employ a quasi-experimental design – which have a comparison group through matching, regression discontinuity, propensity scores or other means. The program will ensure that findings from both these evaluations are strengthened through triangulation. The detailed methodology and evaluation plan shall be presented at the inception report by the successful consultancy firm is contracted and this shall be discussed with the relevant EGF staff before the actual evaluation kicks off.