Formative Assessment Design and Delivery at Aga Khan Foundation

Scope of work

The partner consultant or organisation will collaborate with the AKF Education team, namely the Regional Assessment Coordinator, the Regional Education and ECD Advisor, the National Schools2030 Coordinator and Global Assessment Partner, to develop and review items for use in formative assessments, develop test specification and construction of operational and field tests among out of school children (15-year-old). Specifically, the consultant will:

• Develop an assessment framework
• Apply best practices in item development and test development, involvement in standard interpretation and appropriate aliment determinations
• Position requires skills in developing life skills assessment in out of school cohorts
• Lead item writing and item data review meetings and provide content expertise in those meetings as necessary.
• Provide technical expertise in defining the learning domains and competences (both academic and non-academic domains) for the out of school cohort.
• Develop and conduct item development workshops for 5 learning domains, both academic and non-academic domains for out of school children
• Some travel may be required for item construction related meetings
• Field-test the items and refine them where necessary
• Ensure that the items develop are of high quality.
• Classify items according to pre-specified content dimensions.
• Ensure accuracy of item content, keying, and item validations.

Expected Deliverables

• Develop an assessment framework that details the course of action and test specification
• Defined domains and competences that will be assessed
• High Quality Holistic Assessment for Learning tools for out of school cohort (15-year-olds)
• Pre-pilot and pilot the tools
• Train the enumerators on how to administer the tools
• Draft and share the pre-pilot and pilot reports and make necessary recommendations based on the data from filed testing

Deliverable Days

• Contract signing – 1st July 2022
• Defining domains and competences to be measured (1) day
• Item construction (15) days and submission of 1st draft
• Incorporation of inputs from AKF team and Partners (2 days)
• Pre-piloting preparations and training (2) days
• Data cleaning and pre-pilot report writing (4)
• Submission of the pre-pilot report (1) day
• In-cooperation of inputs based on the data from the pre-pilot
• Piloting tools preparations and training (2 days)
• Data analysis & reporting, and submission of 2nd draft (2) days
• Presentation of findings (1) day

Contract duration

The partnership will be valid from 1st July 2022 – 30th September 2022. This contract can be extended based on performance and mutual agreement by both parties.

Qualifications Required

• Master’s degree in Education
• At least 4 years of experience in teaching / working with out of school’s children
• Experience in item development, life skills assessment is preferred
• General knowledge of test development including processing, scoring, and reporting on student learning assessment is preferred.
• Must have outstanding written and verbal communication skills and the ability to work in partnerships
• Ability to work independently in a timely and organized manner.
• Ability to engage with various stakeholders in open dialogue and value diverse opinions with maturity and tact, proven diplomacy, and cultural sensitivity.
• Willingness to explore and experiment with new ideas and approaches in own work.
• Proficiency in Windows MS Office (Microsoft Word, Excel, PowerPoint, Outlook)