Consultant - Learning Testing Specialist at World Health Organization

Purpose of consultancy

The consultant will coordinate testing activities to support the WHO Academy’s formative evaluation of its learning programmes, learning experience platform (LXP), and other products, including systems for learning design and quality improvement. 

The consultant will use testing to inform decisions about the quality of the products and how to improve them to ensure the products will work as planned upon implementation. Testing is required before the Delivery phase of Academy’s learning design and quality improvement cycle; however, it may also occur during any phase in the cycle to help learning design and product development teams make data-driven decisions. 

The consultant will design and plan a variety of testing activities, run testing with learners and other key stakeholders, and analyze the test data and report findings.

Deliverables: 

Deliverable 1: Design and Planning Specifications for Testing.
Objective 1: Design and plan testing requirements to define inputs for testing WHO Academy products, including learning programmes and the learning experience platform (LXP), and the outputs expected from testing.

• Output 1.1: Determine the objective of the test and specify what is tested, who the test users are, how the test sessions are organized, what data are collected, and when and where the test is conducted.
• Output 1.2: Recruit and select users based on characteristics appropriate for the test.
• Output 1.3: Make test tasks that prescribe what users should try to achieve with the product, focus on specific features that will be tested, and provide a goal against which the users’ actions can be evaluated. 
• Output 1.4: Setup any equipment that will be used for testing such as screen-sharing applications for remote testing.

Deliverable 2: Running the Test Sessions.
Objective 2: Run the test sessions from start to completion, ensuring adherence of all required testing procedures whether tests are conducted remotely or in person, and whether tests are moderated or unmoderated.

• Output 2.1: Run through the checklist of activities required for test sessions specified in the test plan, including welcoming and instructing the users, observing them, listening in on their thoughts, prompting them, taking notes, asking post-task questions, and thanking users.
• Output 2.2: Run test sessions or train evaluators to run the sessions using the test session checklist.

Deliverable 3: Analysis of Test Data.
Objective 3: Analyze the test data and report the findings to ensure the test has a high impact on the continued development of the product.

• Outcome 3.1: Analyze the test data.
• Outcome 3.2: Assign evaluators to rate severity of usability problems.
• Outcome 3.3: Devise redesign proposals.
• Outcome 3.4: Report the test findings.
• Outcome 3.5: Evaluate the quality and usefulness of the test in terms of its impact to bring effective changes in the test product, the cost of testing, and general methodological requirements of reliability, validity, and generalizability.

Qualifications, experience, skills and languages

Educational Qualifications:

Essential:

• Advanced University degree in Learning Science, Educational Technology, Psychology, Human-Computer Interaction, Computer and Information Science, or any related field.

Desirable: 

• PhD in Educational Sciences or related field.
• Masters degree  in UX design and UX research.

Experience

Essential:

At least 5 years of relevant experience in : 

• Conducting research using a range of qualitative and quantitative methods, including usability testing, survey design and remote testing, and participatory design.
• Testing education and training products, including learning management systems.
• Development of online experience testing.
• Analyzing data and reporting findings.

Desirable: 

• Experience in evaluative research, education research and UX research.
• Experience in learning design and UX design.
• Experience in measuring learning impact in LMIC.
• Experience in working with World Health Organization or with international organizations.

Skills/Knowledge:

Essential:

• Ability to deliver and achieve results.
• Excellent communication and writing skills.  
• Ability working with multiple stakeholders in a diverse environment (multiple cultures, time zones, countries/regions, languages, etc.).

Closing Date: Feb 23, 2023