Director of Research and Assessments

Position Overview

We are currently seeking an experienced and knowledgeable Director of Research and Assessments to join our dynamic team. The Director will leverage innovative digital assessment tools and use research methodologies to measure and improve high-quality education that is provided to underserved communities. The Director will be responsible for overseeing research projects, developing and implementing assessment strategies, and guiding the research team. This role requires exceptional analytical skills, a strong understanding of academics, education, and graduate level research methodologies. Furthermore, the ability to manage multiple projects on tight deadlines and collaborate with multiple departments effectively is required.

Key Responsibilities

Research Development and Management

• Identify key research questions to be answered in TTWF’s e-learning models.
  
• Develop and oversee the implementation of research design, methods, and strategies to collect and analyze meaningful data on TTWF deployments.
  
• Plan and conduct research studies, including the collection and analysis of data for stakeholders like the government, corporate donors, technology partners, content partners and internal departments seeking to improve their processes and standards.
  
• Interpret research findings and provide actionable recommendations.
  
• Stay updated with the latest research trends and methodologies in education.
  
• Collaborate with other departments to ensure research aligns with organizational goals.
  
• Present research findings to internal and external stakeholders.
  
• Ensure the scientific validity and reliability of research instruments and processes.
  
• Upskill and professionally develop the team of research and assessments.
  
• Ensure all relevant KPIs related to learners’ assessments are met.
  
• Identify student trends from assessment data that includes the drop-out, retention, matched pair sample, and absent students in assessments.
  
• Provide the learning gains and student assessment data for each TTWF student as organized by the MicroSchool or InSchool.
  

Assessment Design and Implementation

• Develop and implement assessment strategies and frameworks for assessing students from Grades Kindergarten through Grade 5.
  
• Lead a small team of assessment specialists to design and deliver high-quality assessments, particularly formative assessments for students.
  
• Ensure assessments align with the curriculum, the TTWF learning content, and the learning objectives and standards.
  
• Stay updated with emerging trends and best practices in assessment design and technology.
  
• Ensure compliance with educational industry ethics and standards for assessments.
  
• Oversee the digitization of assessments into gamified assessment apps with technology partners.
  
• Design and improve the assessment data pipeline to improve data collection, data reliability, and overall assessment procedure quality.
  
• Design and cascade the testing processes, including the formal summative and formative assessment processes to the managers, field officers, and front-line TTWF staff.
  
• Coordinate the development of technical manuals and training workshops for assessment implementation.
  
• Provide oversight and guidance to field teams on conducting assessments on-ground.
  
• Keep track of on-ground administration of assessments across multiple schools and timelines.
  

Training and Development

• Develop training manuals and conduct workshops for field officers and contractual assessment officers’ training, scoring, and implementation.
  
• Train facilitators and M&E officers on missed learners' protocols and the use of assessment tools.
  
• Manage the training cascade to facilitators via digital apps and technologies for mass adoption of assessments.
  
• Orchestrate collaborative workshops on the procedure and process to define how the formal summative and formative data from assessments will be correlated with the in-app assessments data.
  

Analysis, Reporting and Visualization

• Develop and maintain an assessments database.
  
• Architecture the assessment database so that statistics on learner retention, learner progress, learner participation, and scores of learners are readily available and kept up to date.
  
• Oversee the work of data analysts and ensure the reliability and correctness of analytics.
  
• Determine the reliability of the formal assessments when required.
  
• Develop automated processes with the help of algorithms and formulae created by TTWF data analysts to ensure that assessment data is checked timely and with minimal reliance on manual human resources.
  
• Analyze assessment data and provide insights to inform instructional delivery and content improvement through visually engaging and consumable data presentations.
  
• Orchestrate the creation and update of assessment visualization tools.
  
• Produce stakeholder reports and ensure accurate grading and reporting.
  
• Check for inter-rater reliability and correlational testing between test facilitators, different assessments apps, and various testing methods.
  
• Oversee psychometric analysis of assessment tools including the Cronbach alpha, item difficulty and item discrimination.
  
• Utilize tools such as Canva, Miro, and Whimsical for effective data presentation.
  

Requirements

Qualifications & Experience

• A master’s or post-graduate degree in education, psychology, or a related field (Ph.D. preferred) along with a strong mathematical background.
  
• Proven experience in conducting and managing research projects.
  
• Proven experience in assessment design.
  
• A minimum of 10 years of experience in research and assessments in non-profits and research firms catering to digital learning or standardized educational testing in traditional education environments.
  
• Familiarity with digital learning apps, digital learning platforms, paper and digital world-quality assessment tools.
  

Necessary Skills

• Data Analysis: Proficiency in data analysis software such as Stata, NVivo, and Excel.
  
• Research Design and Methods: Expertise in research design, sampling techniques, and psychometric analysis with a particular focus on assessments.
  
• Design & Presentation Skills: Proficiency in creating visually appealing presentations using Canva, Miro, Whimsical, and other similar tools.
  
• Leadership: Strong leadership skills to manage and guide the research and assessment team.
  
• Analytical Thinking: Ability to analyze complex data sets and derive meaningful insights.
  
• Communication: Excellent written and verbal communication skills to present research findings effectively.
  
• Flexibility and Adaptability: Ability to navigate a dynamic work environment and evolving/competing priorities.
  
• Collaboration: Ability to work collaboratively with cross-functional teams and external stakeholders.
  
• Project Management: Meticulous with strong organizational skills to manage multiple projects simultaneously.