Assessment Technologies Research Manager

We are seeking a Senior Assessment Technologies Research Manager to lead cutting-edge research into AI-driven and technology-enhanced language assessment solutions. In this pivotal role, you will shape the future of assessment by designing and delivering research programmes that underpin the development, validation, and responsible deployment of next-generation technologies. Your work will strengthen the reliability, fairness, and educational impact of OUP's assessment products, with a focus on automated scoring, generative AI-supported item development, and innovative task design. You will investigate and prototype advanced approaches, including NLP and LLM based scoring systems, the use of synthetic data to enhance training datasets, and interactive, scenario-based assessments powered by technologies such as speech-to-text and text-to-speech. Working closely with assessment specialists, product teams, and engineers, you will build robust research methodologies, develop end-to-end prototypes, and conduct sophisticated quantitative analyses using psychometric frameworks such as CTT and IRT. A key part of the role is ensuring that AI-enhanced assessment solutions are valid, unbiased, and operationally viable. This role also requires strong communication skills, translating complex technical and psychometric findings into clear, actionable insights for non-technical stakeholders. You will contribute to organisational capability-building by supporting the responsible use of AI in assessment, while producing high-quality research outputs such as white papers, technical reports, and conference presentations that reinforce OUP's reputation for evidence-based innovation. Success in this role will be measured through the delivery of impactful research studies, the practical application of findings in product development and strategy, and meaningful collaboration across teams. You will play a critical role in advancing OUP's assessment offering, ensuring it meets the evolving needs of learners worldwide while maintaining the highest standards of quality, validity, and fairness.

Essential:

• An academic background in Computational Linguistics, Language Assessment, NLP, or other related field.
• Comprehensive understanding of assessment concepts and frameworks such as construct, Evidence-Centred Design (ECD) and argument-based validation.
• Advanced proficiency in relevant tools such as Python for data science, NLP and LLMs. Experience with SQL relational database design. Experience with speech-to-text and text-to-speech technologies.
• Research methodology expertise in quantitative methods, including data analysis and statistical techniques. Practical experience with psychometric analyses.
• Excellent communication skills - ability to translate complex research findings into accessible insights for diverse audiences including educators, commercial teams, and senior leadership.
Desirable:
• Project management capabilities - able to manage multiple studies simultaneously, meeting deadlines and budget constraints.
• Experience investigating the impact of prompting strategies on the output quality of Large Language Models in educational contexts.
• Experience analysing assessment data and diagnostic outputs (e.g., dashboards, reports) in educational contexts.
• Publication record in applied linguistics/language assessment, presentations at major applied linguistics/language assessment conferences., English Language Teaching
  
  More and more people are choosing to learn English.
When they do, they become part of an international community of English language learners. We are proud to be at that community's heart. Our learning materials are trusted by millions of teachers, educational institutions, parents, and learners worldwide. They can teach and learn on their own terms, make progress, and achieve their goals. Together, we move English language learning forward.

We care about work/life balance here at OUP. With this in mind we offer 25 days' holiday that rises with service, plus bank holidays and Christmas closure (3-days) and a 35-hour working week. We are open to discussing flexibility in respect to working patterns, dependent on role. We also have a great variety of active employee networks and societies. We help make your money go further by contributing to your pension up to 12%, offering loans and savings schemes through our partnership with Salary Finance, in addition to travel to work schemes and access to a wide range of local discounts. This role comes with the added benefit of a discretionary annual payment.