Artificial Intelligence Test Engineer
Avensys Ltd, Newtown, Cambridge
Artificial Intelligence Test Engineer
Salary not available. View on company website.
Avensys Ltd, Newtown, Cambridge
- Full time
- Permanent
- Onsite working
Posted today, 31 Aug | Get your application in now to be one of the first to apply.
Closing date: Closing date not specified
Job ref: 6f87fa91c728401397b64b9781eac073
Location ref: Newtown, Cambridge
Full Job Description
- We are looking for a detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services. You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities.
- You'll be part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools, with a builder mindset, rapid prototyping and continuous improvement, and agility of a start-up.
Familiarity with LLM evaluation techniques, output scoring, and validation frameworks. - Understanding of prompt engineering, RAG, model orchestration, and hallucination detection.
- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.
- Defining performance metrics for AI services and testing for the same.
- Awareness of AI safety, bias detection, and explainability techniques.
- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
- Strong belief in ethical AI practices, transparency, and end-user trust.
- 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.
- Proficient in designing automated testing frameworks.
- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized architectures.
- Strong understanding of API testing, performance profiling, and security testing (including OWASP Top 10).
- Excellent problem-solving skills with the ability to analyze complex technical challenges and propose scalable solutions.
- Experience working in Agile teams and collaborating across global R&D locations.
- Demonstrated ability to mentor junior team members and foster a culture of continuous learning and innovation.
Direct job link
https://www.jobs24.co.uk/job/artificial-intelligence-test-engineer-127310269