AI Test Automation Engineer

An exciting opportunity has come up at SThree for a talented AI Test Automation Engineer (Blue Team). Reporting to the Head of Infrastructure, Security and Operations, the role is based in our Glasgow office at Cadworks, on a permanent contract, hybrid working basis.

As the AI Test Automation Engineer, you will design and implement automated testing frameworks to validate the safety, reliability, and robustness of AI agents across our orchestration platform. This is an opportunity to join a high functioning relaxed team that will significantly contribute to the digital transformation at SThree.

Who will you be working for?

SThree is the global STEM-workforce consultancy.We connect sought-after specialists with dynamic organisations around the world. We advise businesses, build expert teams, and deliver project solutions to drive innovation across STEM sectors, helping them to Outpace tomorrow, together.

What are the key expectations of this role?

• Design and implement automated testing frameworks to validate the safety, reliability, and robustness of AI agents across our orchestration platform.

• This includes unit and integration tests, scenario simulation, and adversarial validation for prompt injection, hallucinations, and edge cases.

• You’ll also simulate failure scenarios, manage synthetic input testing, and support blue team efforts in early-stage detection of model or orchestration misbehaviour.

Skills, Knowledge & Experience …

• Test automation frameworks (e.g., PyTest, Postman, Playwright, k6)
• LLM behaviour testing, including misuse and injection detection
• Blue team and adversarial scenario simulation design
• CI/CD integration with Azure DevOps for continuous testing
• Python/YAML scripting for scenario and agent validation
• Experience with AI safety test harnesses or red team inputs

Remote Working

• Expected to be in the office 1 to 2 days a week. With additional days depending on activity (e.g. a design workshop)

Benefits for our U.K. teams include:

• The choice to work flexibly from home and the office, in line with our hybrid working principles
• Bonus linked to company and personal performance
• Generous 28 days holiday allowance, plus public holidays
• Annual leave purchase scheme
• Five days paid Caregiver/Dependent leave per annum
• Five paid days off per year for volunteering
• Private healthcare, discounted dental insurance and health care cashback scheme
• Opportunity to participate in the company share scheme
• Access to a range of retail discounts and saving

What we stand for...

We’re committed to ensuring that all processes are equitable, and everyone is treated with fairness and dignity where everyone belongs, is valued and connected. If you need any assistance or reasonable adjustments in submitting your application please let us know, and we’ll be happy to help.