This job is no longer live. The employer has closed or delisted this posting, so new applications are unlikely to be considered. See live jobs at ConnexAI or browse all sponsored jobs.
Machine Learning Systems Engineer
Not disclosed
Salary
Not disclosed by employer
£54,700
Going rate
Skilled Worker going rate
This role likely qualifies for a Skilled Worker visa
Our predicted code SOC 2134 (73% match) is an eligible occupation, with a going rate of £54,700, and ConnexAI is a licensed sponsor. That is our reading of the published rules. Whether they issue a Certificate of Sponsorship is still their call.
About the role
About the role
We are building real-time conversational AI systems for contact centres, powered by ASR, LLMs, and TTS.
As an LLM Systems Engineer, you will sit within our LLM team and focus on the systems layer that makes production Conversational AI work at scale. You’ll design and improve the infrastructure, orchestration, and runtime systems behind low-latency conversational AI workflows.
This role focuses on solving the technical challenges associated with delivering real-time AI conversations: coordinating complex AI systems under strict latency and reliability constraints.
What you’ll do
- Design and build systems that enable LLM workflows to maintain real-time responses even under peak load
- Improve latency, throughput, concurrency, and reliability across our production systems
- Build orchestration logic for model calls, services, queues, retries, fallbacks, and routing that balances load management with low response times
- Help scale systems to support high volumes of concurrent real-time conversations
- Optimise memory usage and resource efficiency across LLM-powered services
- Deploy and support autoscaling in AI services running in AWS-based systems
- Build observability into AI workflows, including monitoring, logging, alerting, and performance tracking
- Work closely with data scientists, MLEs, prototype engineers, and backend engineers
- Help turn LLM capabilities into stable, scalable production Conversational AI systems
What we’re looking for
- Strong Python engineering skills
- Experience building production backend systems, distributed systems, or ML infrastructure
- Strong understanding of scalability, latency, reliability, and performance engineering
- Experience with cloud infrastructure, ideally AWS
- Experience working with APIs, queues, service orchestration, and production monitoring
Nice to have
- Experience with conversational AI, voice systems, ASR, TTS, or real-time streaming systems
- Experience with model serving or inference infrastructure
- Exposure to open-source LLMs or LLM orchestration frameworks
- Experience with Docker, Kubernetes, ECS, or similar container orchestration tools
- Experience with Redis, Kafka, Kinesis, SQS, or similar queueing/event systems
- Familiarity with monitoring tools such as CloudWatch, Prometheus, or Grafana
Why join?
You’ll help build the systems behind real-time AI conversations used in production contact centre environments. This is a high-impact engineering role focused on low latency, scalability, reliability, and making LLM-powered systems work under real-world load.
This description is the source posting as it read when we added it. We are not affiliated with ConnexAI, so check their own site for the current details.
Where this offer sits in the market
SOC 2134 · UK · ONS ASHE 2025 · ~343k in sampleSimilar sponsored roles
See all jobsNo close matches live right now.
Browse more sponsored jobs at ConnexAIAbout sponsorship for this role
Does this job guarantee visa sponsorship?
Not necessarily. ConnexAI holds a sponsor licence, but sponsorship for a specific hire is always the employer's decision. Be upfront in your application that you'll require it.
What salary is needed for this role to be eligible?
The offer must clear both the general threshold and the SOC 2134 going rate of £54,700. New-entrant and shortage discounts can lower it.