As Annotation Operations Lead, you’ll manage Cleo’s human-powered annotation programs. Working closely with content designers and machine learning engineers, you’ll ensure that annotation pipelines are well designed, reliable, scalable, and consistently delivering the high-quality data our models rely on.
You’ll guide project setup, resource strategy, labelling best practices, and operational workflows. You’ll design and manage the right mix of internal and outsourced resources (including BPO partners), ensuring that both quality and productivity expectations are met.
A key focus will be running a robust golden set and evaluation program, with support from our Quality and Training specialist. You’ll become an expert in how we label data at Cleo, how we measure annotation success, and how we continuously raise the bar for accuracy.
This role sits within our Customer Support team, so you should also be comfortable supporting broader CS operations: including automation work and cross-team initiatives that improve our customer experience and operational efficiency.
This is an ideal role for someone who enjoys complex systems, thrives at the intersection of people and process, and loves enabling others to produce exceptional work.
Key Responsibilities
- Partnering With Machine Learning Teams