AI Data Pipeline Engineer

An exciting opportunity has come up at SThree for a talented AI Data Pipeline Engineer. Reporting to the Head of Infrastructure, Security and Operations, the role is based in our Glasgow office at Cadworks, on a permanent contract, hybrid working basis.

As an AI Data Pipeline Engineer, you will be responsible for building scalable, real-time data pipelines to connect various structured and unstructured data sources across Cosmos DB, Redis, PostgreSQL, and Dataverse. This is an opportunity to join a high functioning relaxed team that will significantly contribute to the digital transformation at SThree.

Who will you be working for?

SThree is the global STEM-workforce consultancy. We connect sought-after specialists with dynamic organisations around the world. We advise businesses, build expert teams, and deliver project solutions to drive innovation across STEM sectors, helping them to Outpace tomorrow, together.

What are the key expectations of this role?

• Be responsible for building scalable, real-time data pipelines to connect various structured and unstructured data sources across Cosmos DB, Redis, PostgreSQL, and Dataverse.

• You will also lead the design of embedding generation pipelines to feed Azure Cognitive Search indexes, powering semantic retrieval across the recruitment knowledge graph.

• You’ll work closely with AI engineers to ensure data compliance (GDPR, DSAR) and auditability, enabling secure AI workflows across multiple business domains and geographical regions.

Skills, Knowledge & Experience …

• Advanced skills in Cosmos DB, Redis, PostgreSQL (query optimisation, schema design)
• Event-driven architecture using Azure Event Grid, Service Bus, or Event Hub
• Azure Cognitive Search integration and vector embedding pipelines
• Microsoft Dataverse and Microsoft Fabric familiarity
• ETL pipeline design for AI/LLM use cases
• Data compliance and governance controls (GDPR, DPA, DSAR)

Remote Working

• Expected to be in the office 1 to 2 days a week. With additional days depending on activity (e.g. a design workshop)

Benefits for our U.K. teams include:

• The choice to work flexibly from home and the office, in line with our hybrid working principles
• Bonus linked to company and personal performance
• Generous 28 days holiday allowance, plus public holidays
• Annual leave purchase scheme
• Five days paid Caregiver/Dependent leave per annum
• Five paid days off per year for volunteering
• Private healthcare, discounted dental insurance and health care cashback scheme
• Opportunity to participate in the company share scheme
• Access to a range of retail discounts and saving

What we stand for...

We’re committed to ensuring that all processes are equitable, and everyone is treated with fairness and dignity where everyone belongs, is valued and connected. If you need any assistance or reasonable adjustments in submitting your application please let us know, and we’ll be happy to help.