Lead Data Engineer

Allen Lane are pleased to be partnering with the London Borough of Newham to recruit a Lead Data Engineer on a permanent basis. This is a fantastic opportunity to join a forward-thinking, data-driven local authority and lead the delivery of high-quality, high-impact data engineering solutions that enable smarter decisions and better services for residents. Please note that this is a hybrid role, with candidates required to be office-based up to 2 days per week.

As a Lead Data Engineer, you will:

• Lead the council’s data engineering function, managing a talented team to deliver innovative, reliable and secure data solutions.
• Drive the development of the Enterprise Cloud Data Platform on Microsoft Azure, including automated pipelines, integrations and scalable architectures.
• Ensure that data across the council is of the highest quality, accessible, and usable.
• Provide technical leadership across the full data lifecycle, from ingestion and transformation to presentation and self-service analytics.
• Administer and optimise the Microsoft Fabric environment, connecting operational, analytics and BI systems.
• Support AI-related initiatives and champion the use of data for continuous insight and improvement.
• Collaborate with senior stakeholders to align data engineering priorities with strategic objectives.

As a Lead Data Engineer, you must have:

• Significant leadership and management experience in a data-focused environment, with proven team mentoring skills.
• Hands-on expertise in Microsoft Azure Data services including Data Factory, Synapse, Databricks, and Fabric.
• Strong proficiency in SQL and Python, with experience of data modelling, ETL/ELT processes, and pipeline optimisation.
• The ability to design and deliver enterprise-scale data platforms and ensure compliance with data protection requirements.
• Excellent communication skills and the ability to engage, influence and collaborate across multidisciplinary teams.
• A strategic mindset with the ability to challenge existing practices and drive innovation.

What you get in return:

A salary between £57,399 - £60,570 plus excellent benefits including the Local Government pension scheme and much more!

How to apply:

Please submit an updated CV and covering letter (no more than 1250 words) to [email protected] by 9am on Wednesday the 27th of August