Principal Data Engineer (Databricks)
Not disclosed
Salary
Not disclosed by employer
£54,900
Going rate
Skilled Worker going rate
This role likely qualifies for a Skilled Worker visa
SOC 2133 (85% match) is an eligible occupation, with a going rate of £54,900, and X4 Technology is a licensed sponsor. That is our reading of the rules. Whether they issue a Certificate of Sponsorship is still their call.
This could also be SOC 2134 (Programmers and software development professionals, Hands-on PySpark/Python/SQL engineering could fit software development) or SOC 2139 (Information technology professionals not elsewhere classified., Platform engineering and data consultant aspects fit IT n.e.c.). We read the code off the advert, so it is our best guess, not the employer's.
About the role
Role: Principal Data Engineer (Azure Databricks)
Programme: Data Exchange Platform
Industry: Commodities / Energy Trading
Location: London (Hybrid)
Contract: Initial 6-month contract (long-term transformation programme)
Rate: £850-950/day (Inside IR35)
X4 Technology are partnered with a global energy trading firm on a major transformation of its Data Exchange platform - the technical data backbone supporting physical commodities trading on a global scale.
The platform automates, reconciles and standardises transaction workflows across physical crude oil and refined petroleum products, giving traders a single, trusted source of truth across the entire ecosystem.
Joining as contract Principal Data Engineer, you'll play a pivotal role in the transformation - combining deep Azure Databricks expertise with genuine technical ownership across data architecture, streaming, integration and platform engineering.
Responsibilities for the Principal Data Engineer (Databricks)
- Own end-to-end data and platform architecture, shaping scalable, secure and high-performance solutions across multiple workstreams
- Lead design/delivery of the Databricks data platform - batch and real-time ingestion, streaming, data modelling, integration across Azure
- Set technical direction and engineering standards, driving best practice on performance, scalability, governance, security, testing and cost optimisation
- Be the go-to across Architects, Engineers, Programme Managers, Business Analysts and Trading stakeholders
- Spot and land pportunities for AI and intelligent automation - MLflow, Azure AI Foundry, Agent Bricks and Microsoft Copilot
Requirements for the Principal Data Engineer (Databricks)
- Extensive hands-on Azure Databricks expertise with a strong track record designing and delivering enterprise-scale data platforms (PySpark, Python, SQL, Delta Lake, Structured Streaming, DLT)
High-profile seat at the heart of a global trading data ecosystem. You'll combine hands-on data engineering with real technical influence, shaping a highly secure, cloud-native data platform that connects trading desks, physical assets and external partners
Initial 6-month contract with multi-year programme scope, £850-950/day (inside IR35), hybrid in London. Interviews are being scheduled immediately, with a view to onboarding as soon as possible, so please apply now for immediate consideration.
This description is the source posting as it read when we added it. We are not affiliated with X4 Technology, so check their own site for the current details.
Where this offer sits in the market
SOC 2133 · UK · ONS ASHE 2025 · ~163k in sampleSimilar sponsored roles
See all UK visa jobsNo close matches live right now.
Browse more sponsored jobs at X4 TechnologyAbout sponsorship for this role
Does this job guarantee visa sponsorship?
Not necessarily. X4 Technology holds a sponsor licence, but sponsorship for a specific hire is always the employer's decision. Be upfront in your application that you'll require it.
What salary is needed for this role to be eligible?
The offer must clear both the general threshold and the SOC 2133 going rate of £54,900. New-entrant and shortage discounts can lower it.