Data Engineer (Databricks)
Not disclosed
Salary
Not disclosed by employer
£54,900
Going rate
Skilled Worker going rate
This role likely qualifies for a Skilled Worker visa
SOC 2133 (85% match) is an eligible occupation, with a going rate of £54,900, and X4 Technology is a licensed sponsor. That is our reading of the rules. Whether they issue a Certificate of Sponsorship is still their call.
This could also be SOC 2134 (Programmers and software development professionals, Heavy hands-on PySpark/SQL pipeline building could be software development). We read the code off the advert, so it is our best guess, not the employer's.
About the role
Role: Data Engineer (Azure Databricks)
Programme: Azure Databricks Platform
Industry: Commodities / Energy Trading
Location: London (Hybrid)
Contract: Initial 6-month contract (long-term transformation programme)
Rate: £650-700/day (Inside IR35)
X4 Technology are partnered with a leading global energy trading organisation on a major tech transformation - migrating from a legacy ETRM platform onto Endur, and modernising its enterprise data platform with Azure Databricks.
As part of this multi-year programme, Oracle-based data platforms are being rebuilt into a scalable, cloud-native Azure Databricks platform supporting Endur, global reporting, analytics and risk - cutting critical data latency from 10–15 minutes down to near real-time.
They're after an experienced Data Engineer to help design and build that platform hands-on - combining deep engineering with real technical ownership, shaping standards, performance and future architecture along the way.
Responsibilities of the Data Engineer (Azure Databricks)
- Design, build and optimise scalable Azure Databricks pipelines using PySpark, SQL, Delta Lake and Structured Streaming
- Lead the migration of legacy Oracle platforms into Azure Databricks, delivering high-performance solutions for trading, reporting and analytics
- Drive engineering best practice across performance, scalability, CI/CD, testing, governance and cloud cost
- Work closely with architects, platform teams and stakeholders to shape solutions, mentor engineers and influence platform direction
Requirements for the Data Engineer (Azure Databricks)
- Extensive hands-on experience delivering enterprise-scale Azure Databricks platforms - strong PySpark, Python, SQL, Delta Lake and Structured Streaming (Delta Live Tables a bonus)
A brilliant chance to work on one of the biggest Azure Databricks transformations in energy trading, helping build a modern cloud platform underpinning trading, risk, reporting and analytics - with real influence over technical decisions while staying hands-on in a high-performing team.
Interviews moving fast, with a view to onboarding ASAP. Apply now for immediate consideration.
This description is the source posting as it read when we added it. We are not affiliated with X4 Technology, so check their own site for the current details.
Where this offer sits in the market
SOC 2133 · UK · ONS ASHE 2025 · ~163k in sampleSimilar sponsored roles
See all UK visa jobsNo close matches live right now.
Browse more sponsored jobs at X4 TechnologyAbout sponsorship for this role
Does this job guarantee visa sponsorship?
Not necessarily. X4 Technology holds a sponsor licence, but sponsorship for a specific hire is always the employer's decision. Be upfront in your application that you'll require it.
What salary is needed for this role to be eligible?
The offer must clear both the general threshold and the SOC 2133 going rate of £54,900. New-entrant and shortage discounts can lower it.