Senior Data Engineer
UK Visa Sponsorship Analytics
Above analytics are generated algorithmically based on job titles and may not always be the same as the company's job classification. You can also check detailed occupation eligibility, and salary criteria on our UK Visa Eligible Occupations & Salary Thresholds page.
Disclaimer: Hunt UK Visa Sponsors aggregates job listings from publicly available sources, such as search engines, to assist with your job hunting. We do not claim affiliation with Verian Group. For the most up-to-date job details, please visit the official website by clicking "Apply Now."
Data Engineer/Senior Data Engineer
Location: London (Hybrid/Flexible)
About Verian
Verian is a purpose-led company, delivering high-impact projects that shape public policy and drive social change. From education to health, crime to energy, our projects make a real difference.
With offices in 15 countries, our consultants and researchers advise government departments, regulators, charities, and other public sector organisations to make informed decisions and improve people’s lives.
Operating globally, Verian has offices across Europe, Asia Pacific, and the United States.
About the Role
We are seeking a Data or Snr Data Engineer to join our Data Platform team and contribute to the delivery of our product strategy for managing and analysing social research data.
Working primarily with Azure and Databricks, supported by technologies like Power BI, you’ll design, build, and maintain scalable, reliable, and high-quality data pipelines.
As a key member of the team, you will collaborate with product managers, lead engineers, and cross-functional teams to turn business requirements into technical solutions that drive real-world impact.
Responsibilities
- Collaborate with global business stakeholders to translate business requirements into clear technical specifications.
- Design, develop and maintain data pipelines using Azure Data Factory (ADF), Databricks, Synapse, Python, R, Spark, Pandas and SQL.
- Manage and optimize Azure resources including Azure Portal, Blob Storage, and Data Lake.
- Implement and manage data workflows, ensuring seamless data orchestration and integration.
Skills and Experience
- Proven experience as Senior Data Engineer in international environments, ideally within the consulting sector
- Strong stakeholder management skills and ability to adapt across regions and cultures
- Comfortable working in a fast-paced, agile environment
- Track record in designing and implementing scalable data platforms and products
- Deep expertise in Cloud technologies, especially Microsoft Azure
- Advanced skills in Python, R, Spark, Pandas, and SQL
- Hands-on experience with Delta Live Tables
- Familiarity with the Databricks medallion architecture
- Working knowledge of Unity Catalog and data governance principles
- Experience applying Agile and DevOps practices
- Proficient in building and maintaining CI/CD pipelines
- Experience using Terraform for infrastructure as code
Why Join Verian?
Joining Verian means becoming part of a dynamic and collaborative community that thrives on innovation and intellectual curiosity.
- Play a pivotal role in building our data platform from the ground up, at the heart of Verian’s digital transformation.
How to Apply
If you’re passionate about turning data into insights that impact society, we’d love to hear from you!
Apply online today, and if your profile matches, we’ll be in touch for an initial exploratory interview.
We encourage applications from all sections of society and provide reasonable accommodations for candidates with disabilities throughout the application and interview process.
Learn more about us at veriangroup.com