Lead Data Engineer
UK Visa Sponsorship Analytics
Above analytics are generated algorithmically based on job titles and may not always be the same as the company's job classification. You can also check detailed occupation eligibility, and salary criteria on our UK Visa Eligible Occupations & Salary Thresholds page.
Disclaimer: Hunt UK Visa Sponsors aggregates job listings from publicly available sources, such as search engines, to assist with your job hunting. We do not claim affiliation with Synechron. For the most up-to-date job details, please visit the official website by clicking "Apply Now."
Overview:
Synechron UK is looking for a highly experienced Lead Data Engineering Consultant to lead and develop cutting-edge data engineering platforms. The ideal candidate will bring a mix of technical expertise, leadership skills, and innovative thinking to support our data-driven initiatives.
Key Responsibilities:
- Lead the design, development, and optimisation of enterprise data platforms using tools such as Hadoop, Spark, and Splunk.
- Develop and maintain robust ETL/ELT data pipelines to handle raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
- Integrate large, disparate datasets with modern tools and frameworks, ensuring smooth data flow across systems.
- Collaborate closely with BI and Analytics teams in fast-paced environments, supporting their data needs.
- Drive the creation of technical test plans, conduct unit and integration testing, and maintain high code quality within automated environments.
- Promote a Site Reliability Engineering (SRE) culture by addressing operational challenges and ensuring service resilience and sustainability.
Qualifications:
- Extensive experience with Hadoop, Spark, and Splunk.
- Proficiency in Python scripting, with experience in handling various data formats.
- Strong background in building and optimising data pipelines and supporting BI/Analytics teams.
- Experience with CI/CD pipelines and source control.
- Knowledge of agile methodologies such as Scrum or Kanban.
- Ability to develop and implement automated test plans and ensure high-quality deliverables.