Principal Data Engineer

If you’re looking for a career where you can make a real impression, join HSBC and discover how valued you’ll be.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of The Principal Cybersecurity Data Engineer, this a key technical role within the Platform & Data Engineering Team, contributing to, coordinating, and leading data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big data technologies.

The position is a senior technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering, platform operations and production support

As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and benefits package. This includes private healthcare for all UK-based employees, enhanced maternity and adoption pay and support when you return to work, and a contributory pension scheme with a generous employer contribution.

In this role you will:

• Ingest and provision raw datasets, enriched tables, and curated data assets to support various cybersecurity use cases.
• Drive enhancements to the data ingestion process, with an emphasis on real-time data coverage.
• Design and implement robust data pipelines that integrate diverse data sources across the enterprise and external platforms.
• Perform ETL workflows, leveraging both advanced data manipulation tools and custom code, ensuring data is accessible and structured appropriately for all systems and stakeholders.
• Identify, analyze, and onboard new data sources, conducting exploratory analysis when necessary.

To be successful in this role you should meet the following requirements:

• Strong experience with SRE and Azure DevOps.
• Proficiency in scripting (Bash/PowerShell, Azure CLI), coding (Python, C#, Java), and querying (SQL, Kusto).
• Hands-on experience with PowerShell, Terraform, and object-oriented programming languages.
• Strong experience with cloud & big data technologies, including Azure Cloud, Azure IAM, Azure AD, Azure Data Factory, Databricks, Kubernetes, and PowerBI.
• Experience with server and infrastructure technologies like Nginx/Apache, CosmosDB, Linux, and tools such as Prometheus, Grafana, and Elasticsearch.

This role is based in Sheffield or Birmingham