Location: UK (Remote)
Department: Engineering
Hours: Full-time
About YLD:
Everything we do is to empower our clients to move forward. Our
purpose is to help our clients develop the capabilities they need to outperform their competitors. Our
success is a consequence of ensuring our clients are successful. Our
company is built on extraordinary people; we aim to attract, inspire, develop and retain them. YLD is a software engineering and design consultancy; we create digital capabilities for our clients that last beyond our engagement. We have offices in London, Lisbon, Porto.
About the role:
As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.
Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, and data streaming for soft real-time consumption while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach & mentor other engineers to support the growth of their technical expertise.
Technical competencies:
- Proven experience writing highly maintainable, performant Python and JavaScript code;
- Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar);
- Understanding of Data Modelling patterns;
- Deep knowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance;
- Experience with end-to-end monitoring & alerting experience (CloudWatch, Datadog, etc.).