Copyright © 2025
Disclaimer: Hunt UK Visa Sponsors aggregates job listings from publicly available sources, such as search engines, to assist with your job hunting. We do not claim affiliation with Ubique Systems. For the most up-to-date job details, please visit the official website by clicking "Apply Now."
· Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related activities for supporting the key capabilities
o Technical Data Architecture
o Data Ingestion framework ( Batch/ Micro Batch processing )
o Data Contract & Data management( including DQ, metadata & lineage)
o Delivery, Scaling & Op Model
· Discovery/ assessment along with the Data platform requirements
oIdentify and document the relevant data sources to be used for collection & ingestion, cataloging , defining Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation
o Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/ framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/ technical requirements for both batch and micro-batch processing.
· Define the E2E Data architecture framework
· Define Solution patterns for Data collection & ingestion, Data transformation and curation and Data consumption layer using native GCP data services, e.g Cloud Datafusion, Dataproc, Dataflow, Dataplex, Data streams and BQ
· Define the Solution design to support Self service ingestion capability of the CSV files for the business users including any ad hoc demand for Data Processing.
· Support the Automation Code samples and examples produced during MVP phase to address Data pipeline build including Data Platform capabilities