Disclaimer: Hunt UK Visa Sponsors aggregates job listings from publicly available sources, such as search engines, to assist with your job hunting. We do not claim affiliation with US Tech Solutions. For the most up-to-date job details, please visit the official website by clicking "Apply Now."
We are seeking a Data Engineer / Software Engineer to support a pioneering project focused on LLM agents for research. You will play a key role in onboarding and filtering text, image, and video datasets used by our client’s research teams. The goal is to proactively mitigate risks associated with these datasets through effective engineering and automation.
This position offers the opportunity to work 100% on an AI-driven project, collaborating with researchers to build tools that allow intelligent agents to manage and improve datasets autonomously.
Responsibilities:
- Data Preprocessing: Transform raw datasets into formats suitable for filtering pipelines.
- Filtering: Clean, enhance, and filter data using client-provided pipelines.
- Post-processing: Apply filtering results to original datasets, repackage them, and support re-ingestion workflows.
- Collaborate with cross-functional teams to ensure data readiness and quality.
- Contribute to system design and pipeline automation efforts.
- Build and maintain Python-based data pipelines.
- Engage in technical discussions with researchers and stakeholders.
- Execute data mitigation and filtering tasks with minimal overhead.
- Develop tools that enable LLM agents to process and manage data automatically.
Required Skills & Qualifications
- Solid background in data engineering or software engineering.
- Proficient in Python and pipeline development.
- Experience with data cleaning, transformation, and validation.
- Understanding of modern data storage systems and formats.
- Strong communication and collaboration skills.
- Prior work with text, image, and video datasets.
- Familiarity with data risk mitigation practices.
Preferred Skills
- Experience using client-specific data pipelines or filtering frameworks.
- Knowledge of machine learning concepts.
- Exposure to front-end technologies like JavaScript is a plus.
- Background in research or AI/ML project environments is beneficial.
