AI Data Engineering Lead
Ideagen
2 days ago
Full Time
Remote
United Kingdom
Role Purpose
Location- Ruddington, Nottinghamshire
Level - Professional
Department - Product R&D
Working Pattern - Remote unless based locally
Benefits - Benefits at Ideagen
Salary - To be discussed at next stage
Mazlan+ Models is Ideagen’s programme to build domain‑specific AI models for regulated industries, where the quality of data directly determines the quality of outcomes. As AI Data Engineering Lead, you will own the data foundation every model is built on and shape how trusted AI is delivered at scale. This is a leadership role combining strategy, architecture, and governance with hands‑on impact across sourcing, transforming, versioning, and preparing high‑value regulated data for training. You will lead a growing team of data engineers and work closely with AI engineering, legal, and domain experts to ensure our models are accurate, compliant, and ready for real‑world use.
Responsibilities
- Leading and developing a team of AI data engineers, setting clear technical standards, supporting career growth, and scaling the function as the programme grows
- Defining the technical direction for AI data engineering, including architecture decisions, tooling choices, and delivery practices across the organisation
- Designing and building the end‑to‑end AI data platform, from operational product data and regulatory sources through cloud storage and transformation pipelines to training‑ready datasets
- Owning dataset versioning and lineage so every training artefact is traceable, reproducible, and auditable across the full model lifecycle
- Building and maintaining large‑scale regulatory and operational corpora in collaboration with domain experts, ensuring data quality and consistency
- Architecting and operating AWS‑based data infrastructure at production scale with a focus on reliability, security, and performance
- Defining and enforcing data governance standards, including quality checks, labelling conventions, and data handling frameworks
- Leading GDPR compliance for AI training data in partnership with Legal and ensuring best practice is embedded from the start
Skills and Experience
- You are a senior data engineer or technical lead with prior experience leading teams and owning large data platforms end to end
- You have deep production experience with Python and SQL and write data transformation code that is robust, readable, and reusable
- You have designed and run AWS data stacks at scale, including services such as S3, Glue, Athena, Kinesis, Lambda, and IAM
- You understand ML training data pipelines and know how they differ from analytics workloads, including dataset formats, splits, and quality constraints
- You bring strong data governance instincts and design for versioning, lineage, and auditability from day one
- You are comfortable working with legal and compliance partners on sensitive data handling and regulatory requirements
- You communicate clearly across disciplines and work effectively with AI engineers, product leaders, and domain specialists
- Experience with NLP or LLM training data, data version control tools, or regulated industry software is valuable but not essential
About Ideagen
Ideagen is the invisible force behind many things we rely on every day - from keeping airplanes soaring in the sky, to ensuring the food on our tables is safe, to helping doctors and nurses care for the sick. So, when you think of Ideagen, think of it as the silent teammate that's always working behind the scenes to help those people who make our lives safer and better. Everyday millions of people are kept safe using Ideagen software. We have offices all over the world including America, Australia, Malaysia and India with people doing lots of different and exciting jobs.
We’re building a future-ready team, and AI is part of how we work smarter. If you're curious, adaptable and open to using AI to improve how you work, you’ll thrive at Ideagen!
What is next?
If your application meets the requirements for this role, our Talent Acquisition team will be in touch to guide you through the next steps.
To ensure a flexible and inclusive process, please let us know if you require any reasonable adjustments by contacting us at recruitment@ideagen.com. All matters will be treated with strict confidence.
At Ideagen, we value the importance of work-life balance and welcome candidates seeking flexible arrangements. If this is something you are interested in, please let us know during the application process. Enhance your career and make the world a safer place!
#INDMP
#LI-NOTTINGHAM
#LI-REMOTE