Full-time · Hybrid

Senior Data Engineer

This is a pivotal senior role for a technical expert ready to lead the architectural evolution of a major UK food manufacturer's data platform. You will balance hands-on engineering with strategic leadership, overseeing a modern Azure stack and driving best practices in DevOps and data governance. It offers the rare combination of remote work flexibility with the tangible impact of visiting physical production sites.

TC
Hiring company

The Compleat Food Group

London, England, United Kingdom · Posted 1 May 2026

The role

Overview

This is a pivotal senior role for a technical expert ready to lead the architectural evolution of a major UK food manufacturer's data platform. You will balance hands-on engineering with strategic leadership, overseeing a modern Azure stack and driving best practices in DevOps and data governance. It offers the rare combination of remote work flexibility with the tangible impact of visiting physical production sites.

The hiring side

About The Compleat Food Group

The Compleat Food Group is a large employer working in food manufacturing, based in London, England, United Kingdom.

Industry

Food Manufacturing

Size

Large

Location

London, England, United Kingdom

Go deeper

See The Compleat Food Group the way an insider would

Unlock company research, key people to know, recent moves, and how this role fits into their wider picture.

Research The Compleat Food Group

What they need

Requirements & Skills

Key Responsibilities

  • Lead the design and delivery of scalable ELT/ETL pipelines using modern patterns
  • Architect and optimize real-time and batch data workflows using Airflow and dbt
  • Manage Azure cloud infrastructure including Synapse and Event Hubs
  • Implement CI/CD pipelines and Infrastructure-as-Code (Terraform/Bicep)
  • Ensure data security, privacy, and GDPR compliance across all solutions
  • Mentor junior engineers and establish engineering standards
  • Integrate complex ERP systems and external data sources into the central platform

Essential

  • Minimum of 7 years of professional experience in data engineering
  • Proven track record in senior or lead-level technical delivery
  • Expert-level proficiency in SQL and Python
  • Extensive experience with Azure data services including ADF, Synapse, and Event Hub
  • Experience with Infrastructure-as-Code tools like Terraform or Bicep
  • Ability to travel regularly to various company sites across the UK

Preferred

  • Experience with ERP platform integrations such as Infor M3 or ION
  • Familiarity with data quality frameworks like Great Expectations
  • Knowledge of modern orchestration tools like Airflow or dbt Cloud
  • Understanding of food manufacturing or supply chain data

Key Skills

Data ArchitectureETL/ELT Pipeline DesignAzure Data Lake Storage (ADLS)CI/CD and DevOpsData Governance and GDPR ComplianceMicro-batch and Real-time ProcessingJSON/XML/Avro/Parquet formatsTechnical MentoringStakeholder Management

Networking

People to Know

Sign up to discover hiring managers, team leads, and key people at The Compleat Food Group.

Perks

Benefits & perks

  • Competitive salary of £80,000
  • Permanent contract stability
  • Home-based working flexibility
  • Opportunity to lead a major cloud data transformation
  • Exposure to diverse national manufacturing operations
  • Professional development and mentoring opportunities

Next step

Apply now

Found via www.compleatfood.com

We use cookies to improve your experience

We use essential cookies for functionality and analytics cookies to understand how you use Career Steer and improve our services. You can manage your preferences or learn more in our Privacy Policy.

Senior Data Engineer at The Compleat Food Group - London, England, United Kingdom | Career Steer