Lead Data Engineer

Lead Data Engineer 

Location:

City of London

Contract Type:

Temporary & Contract

Sector:

Software Development

Salary:

£500.00 - £550.00 Daily OUTSIDE IR35

Reference No.

BBBH489772


Contract Opportunity: Lead Data Engineer (Outside IR35)

Start Date: Immediate
Duration: 6–9 months (potential for extension)
Location: Remote-first (London-based candidates may be required to attend occasional client meetings, approximately 1–2 days per month)
Engagement Model: Contract Outside IR35

We are seeking an experienced Lead Data Engineer to join a high-performing business-as-usual (BAU) data team, reporting directly to the Chief Data Officer. This is a hands-on technical leadership role focused on engineering excellence, without line management responsibilities. You will guide a team of 4–5 senior data engineers and drive delivery across both new and existing data initiatives.


Key Responsibilities

  • Provide technical leadership across data engineering engagements
  • Collaborate with architects and stakeholders to design scalable data products
  • Lead the development and optimisation of data pipelines and models
  • Ensure best practices in data quality, governance, and performance
  • Support integration of real-time data and ML/AI workflows

Technical Requirements

  • Proven experience with cloud data warehouses (Databricks preferred; Snowflake also considered) on AWS
  • Strong Python engineering skills, including orchestration tooling
  • Proficiency in SQL, Spark, Airflow, and Terraform
  • CI/CD implementation experience using Git, Jenkins, or equivalent tools
  • Expertise in end-to-end data modelling—from conceptual design to performance tuning
  • Experience building DLT and DBT pipelines (or Snowflake equivalents)
  • Solid understanding of Kafka and real-time data integration frameworks
  • Ability to ingest, cleanse, and structure large-scale datasets from diverse sources
  • Exposure to Generative AI in production environments is advantageous
  • Prior experience in the insurance sector is beneficial

Interview Process

  • Two-stage process involving both consultancy and client stakeholders
  • Typically completed within 1–2 business days

Candidate Profile

We welcome applications from senior data engineering professionals with a track record of delivering robust, scalable solutions in cloud-native environments. Ideal candidates will demonstrate strong technical leadership, a collaborative mindset, and a commitment to clean, maintainable delivery.

To express interest or refer a candidate, please get in touch directly. Profiles and referrals are welcome.

Read More
APPLY NOW

Share this job

Interested in this job?
Save Job
Create As Alert

Similar Jobs

SCHEMA MARKUP ( This text will only show on the editor. )