Contract Opportunity: Lead Data Engineer (Outside IR35)
Start Date:
Immediate
Duration:
6–9 months (potential for extension)
Location:
Remote-first (London-based candidates may be required to attend occasional client meetings, approximately 1–2 days per month)
Engagement Model:
Contract Outside IR35
We are seeking an experienced Lead Data Engineer to join a high-performing business-as-usual (BAU) data team, reporting directly to the Chief Data Officer. This is a hands-on technical leadership role focused on engineering excellence, without line management responsibilities. You will guide a team of 4–5 senior data engineers and drive delivery across both new and existing data initiatives.
Key Responsibilities
- Provide technical leadership across data engineering engagements
- Collaborate with architects and stakeholders to design scalable data products
- Lead the development and optimisation of data pipelines and models
- Ensure best practices in data quality, governance, and performance
- Support integration of real-time data and ML/AI workflows
Technical Requirements
- Proven experience with cloud data warehouses (Databricks preferred; Snowflake also considered) on AWS
- Strong Python engineering skills, including orchestration tooling
- Proficiency in SQL, Spark, Airflow, and Terraform
- CI/CD implementation experience using Git, Jenkins, or equivalent tools
- Expertise in end-to-end data modelling—from conceptual design to performance tuning
- Experience building DLT and DBT pipelines (or Snowflake equivalents)
- Solid understanding of Kafka and real-time data integration frameworks
- Ability to ingest, cleanse, and structure large-scale datasets from diverse sources
- Exposure to Generative AI in production environments is advantageous
- Prior experience in the insurance sector is beneficial
Interview Process
- Two-stage process involving both consultancy and client stakeholders
- Typically completed within 1–2 business days
Candidate Profile
We welcome applications from senior data engineering professionals with a track record of delivering robust, scalable solutions in cloud-native environments. Ideal candidates will demonstrate strong technical leadership, a collaborative mindset, and a commitment to clean, maintainable delivery.
To express interest or refer a candidate, please get in touch directly. Profiles and referrals are welcome.