Lead Data Engineer (AWS / AI / SQL)

Salary: £70,000 - 90,000 per year

Requirements:

• We are looking for an experienced Data Engineer who has built and operated complete data platforms rather than solely delivering individual components. • Experience across batch data processing, ELT and orchestration. • Experience with modern streaming technologies such as Flink or comparable platforms. • Experience with AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. • Experience with infrastructure as code using Terraform. • Experience with CI/CD and automated testing. • Experience with lakehouse architecture and open table formats such as Iceberg. • Experience with medallion architecture and dimensional data modelling. • Strong SQL and Python skills. • Experience with SQL Server, SSIS/SSDT and Power BI. • Experience with semantic layers, common metrics and data glossaries. • Experience with data governance, lineage, retention, classification and auditability. • Experience managing and developing a small technical team. • Comfortable using advanced AI coding assistants, such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security. • Desirable experience in a regulated environment. • Desirable experience with PySpark for large-scale data transformations. • Desirable experience migrating legacy data estates to lakehouse or metadata-driven architectures. • Desirable experience with Customer Data Platforms or…