Data Engineering Lead (AWS & AI)

Salary: £70,000 - 95,000 per year

Requirements:

• You are an experienced Data Engineer or Data Engineering Lead who has built and operated complete data platforms, not just individual components. • You combine strong technical knowledge with the confidence to make architectural decisions, lead change, and determine when existing technology should be evolved or replaced. • Your experience includes batch processing, data warehousing, ELT, and orchestration. • You have experience with modern streaming technologies such as Flink or comparable platforms. • You have production AWS data engineering experience. • You have hands-on experience with AWS services including S3, Lambda, Glue, Athena, Kinesis, RDS, IAM, and CloudWatch. • You have experience with lakehouse architectures and open table formats such as Iceberg. • You have experience with medallion-style data layering and dimensional modelling. • You have strong SQL and Python development skills. • You have infrastructure-as-code experience using Terraform. • You have experience with CI/CD, automated testing, and modern engineering practices. • You have experience with SQL Server, SSIS/SSDT, and Power BI. • You have experience with semantic models, shared metrics, and data glossaries. • You have experience with data governance, retention, lineage, classification, and auditability. • You have experience managing, mentoring, or developing Data Engineers. • You are comfortable using advanced AI coding assistants such as Claude…