Senior Data Engineer

Senior Data Engineer, 6 months, London/Hybrid, £600 - £660/day (INSIDE IR35)

Energy/Trading experience is a MUST.

Job Summary:

We are looking for a highly skilled Senior Data Engineer with strong analytical skill, problem solving capabilities and hands-on experience in building scalable data solutions. The ideal candidate will have expertise in Python, Databricks: PySpak, streaming architectures, data ingestion frameworks, and Performance/Cost Optimization Technique, along with experience working with SAP, ETRM data sources would be an added advantage. The candidate will be responsible for designing and implementing scalable data pipelines and enabling real-time, batch analytics and across the program.

Key Responsibilities:

• Design and implement scalable data pipelines using Databricks and Delta Live Tables (DLT). • Develop and manage streaming data