Data Engineer

Salary: £37,000 - 77,000 per year

Requirements

• We need hands-on experience building and managing workloads on Databricks, including Delta Lake, Unity Catalog, and Declarative Automation Bundles. • We need proficiency in writing and optimising PySpark code for data transformation and processing. • We need solid experience working within the Azure ecosystem, including Azure Data Factory, Azure Data Lake Storage, and Azure DevOps. • We need experience with Azure SQL Server, as it forms the foundation of our existing data warehouse. • We need experience designing and maintaining pipelines using REST APIs, JSON, and ELT protocols. • We need comfort working with both relational and non-relational data technologies, with a solid grounding in data modelling principles. • Exposure to business intelligence tools like Power BI is desirable. • We need excellent communication and stakeholder engagement skills. • We need confidence working within an Agile framework, with an understanding of secure development practices and non-functional requirements such as scalability, performance, and access management. • We need an international mindset, sensitivity to local business priorities, and a collaborative approach.

Responsibilities

• We will expect you to take ownership of building, optimising, and maintaining data pipelines using PySpark. • We will expect you to orchestrate feeds from source systems through to our group data platform. • We will expect you to work as a technical…