Data Platform Engineer

Salary: £55,000 - 55,000 per year

Requirements:

• A degree or equivalent experience in Computer Science, Data/Software Engineering or a similar subject, with a strong foundation in core database systems and data structures. • Proficiency in Databricks and big data coding languages, including SQL, Python and Scala. • Experience designing and deploying ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics or equivalent tools in AWS/GCP. • Strong engineering skills, with the ability to write clean, maintainable code, and test and document your work effectively. • Strong communication and collaboration skills, with the ability to explain technical trade-offs clearly and work effectively across teams and departments. • Right to work in the UK is an essential requirement - we do not provide sponsorship.

Responsibilities:

• Design, build and operate secure, reliable and cost-effective data pipelines using Azure services and Databricks. • Ingest and transform data from different sources, handling changes in data and schemas effectively. • Improve pipeline performance, reliability and cost, while automating tasks and maintaining clear technical documentation. • Build data quality checks, validation and reconciliation, and contribute to metadata, data lineage and governance requirements. • Use Git, code reviews, CI/CD and Infrastructure-as-Code to deliver safe, repeatable changes, supported by effective monitoring, runbooks and deployment evidence. • Work closely…