Data Engineer
- Company
- Syntax Consultancy Ltd
- Location
- Derby, United Kingdom
- Salary
- 60 000–65 000 £/yr
- Posted
- 2026-11-13
Skills: AWS, Databricks, Delta Lake, Hive, PySpark, Python, Spark, SQL
Salary: £60,000 - 65,000 per year
Requirements:
• Were looking for strong hands-on experience with Databricks, AWS, Python, PySpark and SQL. • We need experience with Databricks notebooks, scheduled jobs, cluster configuration, driver and executor logs, Spark UI, and performance troubleshooting. • Were looking for experience with Spark SQL, Delta Lake, Parquet, Hive metastore tables, schemas, partitions, and the relationship between table metadata and underlying files. • We need hands-on AWS experience, particularly with S3, IAM and CloudWatch, plus an understanding of role-based access, KMS encryption, and diagnosing data access failures. • Were looking for a working knowledge of Git, code reviews, CI/CD, and controlled production deployments, including testing, rollback and release validation. • Experience with AWS Glue, Lambda, Step Functions, Linux, shell scripts, Terraform, GitLab or Jenkins would be advantageous.
Responsibilities:
• We need you to run and maintain production data pipelines on Databricks and AWS. • Youll keep scheduled data processing reliable, resolve incidents, apply fixes, and improve data service performance. • Youll provide a combination of L2/L3 production support and data engineering. • Youll support and maintain production data pipelines, including incident investigation, safe recovery, root cause analysis and permanent remediation. • Youll own incidents from investigation through recovery and closure, diagnosing issues in Python, PySpark,…
Full text and application on the employer's site.