Senior Data Engineer
- Company
- ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.
- Location
- Singapore, Singapore
- Salary
- 7 000–12 000 SGD/mo
- Posted
- 2026-10-26
Skills: AWS, Databricks, Delta Lake
Senior Data Engineer – AWS / Databricks / PySpark
Role Overview
We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines and reusable data products on an AWS and Databricks-based data platform. The role involves technical leadership in data engineering, lakehouse architecture, data quality, governance and performance optimisation to support analytics, reporting and AI/ML workloads.
Key Responsibilities
• Design, develop and optimise scalable batch and streaming data pipelines using AWS, Databricks, Python, PySpark and SQL. • Build and maintain lakehouse architectures using Delta Lake, including Bronze, Silver and Gold data layers, curated datasets and reusable data products. • Implement data ingestion from databases, APIs, files and event streams, including incremental loading, Change Data Capture (CDC), backfills and recovery. • Establish automated data quality checks, schema validation, reconciliation, metadata management and data lineage. • Develop and automate data workflows using Databricks Workflows, Lakeflow and AWS services, incorporating CI/CD, automated testing and infrastructure as code. • Implement data governance, access controls and security measures using Unity Catalog, AWS Glue Data Catalog, Lake Formation and IAM. • Monitor pipeline performance, troubleshoot production issues and optimise Spark/SQL workloads for scalability, reliability and cost efficiency. • Lead technical design and code reviews,…
Full text and application on the employer's site.