Job Radar › All jobs

Senior Data Engineer

Company
ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.
Location
Singapore, Singapore
Salary
7 000–12 000 SGD/mo
Posted
2026-10-26

Skills: AWS, Databricks, Delta Lake

Senior Data Engineer – AWS / Databricks / PySpark

Role Overview

We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines and reusable data products on an AWS and Databricks-based data platform. The role involves technical leadership in data engineering, lakehouse architecture, data quality, governance and performance optimisation to support analytics, reporting and AI/ML workloads.

Key Responsibilities

• Design, develop and optimise scalable batch and streaming data pipelines using AWS, Databricks, Python, PySpark and SQL. • Build and maintain lakehouse architectures using Delta Lake, including Bronze, Silver and Gold data layers, curated datasets and reusable data products. • Implement data ingestion from databases, APIs, files and event streams, including incremental loading, Change Data Capture (CDC), backfills and recovery. • Establish automated data quality checks, schema validation, reconciliation, metadata management and data lineage. • Develop and automate data workflows using Databricks Workflows, Lakeflow and AWS services, incorporating CI/CD, automated testing and infrastructure as code. • Implement data governance, access controls and security measures using Unity Catalog, AWS Glue Data Catalog, Lake Formation and IAM. • Monitor pipeline performance, troubleshoot production issues and optimise Spark/SQL workloads for scalability, reliability and cost efficiency. • Lead technical design and code reviews,…

Full text and application on the employer's site.

Apply