Senior Data Engineer (Azure Databricks)

📋 Senior Data Engineer (Azure Databricks & DevOps, Remote, US Project) 🏢 DATAI SERVICES MCHJ 💰 1,500–4,000 USD (gross) Опыт: От 3 до 6 лет Формат работы (hh.ru): удалённая работа Требуемые языки (hh.ru): Английский — C1 📍 Ташкент

Senior Data Engineer (Azure Databricks & DevOps) — remote, US-based project, US business hours. English: Advanced / Fluent (required).

We are looking for an experienced Senior Data Engineer to join a US-based project. You will work closely with US-based engineers and stakeholders to build, maintain and improve scalable data platforms.

Responsibilities:

• Build and optimize large-scale data pipelines on Azure Databricks (PySpark, Delta Lake) • Design reliable ETL/ELT ingestion and transformation processes • Set up CI/CD and automated deployments (Git, Azure DevOps, Jenkins, Databricks Asset Bundles) • Ensure data quality: validation, testing, monitoring, troubleshooting production pipelines • Integrate external systems via REST APIs • Support deployments across dev, test and production; resolve production issues • Communicate directly with US clients and stakeholders

Requirements:

• Strong hands-on Azure Databricks: Jobs, Workflows, Unity Catalog, Delta Lake, Databricks Asset Bundles (DAB) • Advanced Python and SQL; PySpark / Apache Spark • Good understanding of Azure services, cloud infrastructure, networking and security • DevOps and CI/CD: Git, Azure DevOps, Jenkins, release management • SDLC, Agile, version control; production support…