Senior Data Engineer
- Company
- Cloud Raptor
- Location
- Bengaluru, India
- Salary
- 2 000 000–3 500 000 INR/yr
- Posted
- 2026-11-10
Skills: CI/CD, Data Modeling, dbt, ELT, ETL, Git, Observability, PySpark, Python, REST API, Snowflake, SQL, Automated Testing
Role & responsibilities :
• Design and deliver scalable pipelines. Build batch and near-real-time ETL/ELT pipelines using SQL, Python and PySpark, with Snowflake as a primary cloud data platform. • Engineer reliable data models. Create dimensional, normalized and analytical models that support efficient querying, traceability and reuse across enterprise reporting and analytics. • Own data quality by design. Implement automated profiling, schema checks, reconciliation, completeness, freshness, uniqueness and business-rule validation; publish quality results and route failures for action. • Build CI/CD for data products. Create and maintain automated build, test and deployment pipelines for SQL, dbt, orchestration code and infrastructure configuration, including version control, peer review, environment promotion and safe rollback. • Strengthen observability and operations. Monitor pipeline health, lineage, cost, performance and service-level objectives; troubleshoot incidents, perform root-cause analysis and eliminate recurring manual support. • Integrate diverse sources. Ingest and standardize data from databases, APIs, files and event sources, applying secure access patterns and appropriate handling for sensitive information. • Modernize legacy workflows. Migrate or refactor Informatica PowerCenter and other legacy ETL processes into maintainable cloud-native patterns using tools such as dbt and modern orchestration platforms. • Partner from requirement to adoption.…
Full text and application on the employer's site.