Lead Data Engineer
- Company
- Solve It Consultant
- Location
- Remote, Gurugram, India
- Salary
- 1 000 000–2 000 000 INR/yr
- Posted
- 2026-11-12
Skills: Airflow, AWS, Azure, Azure Data Factory, BigQuery, CI/CD, Data Governance, Data Lake, Data Modeling, Data Vault, Databricks, ELT
Job Description: Principal / Lead Data Engineer (PySpark, SQL)
Role & Requirements Overview
Exp: 10+ Years
Role Overview
We are seeking a highly experienced and motivated Principal / Lead Data Engineer to join our dynamic data platform team in either our Gurgaon or Chennai office. The successful candidate will be a critical player in designing, building, and optimizing our next-generation data architecture and pipelines.
This role requires expert-level proficiency in PySpark and SQL, alongside a proven track record of architecting scalable, high-performance ETL/ELT processes. You will transform vast amounts of raw data into high-quality, actionable insights for analytics, reporting, and Machine Learning. Given the seniority of this role, we are looking for a seasoned leader and immediate joiner who can hit the ground running and contribute significantly from day one.
Key Responsibilities
Data Pipeline Development & Optimization
• Design and Build: Architect, develop, and maintain robust, scalable, and fault-tolerant ETL/ELT pipelines for ingesting data from diverse sources (e.g., databases, APIs, streaming sources) into our data lake and data warehouse. • PySpark Expertise: Write and optimize complex data transformation jobs using PySpark and the Spark DataFrame API to process petabytes of structured and unstructured data efficiently. • SQL Mastery: Utilize Advanced SQL for complex querying, data manipulation, stored procedures, performance tuning, and optimizing…
Full text and application on the employer's site.