Principal Data Engineer

We're looking for a Principal Data Engineer to design, build, and scale the data pipelines that bring data into our platform and make it ready for analytics. You'll work across the full pipeline lifecycle — from raw ingestion of heterogeneous sources through staging and curated layers — while playing a leading role in setting technical direction for our broader data infrastructure. You'll partner closely with fellow data engineers, data modelers, analysts, and product teams on what gets built next, and help raise the technical bar across the team.

What you'll get to do:

• Move data through the full pipeline lifecycle — raw/src, staging, and curated layers — applying appropriate transformation, validation, and testing at each stage to prepare data for analytics consumption • Build and maintain Azure Data Factory (ADF) pipelines to orchestrate ingestion and transformation across source, curated, and serving layers • Design ingestion patterns for a range of raw source formats — REST/SOAP APIs, flat files (CSV, fixed-width), JSON, and XML — landing them reliably into the src layer before transformation • Build resilient API extraction logic handling pagination, rate limiting, incremental/delta pulls, and schema drift from third-party sources • Parse and flatten semi-structured JSON payloads (nested objects, arrays) into queryable relational structures within Snowflake • Handle file-based ingestion at scale — SFTP/blob drops, file validation, schema enforcement, and…