Data Engineer

Описание Put your expertise to work for a digitally sovereign Europe! As a Senior (Sovereign) Data Engineer, you will work on a data platform built entirely from open-source components. You will retrieve data from source systems, model and transform it, and deliver the datasets, dashboards and data products our customers actually use to make decisions. The platform will remain European and open source; your task is to ensure it delivers value.

Задачи • Build batch ingestion from source systems using dlt or comparable declarative tooling, with data as open Parquet on object storage. • Model and transform data with dbt and SQL into a layered lakehouse on Apache Iceberg, Delta Lake or DuckLake tables, orchestrated with Airflow or Dagster. • Query and expose data with Trino, DuckDB or PostgreSQL, and deliver the consumption layer through Apache Superset dashboards, notebooks and data APIs. • Build data quality and governance directly into the pipeline — with dbt tests, data contracts and lineage in OpenMetadata or DataHub. • Be the technical point of contact for the customer and take responsibility for progress, quality and content.

Требования • At least 5 years of experience as a data engineer and a completed relevant bachelor's or master's degree. • Strong knowledge of Python and SQL, with code that colleagues can read and test. Demonstrable experience with data products on Free and Open Source data systems, not only on a managed platform. • Experience with dbt and an…