Job Radar › All jobs

Data Engineer (Python & Feature Store)

Company
Websensa
Location
Warsaw, Poland
Salary
80–140 PLN/h
Posted
2026-10-25

Skills: Airflow, ClickHouse, Delta Lake, Iceberg

Описание: We are looking for a Mid / Mid+ Data Engineer to join the team developing a Feature Store platform- a solution responsible for computing, storing, and serving features used by machine learning models. You will work on developing a production data platform, building and optimizing pipelines that process large volumes of information. Projects include retrieving data from analytical warehouses, distributed processing, preparing and storing data, and serving it to systems and ML models. Python is the main programming language, and our daily technologies include PySpark, Polars, Airflow, ClickHouse, Delta Lake, and Apache Iceberg. We also use Go in selected components. This role is for someone with strong Python skills and experience processing large datasets who wants to develop practical, prod

Задачи

• Design, develop, and maintain the Feature Store platform. • Build and develop data processing pipelines in Python. • Process large volumes of data using tools such as PySpark and Polars. • Integrate with data warehouses and analytical systems. • Prepare and store data in formats used in data lake and lakehouse architectures. • Orchestrate and automate data flows. • Develop components and services that support the data platform. • Prepare and serve features used by ML models, including in online scenarios. • Optimize the performance, cost, and scalability of data processing workflows. • Ensure data quality, correctness, and consistency, including validation, schema…

Full text and application on the employer's site.

Apply