Data Engineer (Clickstream Data)

Описание Vento is a service that standardizes and validates Allegro clickstream events. It supports high-quality data for AI agents and core business dashboards.

Задачи • Design, scale, develop, and maintain data validation pipelines for high-volume clickstream data within the Vento service • Implement anomaly detection mechanisms to ensure data integrity and quality before ingestion into the core Data Assets layer • Collaborate with cross-functional stakeholders to reconcile data requirements • Participate in engineering discussions, code reviews, and cross-team initiatives

Требования • Production-proven experience in Big Data ecosystems and building stable data pipelines • Proficiency in Python and Spark, with openness to working with Java backend applications • Understanding of data quality principles, event contract validation, anomaly detection, and streaming data processing • Openness to feedback, participation in code reviews, and willingness to develop skills • Proactive communication, ability to signal technical problems, and ownership of tasks with a high level of autonomy • Broad technical perspective and interest in how Big Data, Backend, and Frontend interconnect • Enthusiasm for using AI coding tools to automate repetitive tasks and optimize workflows • Polish at C1 level and English at B2 level • Будет плюсом: Scala

Условия • Flexible working hours; working hours start between 7:00 a.m. and 10:00 a.m • Hybrid schedule: 4/1, with 30 days of occasional remote…