Data Engineer

Описание The Fund operates the compulsory medical insurance system and ensures the provision of medical care to the population.

Задачи • Build and develop the data layer for the Fund’s unified AI platform • Integrate the DWH, internal information systems, documents, and other data sources • Develop ETL/ELT pipelines, data marts, and data quality control mechanisms • Prepare reproducible training datasets and features for ML models • Prepare and maintain production data delivery pipelines in collaboration with MLOps/LLMOps • Form RAG sources from regulations, internal documents, knowledge bases, and metadata; update and index documents • Organize access control, data storage, and auditing

Требования • 4+ Years of experience as a Data Engineer • Proficient in SQL and Python • Experience designing DWH, data marts, and integration solutions • Practical experience building ETL/ELT pipelines using Airflow, Dagster, Prefect, or similar tools • Knowledge of PostgreSQL, ClickHouse, MS SQL, Oracle, or similar DBMS • Experience working with APIs, message queues, and file storage • Understanding of data quality, data lineage, metadata management, and data access • Experience processing unstructured documents and preparing data for search/RAG • Будет плюсом: experience with Kafka, Debezium, dbt, Spark, and MinIO/S3; experience with Qdrant, OpenSearch/Elasticsearch, or other search and vector databases; experience working with government, medical, or insurance data; understanding of…