Data Engineer

Описание Data Insight Consulting is a specialized Databricks and Microsoft Azure consultancy based in Hamburg. It combines data engineering, modern data architecture, business intelligence, and AI for companies across the DACH region.

Задачи • Design and implement Databricks and Azure Lakehouse solutions, from connecting data sources to making data available for analytics and AI • Develop production-ready pipelines with Python, PySpark, and SQL; improve existing solutions and establish testing, monitoring, and automated deployments • Make clear decisions about data models, processing, and interfaces, accounting for maintainability, performance, and costs • Implement data quality checks, access control concepts, and traceable data management, for example with Unity Catalog • Translate business requirements into actionable work packages, explain technical options, and make effort and risks transparent to customers • Support colleagues through reviews and knowledge sharing, and enable customer teams to further develop solutions • Contribute to technical standards, reusable solutions, and the further development of the consulting offering

Требования • Extensive practical data engineering experience and responsibility for production data solutions • Substantial project experience with Databricks and Microsoft Azure, particularly building or developing data platforms • Strong Python/PySpark and SQL skills • Experience with Lakehouse architectures, Delta Lake, and data modeling •…