Streaming Data Engineer
- Company
- MEEDEN LABS PRIVATE LIMITED
- Location
- Bengaluru, India
- Salary
- 1 600 000–3 200 000 INR/yr
- Posted
- 2026-11-14
Skills: ArgoCD, CI/CD, Docker, ELK, Flink, GitOps, Grafana, Jenkins, Kafka, Kubernetes, Prometheus, PySpark, Python
We are seeking an experienced Streaming Data Engineer with a strong background in Apache Kafka and real-time stream processing. The ideal candidate will have hands-on experience in managing enterprise Kafka clusters, developing real-time streaming applications, and integrating Kafka with various data platforms. This role requires expertise in configuring, managing, and optimizing Kafka clusters to ensure high availability and fault tolerance in enterprise environments.
Key Responsibilities include: 1. Kafka Cluster Management: Configure, manage, and optimize enterprise Apache Kafka clusters. Manage Kafka topics, partitions, consumer groups, offsets, and replication configurations to ensure reliability and performance. 2. Real-Time Stream Processing: Design and develop real-time data processing applications using Kafka Streams, ksqlDB, or Apache Flink. Build and maintain event-driven data pipelines for high-volume data processing, optimizing for performance and low latency. 3. System Integration: Integrate Kafka with enterprise data stores and external systems, utilizing Kafka Connect and various connectors. Develop reliable data ingestion and distribution pipelines to ensure data consistency across systems. 4. CI/CD and Deployment Automation: Build and maintain automated CI/CD pipelines using tools like Jenkins and ArgoCD. Implement GitOps practices for deployment and configuration management, leveraging Docker and Kubernetes for containerization. 5. Monitoring and…
Full text and application on the employer's site.