Data Integration Engineer NiFi & Kafka (m/w)
Summary
Design, build and operate Apache NiFi ETL pipelines and Kafka producers/consumers that move data between source and target systems, ensuring integrity through reconciliation, error handling and schema validation (JSON, XML, Avro). Requires hands-on NiFi/Kafka experience, Oracle PL/SQL and Azure Dataverse exposure, and fluent German and English.
Location: ZurichWorkload: Full-timeStart: By agreementYour tasks:You analyse source and target systems and derive precise data mapping strategies for direct interfaces and Kafka-based publish/subscribe scenarios.You design, develop and configure Apache NiFi pipelines including custom processor configuration and flow design.You implement Kafka producers and consumers that follow existing topic structures and partitioning strategies.You ensure data integrity and completeness through reconciliation processes, error handling and performant pipeline design.You work closely with cross-functional parties in the Release Train to keep data flows testable and consistent.You create documentation for the implemented pipelines, including data flow diagrams, schema definitions and operating manuals.Your profile:Proven hands-on experience building productive Apache NiFi ETL pipelinesSolid understanding and implementation experience with event-driven architectureExperience with point-to-point ETL in batch or near-real-time environmentsProven ability to guarantee data integrity between source and target systemsProficiency in schema validation using JSON, XML and AvroHands-on Kafka integration experienceExperience with Azure Integration (Dataverse), Oracle DB/PL-SQL and ODS/DWHBasic Java knowledgeExperience with CI/CD for NiFi and Kafka as well as Change Data CaptureFluent in German and EnglishYour benefits:A culture of purpose and value - as a team you deliver solutions that make a real differenceKnowledge sharing with colleagues and clients across projectsTalent Academy supporting your individual career path, innovation and creativityA company committed to sustainability, social responsibility and strong business ethics
- Apache
- Oracle
- ETL
- JAVA
- XML
- JSON