Ab Initio Data Engineer
Summary
Designs and builds resilient, low-latency Ab Initio data pipelines with Kafka/MQ streams, stateful joins, and exactly-once processing for high-volume event-driven systems.
Key Responsibilities: Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations. Implement event-driven data pipelines using Kafka, MQ, and file streams. Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-once" processing. Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance. Proactively monitor live production streams to ensure 2…