freehire launches on Product Hunt on 26 August.

Follow →

Senior Backend Engineer. High-Performance Data Streaming

Summary

Senior backend engineer at Zibra AI building a high-performance data streaming service using Python, HTTP/3, QUIC, and object storage for large datasets.

We are looking for a senior backend engineer to build a high-performance service for streaming large datasets.

This is not a conventional CRUD backend role. You will work on persistent HTTP/3 connections, asynchronous I/O, object-storage range reads, binary data transfer, authentication, request scheduling, etc.

What you will do
Design and build the data-streaming service in Python.
Implement HTTP/3 and QUIC-based client-server communication.
Integrate with S3-compatible object storage.
Build request prioritisation, cancellation, retries, caching, and backpressure.
Implement token-based authentication and fine-grained access control.
Integrate Python services with native libraries and binary data formats.
Add metrics, tracing, load testing, and failure recovery.
Work closely with desktop visualisation and Python/ML client teams.
Benchmark streaming performance against download-first workflows.

What we are looking for
Strong production experience with Python.
Experience with asynchronous Python, task scheduling, and concurrent I/O.
Experience building high-throughput or low-latency backend systems.
Good understanding of networking, HTTP, TLS, and binary protocols.
Practical knowledge of S3, MinIO, Ceph, or similar object storage.
Experience with streaming I/O, byte-range reads, caching, and memory management.
Strong performance-profiling and debugging skills.
Ability to design stable interfaces between independently developed systems.

Nice to have
Production experience with C++.
Experience with HTTP/3, QUIC, WebTransport, or high-performance RPC.
Background in distributed storage, CDNs, databases, filesystems, or media streaming.
Familiarity with scientific visualisation, HPC, simulation, or large multidimensional datasets.
Experience with CUDA or GPU data pipelines.
Experience with OAuth, OIDC, JWT, and capability-based access.
Knowledge of Kubernetes and OpenTelemetry.

See also