Data Reliability Engineer: Python Pipelines & Production
Posted Updated
Description
Susquehanna is seeking a Data Reliability Engineer to safeguard Python data pipelines and trading workflows across ingestion, streaming, and batch jobs. You will validate datasets, diagnose anomalies, and implement fixes with cross-team collaboration to keep downstream systems healthy.
Responsibilities include building data onboarding tooling, managing releases via GitLab and Octopus Deploy, and providing incident support with a strong emphasis on SLA adherence in a fast-paced trading
Engineer and maintain data ingestion tooling and automated Python workflows. Analyse data, validate against expectations, and help researchers shape data for models. Investigate discrepancies upstream, identify root causes, and collaborate across teams. Provide proactive oversight of scheduled jobs and pipelines; triage, troubleshoot, and resolve incidents within SLA. Release: review changes and coordinate risk-aware deployments via GitLab and Octopus Deploy. 2+ years in a data engineering, data science, or production-support role, or a degree in a technical or data discipline. Demonstrated experience with Python (or a comparable language). Experience with at least one SQL variant (PostgreSQL, MSSQL, MySQL), and the ability to pick up others as needed. Strong analytical and troubleshooting skills; detail-oriented, self-motivated, and curious. Willingness to work shifts: the team works an alternating weekday early/late shift rotation, with participation in an on-call rota. Exposure to change-management and incident-management practices. Comfortable with technical documentation and handling support cases. Comfortable working in both Windows and Linux environments.Skills
Sign in to read and join the discussion.