Software Engineer - Data Engineering
Summary
Build and maintain batch and streaming data pipelines for a quantitative trading firm, using Java/Scala, Spark, Kafka, and cloud infrastructure.
You expand the data platform, build batch and streaming pipelines, collaborate with Trading, Quant, Technology, and Business Operations teams, mentor junior engineers, produce tested and documented code, create automated data validation suites, and improve the technology stack.
Responsibilities
- Support the strategic role of data within the data engineering division
- Design and expand the data platform across streaming, operational, and research workflows
- Identify how data is produced and consumed and deliver high-impact projects
- Build and deploy batch and streaming data pipelines
- Mentor junior engineers in software and data engineering best practices
- Produce clean, tested, and documented code
- Build automated data validation test suites
- Improve the organization’s technology stack
Requirements
- BS, MS, or PhD in computer science, engineering, physics, mathematics, or an equivalent technical field
- 5+ years of professional experience developing software applications
- Java or Scala experience
- Experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, or Presto/Trino
- Experience building large-scale batch and streaming pipelines with SLA and data quality requirements
- AWS cloud development, deployment, and monitoring experience
- Experience with Agile software engineering practices, GitOps, and CI/CD
- Communication, analytical, and problem-solving skills
Benefits
- Employer-paid medical insurance
- Dental insurance
- Vision insurance
- Retirement contributions
- Paid time off
- Discretionary performance bonus