Data Engineer
Summary
Build and optimize cloud-scale data pipelines using PySpark, Parquet, and Iceberg to power portfolio analytics for a fintech team.
We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats.
Key Responsibilities
- Develop and optimize Spark workloads in cloud environments
- Work with large datasets using Parquet and Iceberg
- Translate requirements into robust engineering solutions
- Ensure performance, reliability, and maintainability
- Contribute to monitoring, documentation, and deployment
Must Have
- Strong Python and PySpark
- Hands‑on Apache Spark, cloud preferred
- Databricks experience
- Large‑scale data systems expertise
- Client‑facing delivery background
- Independent problem‑solving in ambiguous settings
Nice To Have
- AWS Glue and Lake Formation
- Airflow and orchestration tools
- Distributed data architectures
- Capital markets exposure