Senior Data Engineer
We are seeking a Senior Data Engineer to design, build, and scale enterprise‑grade data integration and ingestion platforms within the financial services and capital markets domain. The role requires multi‑pattern data engineering expertise, supporting complex data movement, real‑time and batch ingestion, and Change Data Capture (CDC) architectures across heterogeneous source systems into a modern data platform built on Microsoft Fabric.
This is not a single‑tool or single‑pattern role. The ideal candidate is a cross‑pattern data engineer who can work fluently across relational databases, managed SQL services, blob/object storage, and flat‑file‑based integrations while ensuring performance, scalability, and data consistency at enterprise scale.
Required Skills & Experience:
- Strong experience as a Senior Data Engineer working on enterprise‑scale data platforms.
- Proven expertise in multi‑pattern data engineering, not limited to a single tool or technology.
- Hands‑on experience with multiple source systems:
- Relational Databases: Oracle, MySQL, PostgreSQL
- Managed SQL Services: Azure SQL Managed Instance
- Storage: Blob/Object storage, flat files
- Deep understanding of CDC/CDF concepts, including:
- Primary key–based change tracking
- Timestamp‑based capture
- Log‑based change capture
- Latency and performance considerations under scale
- Experience designing pipelines that handle high data volumes and evolving performance requirements.
- Strong SQL skills and understanding of data modeling for analytical platforms.
- Experience integrating data pipelines into Microsoft Fabric or comparable modern data platforms.
- Ability to work across teams and domains in a regulated, data‑intensive financial environment.
Nice to Have:
- Experience in capital markets, financial data platforms, or market data systems.
- Exposure to real‑time or near‑real‑time ingestion patterns.
- Familiarity with cloud‑native monitoring, observability, and data quality frameworks.