Senior Data Engineer (Databricks)
Summary
Designs and builds scalable data pipelines on Databricks for financial time-series analytics, using Delta Lake, PySpark, and Unity Catalog.
Required Qualifications · Data Engineering : Proven track record of architectural ownership and end-to-end system design. · Production Databricks Depth : Extensive experience with Delta Lake, Spark (PySpark & Spark SQL), Unity Catalog, job orchestration, and performance tuning (partitioning, clustering, Z-ordering, file compaction). · Financial Time-Series Domain Expertise : Strong understanding of structured finance instruments (ABS/MBS, loan-level data, cash flow analytics) and time-series co…