Data Platform Engineer (Team Lead)
Posted Updated
Description
Data Platform Engineer (Team Lead)
Company: Walnutt
Job Location: Navi Mumbai, Maharashtra, India
Employment Type: Full-time
Experience Required: 7 - 8 years
Company:
Hiring for an NBFC building its lending platform
Location:
Navi Mumbai (Onsite)
CTC:
50 LPA fixed
Notice Period:
Up to 30 days
About the role
This role is for a hands-on data engineer who has built CDC pipelines from operational databases into a lakehouse and has run Databricks in production. As Data Platform Team Lead, youll own the Databricks lakehouse and the pipelines that feed it. Those pipelines bring in data from the companys Loan Origination System (LOS) on PostgreSQL and from vendor databases. The data serves reporting, risk, collections, finance and regulatory teams. Youll also lead a small team of data engineers.
What youll do
Lead the Databricks lakehouse: ingestion, Delta Lake tables, transformations, orchestration, data quality, Unity Catalog governance and keeping compute costs under control
Design and run reliable CDC from the LOS Postgres database, and ingestion from vendor databases, into Databricks
Own data contracts, PII/audit requirements, reconciliation, lineage and schema-change management
Lead and mentor the team, make the architecture calls, and set priorities with application, product, risk and business teams
What were looking for
7-8 years in data engineering or data platform roles, including leading or mentoring engineers
Hands-on Databricks in production: Spark, Delta Lake, Unity Catalog and Workflows
Youve built CDC or ingestion from operational databases into a lakehouse (e.g. logical replication, Debezium or DMS into Delta/S3)
Good understanding of PostgreSQL as a CDC source, including logical replication and handling schema changes
Strong SQL and Python (Scala is a plus)
Apply
Submit your profile via Walnutt ( select target role as Data Engineer (L3) ): https://app.walnutt.co .
Skills
Sign in to read and join the discussion.