Senior Data Engineer - Databricks
Posted Updated 9
views
Summary
Senior Data Engineer builds and maintains scalable data pipelines on Databricks, migrating legacy ETL to modern Delta Lake architecture while enforcing security, quality, and cost optimization.
- Apply CI CD best practices to pipeline delivery
- Build automation for data delivery
- Design Delta Lake architecture
- Enforce data security and access control
- Implement data quality monitoring and observability
- Implement multi tenant data isolation
- Ingest and transform ERP and CRM data at scale
- Integrate with product ecosystem pipelines
- Maintain SLA performance metrics
- Maintain documentation runbooks and ADRs
- Migrate legacy ETL ELT to Databricks
- Monitor pipelines and respond to incidents
- Optimize Databricks compute costs
- Own Databricks production support
- Participate in on-call rotation
- Provision and validate multi tenant tenant pipelines
Perks/Benefits:
- 401k match
- Educational resources
- Health insurance
- Legal services
- Paid Wellness Reimbursement
- Paid parental leave
- Referral bonus
- Travel discounts
- Unlimited paid time off