Data Engineer – Databricks
Summary
Builds and optimizes data pipelines on Databricks, focusing on ETL/ELT workflows, data modeling, and performance improvements using Delta Live Tables and Structured Streaming.
- Apply data modeling and data warehousing best practices
- Build high-performance data pipelines
- Collaborate with stakeholders to deliver data solutions
- Design ETL ELT data pipelines
- Develop and manage data workflows and orchestration
- Develop and optimize data processing with Databricks
- Implement data integration and transformations
- Implement data quality and performance improvements
- Troubleshoot data pipeline issues
- Use Delta Live Tables Unity Catalog and Structured Streaming
- Use Git CI CD and DevOps for automated deployments
Perks/Benefits:
- Contract-to-hire
- Hybrid work onsite 3 days per week