Databricks Data Engineer
Summary
Build and optimize data pipelines on Databricks, troubleshoot data quality issues, and document workflows while collaborating with cross-functional teams.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Develop and optimize data pipelines to ensure efficient data flow and processing.
- Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.
- Document data processes and workflows to ensure clarity and compliance with best practices.
Responsibilities
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Develop and optimize data pipelines to ensure efficient data flow and processing.
- Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.
- Document data processes and workflows to ensure clarity and compliance with best practices.
Qualifications
- Expert proficiency in Databricks Unified Data Analytics Platform.
- Experience with Python (Programming Language).
- Strong understanding of data modeling and database design principles.
- Experience with ETL tools and data integration techniques.
- Familiarity with cloud platforms and services related to data engineering.
- Proficient in data warehousing concepts and practices.