Databricks Data Engineer
Posted 2
views
Summary
Data engineer acting as a subject-matter expert who builds and optimizes Databricks data pipelines, monitors and fixes data quality issues, and documents workflows while guiding team decisions. Core stack: Databricks, Python, ETL/integration tools, cloud data services, and data warehousing.
Job Description:
Responsibilities
- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Develop and optimize data pipelines to ensure efficient data flow and processing.
- Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.
- Document data processes and workflows to ensure clarity and compliance with best practices.
Qualifications
- Expert proficiency in Databricks Unified Data Analytics Platform.
- Experience with Python (Programming Language).
- Strong understanding of data modeling and database design principles.
- Experience with ETL tools and data integration techniques.
- Familiarity with cloud platforms and services related to data engineering.
- Proficient in data warehousing concepts and practices.