Data Engineer - Databricks
Posted Updated 22
views
Description
This is a remote position.
We are looking for a Data Engineer with strong Databricks experience to join our growing Data & AI Practice. The role involves migrating client data estates from legacy platforms to Databricks, building scalable and metadata-driven data pipelines, implementing Unity Catalog governance, managing CI/CD processes, and supporting Databricks platforms in production.
You will work closely with client stakeholders and senior engineers to deliver high-quality data solutions, contribute to technical documentation and code reviews, and help build reusable Databricks engineering assets.
Requirements
- Bachelor's degree in Computer Science, IT, or a related discipline.
- 2–5 years of Data Engineering experience, including at least 18 months of Databricks experience.
- Databricks Certified Data Engineer Associate certification; Professional certification preferred.
- Strong expertise in PySpark, Advanced SQL and Delta Lake.
- Experience with Medallion Architecture, Data Modeling, Auto Loader, Delta Live Tables/Lakeflow and Databricks Workflows.
- Proficiency in software engineering practices, Git-based development and cloud platforms such as Azure or AWS.
- Experience in data migration, metadata-driven pipelines, Unity Catalog, CI/CD and Databricks Asset Bundles.
- Knowledge of Databricks SQL, Structured Streaming, automated testing, performance optimization, MLflow and Generative AI is desirable.
- Strong analytical, problem-solving, communication and collaboration skills.
- Ability to take ownership of delivery and troubleshoot production data platforms.
Benefits
- Open and transparent work culture
- Opportunity to work on global client projects
- Flexible work-from-home environment
- Competitive compensation and benefits
- Collaborative and learning-focused culture
- Sponsored Databricks certifications
- Exposure to end-to-end Databricks implementations
- Clear career growth and development path