Senior Data Engineer Consultant
Posted Updated
Description
What you'll do:
- Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
- Implement scalable and secure Lakehouse architectures on Databricks.
- Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
- Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
- Ensure data platform systems are secure, reliable, and cost-effective.
What You Will Bring:
- We are looking for critical thinkers who love untangling complex architectures.
- 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
- Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
- Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
- Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
- Familiarity across major cloud platforms (Azure, AWS, or GCP).
- Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
- Solid understanding of the data lifecycle, governance, and platform optimization techniques.