Skip to content

Vivanti Consulting

NewBe an early applicant

Senior Data Engineer Consultant

Posted Updated
Discussion
Find people

Description

What you'll do:

  • Design and build robust data pipelines using Databricks, Spark, and Delta Lake.
  • Implement scalable and secure Lakehouse architectures on Databricks.
  • Collaborate with analysts, ML engineers, and platform teams to deliver Databricks-native solutions.
  • Apply best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem.
  • Ensure data platform systems are secure, reliable, and cost-effective.


What You Will Bring:

  • We are looking for critical thinkers who love untangling complex architectures.
  • 8+ years of experience using Python, Spark, and SQL to build scalable data pipelines in Databricks.
  • Deep hands-on experience with Delta Lake, Unity Catalog, and MLflow.
  • Production experience with workflow orchestration tools like Airflow or Databricks Workflows.
  • Integration experience with modern data stack automation (dbt, Fivetran, Terraform).
  • Familiarity across major cloud platforms (Azure, AWS, or GCP).
  • Strong grasp of data modeling techniques (Inmon, Data Vault, Kimball).
  • Solid understanding of the data lifecycle, governance, and platform optimization techniques.

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply