Databricks Data Engineer | Senior
Posted Updated
Description
Jobgether in Brazil seeks a Senior Databricks Data Engineer to design, develop, and optimize scalable data pipelines. You will leverage PySpark, Spark SQL, Delta Lake, and Medallion architecture to build Lakehouse solutions on Azure, implement CDC and Structured Streaming, and ensure data quality, governance, and cost efficiency.
You will mentor engineers, drive best practices, manage Databricks Workflows and CI/CD, and collaborate with stakeholders to deliver reliable production data platforms.
Design, develop, implement, and continuously improve data engineering solutions using the Databricks ecosystem. Define and implement scalable data architectures based on Lakehouse principles and Medallion architecture (Bronze, Silver, Gold). Develop, optimize, and maintain data pipelines using Databricks, PySpark, Spark SQL, Apache Spark, and Delta Lake. Establish and maintain data governance, security, lineage, and access control standards. Extensive professional experience delivering and maintaining production-grade data engineering solutions using Databricks. Advanced proficiency in PySpark, Spark SQL, Delta Lake, and Apache Spark. Hands-on experience with Delta Live Tables (DLT) / Lakehouse pipelines, CDC, and Structured Streaming. Strong knowledge of Unity Catalog, including data governance, security, lineage, and access management. Healthcare: Medical and dental Remote work support: Home office Welcome kit Life insurance Mental health resources Professional developmentSkills
Sign in to read and join the discussion.