Lead Data Engineer - Azure Databricks & GenAI
Summary
Senior/Lead Data Engineer in Wrocław migrating large-scale data workflows to an Azure-native Databricks environment, building PySpark/Delta ETL pipelines, automating deployments, and supporting GenAI integration and data governance. Core stack: Python, Spark, Delta, Docker, Kubernetes, Terraform, GitLab CI/CD.
Your Jared in Wrocław, Poland is seeking a Senior/Lead Data Software Engineer to migrate large-scale data workflows to an Azure-native Databricks environment and build robust PySpark/Delta ETL pipelines. You will optimize data quality, automate deployment, and support GenAI integration and governance initiatives.
The role requires 3+ years in data engineering, strong Python and Spark skills, and experience with Delta tables, Docker, Kubernetes, Terraform, and GitLab CI/CD.