Azure Platform & Data Engineer
Summary
Remote B2B contract role (>12 months) for a dairy-industry client: the engineer designs and maintains Azure platform infrastructure (networking, storage, security, IAM) with Terraform, administers Databricks, builds CI/CD pipelines in Azure DevOps, and develops data pipelines with PySpark, SQL, Data Factory, and Data Lake.
Work model: remote.
Rate: B2B: up to 185 zl/h.
Start: ASAP
Project length: > 12 months + possible extensions
Project language: English + Polish
Industry: dairy
Recruitment process: 2 interviews with the client.
Workload: full-time (40 hours per week).
Summary:
The main function of the Azure Platform & Data Engineer role is to manage and enhance the Azure infrastructure and platform capabilities while also engaging in data engineering activities as needed. The primary objective is to ensure reliable, efficient data workflows and environment stabilization within the Azure ecosystem.
Main Responsibilities:
Design, build, and maintain Azure-based platform services and infrastructure.
Define and maintain Infrastructure-as-Code standards using Terraform.
Manage Azure networking, storage, security, identity, and access management.
Troubleshoot infrastructure and platform-related issues.
Drive automation and standardization across development and operational environments.
Manage and maintain Databricks workspaces and related services.
Configure and govern clusters, access controls, and workspace standards.
Support platform performance, reliability, and operational stability.
Establish best practices for Databricks usage and deployment.
Develop and maintain CI/CD pipelines in Azure DevOps.
Automate platform provisioning and deployment processes.
Support release management and environment governance.
Improve monitoring, logging, and operational tooling.
Develop and maintain data ingestion and transformation pipelines.
Work with Azure Data Factory, Databricks, and Data Lake technologies.
Build and optimize ETL/ELT processes.
Support data integration from internal and external source systems.
Key Requirements:
Strong experience with Terraform.
Experience in Azure Infrastructure management.
Knowledge of Azure Networking.
Proficiency in Azure Storage solutions.
Understanding of Azure Security & IAM.
Experience with Azure DevOps, GitHub, and GitHub Actions.
CI/CD experience.
Proficiency in Pyspark and SQL.
Nice to Have:
Experience with Databricks Administration.
Familiarity with Databricks Automation Bundles.
Experience leveraging Azure Data Factory.
Knowledge of Data Lake Architecture.
Other Details:
Category: Role Focus; Detail: Platform-focused engineer.
Category: Skill Distribution; Detail: 35% Azure Platform & Infrastructure, 20% Terraform, 20% Databricks Administration, 25% Data Engineering.