Cloud data engineer
Summary
Designs and builds secure, scalable cloud data pipelines and platforms using Azure, Databricks, PySpark, and Kafka to power analytics and AI.
We're seeking an experienced Cloud Data Engineer to design, build, and optimise enterprise-scale cloud data platforms and high-performance data pipelines that power analytics, AI, and real-time business insights.
You'll work with modern Azure data technologies to build secure, scalable, and governed data solutions while driving Data Ops, automation, and cloud platform optimisation. Key Responsibilities Design, build, and maintain enterprise-scale data pipelines using Ab Initio, Microsoft Fabric, Databricks, Python, Py Spark, and Apache Spar Design and develop enterprise data pipelines and cloud data solutions. Build batch and streaming data processing frameworks. Implement Data Ops, CI/CD, automation, and orchestration. Ensure data quality, governance, metadata, and lineage. Optimise cloud data platforms for performance, scalability, and reliability. Collaborate with Data Scientists, Architects, and business stakeholders. Support AI and advanced analytics initiatives. Bachelor's Degree in Computer Science, IT, Engineering, or related field. 3+ years in Cloud Data Engineering or Data Engineering. Experience with Microsoft Fabric, Azure Data Factory, Databricks, and Azure Synapse. Strong Python and Py Spark development. Experience building enterprise ETL/ELT and streaming pipelines. Experience with Kafka or Azure Event Hub. Experience with CI/CD, Data Ops, and Infrastructure as Code. Required Skills Microsoft Fabric Databricks Python Py Spark Kafka SQL Data Ops CI/CD ETL/ELT Data Warehousing Data Lakes Infrastructure as Code Data Governance #J-18808-Ljbffr