Cloud Data Engineer
Summary
Designs and builds secure, scalable cloud data pipelines and platforms in Azure to power analytics and AI for a leading bank in Sandton.
Are you passionate about cloud technologies, big data, and building modern data platforms? We're looking for an experienced Cloud Data Engineer to join a leading bank in Sandton and help deliver enterprise-scale cloud data solutions that power analytics, AI, and business decision-making.
If you enjoy designing high-performance data pipelines, working with Azure cloud technologies, and transforming complex data into valuable business insights, this opportunity is for you.
What You'll Be Doing
As a Cloud Data Engineer, you will be responsible for designing, building, and optimising secure, scalable cloud-based data platforms and pipelines that support the bank's data-driven strategy.
Your Responsibilities Will Include
- Designing and developing scalable cloud data pipelines for batch and real-time processing.
- Building robust ETL/ELT solutions using Azure and modern data engineering technologies.
- Developing and maintaining enterprise Data Lakes and Data Warehouses.
- Working with Microsoft Fabric, Azure Data Factory, Databricks and Azure cloud services.
- Developing data ingestion frameworks for structured, semi-structured and unstructured data.
- Implementing DataOps practices, CI/CD pipelines and workflow orchestration.
- Ensuring data quality, governance, lineage and metadata management.
- Collaborating with Software Engineers, Data Scientists, Architects and business stakeholders to deliver scalable data products.
- Supporting cloud security, data privacy and POPIA compliance.
- Monitoring and optimising cloud data platforms for performance, scalability and reliability.
- Contributing to platform innovation, automation and continuous improvement.
- Bachelor's Degree in Information Technology, Computer Science or a related field.
- 2-5 years' experience in Data Engineering, Business Intelligence or Software Engineering.
- Experience building enterprise cloud data solutions.
- Experience working in Agile delivery environments.
Experience With Most Of The Following Technologies
- Microsoft Azure
- Microsoft Fabric
- Azure Data Factory
- Azure Databricks
- Python
- PySpark
- Apache Spark
- SQL
- Data Warehousing
- Data Lakes
- ETL / ELT Development
- CI/CD
- DataOps
- Infrastructure as Code (IaC)
- Kafka or Azure Event Hub
- Real-time and streaming data processing
- Metadata Management
- Data Quality & Data Governance
- Ab Initio
- Azure Synapse
- SAS
- Denodo
- DB2 Warehouse
- Netezza