Cloud Engineer

What you will be doing:

• Design, develop, and maintain robust, scalable, and fault-tolerant data pipelines for structured, semi-structured, and unstructured data.
• Build and optimise enterprise data solutions using technologies such as Microsoft Fabric, Azure Databricks, Apache Spark, Python, Scala, and Ab Initio.
• Develop high-performance ETL/ELT pipelines to support enterprise Data Warehouses and Data Lakes.
• Implement DataOps best practices, including automation, orchestration, testing, and CI/CD for batch and streaming data workloads.
• Collaborate with software engineering teams to design and implement secure APIs and data services for real-time data consumption.
• Design, build, and manage hybrid cloud data platforms using Microsoft Azure technologies and on-premises data platforms where required.
• Apply Infrastructure as Code (IaC) principles to automate cloud infrastructure deployment and management.
• Establish monitoring, observability, and performance management across enterprise data platforms.
• Partner with Information Security, Data Governance, and Architecture teams to implement data security controls, masking, anonymisation, and POPIA compliance.
• Lead proof of concepts and technical evaluations of emerging data engineering technologies and cloud services.
• Embed automated data quality, validation, reconciliation, auditing, and lineage within enterprise data pipelines.
• Maintain technical and operational metadata to support enterprise data governance.
• Partner with Data Governance teams to implement master data management and enterprise data quality standards.
• Perform data profiling, root cause analysis, and continuous improvement initiatives to maintain high-quality data products.
• Work closely with business stakeholders, data scientists, analysts, and architects to translate business requirements into scalable technical solutions.
• Take ownership of the full lifecycle of enterprise data products from design through production support.
• Provide Level 2 and Level 3 support for complex production incidents and data platform issues.
• Participate in Agile ceremonies including sprint planning, backlog refinement, and delivery.
• Drive continuous improvement of engineering standards, platform performance, and development practices.
• Mentor junior engineers and contribute to technical capability development across the team.
• Research and recommend emerging cloud and data engineering technologies to support innovation.

What we are looking for:

• Completed Degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• 2 - 5 years' experience within an IT, Business Intelligence, Data Engineering, or Cloud Engineering environment.
• Experience designing and implementing enterprise-scale cloud data solutions.
• Strong understanding of Data Warehousing, Data Lakes, ETL/ELT processes, and modern data architecture.
• Experience building scalable cloud-native data platforms using Microsoft Azure.
• Knowledge of DataOps, CI/CD, Infrastructure as Code, and Agile delivery methodologies.
• Experience working with enterprise data governance, metadata management, and data quality frameworks.
• Understanding of cloud security principles and regulatory compliance, including POPIA.
• Experience coordinating technical activities and mentoring junior team members is advantageous.
• Excellent analytical, problem-solving, communication, and stakeholder management skills.

Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful.

Please note that most of our positions are remote however candidates should be residing within the traveling distance as circumstance of the opportunity can change.
Follow for the Latest Vacancies
Join Psybergate Careers Channel here: