Data Engineer
Posted Updated 8
views
Description
Location: Cape Town | Work Type: Hybrid | Job ID: J107289
About our client:
Our client is a highly successful and purpose-driven group with a global shared services hub based in Cape Town. They are far more than a travel company; they act as a vital platform connecting world-class hospitality with large-scale environmental impact across Africa’s most iconic wilderness areas. The organization prides itself on a culture of continuous improvement and ethical behavior, where the mission is to ensure that natural ecosystems and local communities thrive together. You will join a collaborative, friendly team that avoids rigid hierarchies and values individual contribution. While they "think big" and move fast to protect vulnerable landscapes, they are deeply employee-centric, offering unusually generous benefits and a genuine commitment to work/life balance. This is an opportunity to bring your expertise to a stable yet growing organization where profit meets a profound sense of purpose. They are looking for adaptable, long-term partners who are ready to help drive positive change at scale.
What you will be doing:
- Translate requirements into practical designs and manage data products from build through to production support.
- Build and maintain batch, incremental, and change-data-capture pipelines from various sources.
- Develop tested, modular data models that analysts and Power BI users can trust.
- Deliver scalable, resilient, and cost-efficient changes to the data platform for analytics and AI.
- Implement automated testing, monitoring, lineage, access controls, CI/CD, and infrastructure as code.
What our client is looking for:
- A relevant tertiary qualification would be ideal(Computer Science, Information Systems, Engineering, etc.).
- 4+ years in data or software engineering, including ownership of production data pipelines.
- Advanced SQL expertise with complex querying and performance tuning, alongside strong Python skills for writing clean, testable code.
- Background in SQL Server and T-SQL, including troubleshooting and reverse-engineering SSIS packages and SQL Server Agent jobs.
- Proficiency in dimensional modelling, star and snowflake schemas, medallion architecture, and layered warehouse design.
- Cloud platform experience, specifically hands-on work with AWS services like S3, Glue (Python/PySpark), and Lambda.
- Experience managing deployments from development to production using version control and GitHub.
- Background in monitoring production workloads, handling alerting, and conducting root-cause analysis.
- Strong grasp of data-quality testing, lineage, access control, privacy, AI integration using LLMs, and supporting Power BI workloads.
Would would be advantageous:
- Proficiency in Snowflake development, including stages, Snowpipe, streams, tasks, role-based access control, and warehouse cost and performance management.
- Experience with workflow automation and orchestration tools (e.g., Apache Airflow, dbt, Dagster, AWS Step Functions) and managed ingestion or CDC tools (e.g., Fivetran, Airbyte, AWS DMS).
- Capability in enforcing fine-grained access control, privacy/PII detection, metadata management (Data Mesh principles), and Infrastructure as Code using Terraform, AWS CDK, or CloudFormation.
- Possession of relevant cloud or data certifications such as AWS Certified Data Engineer, AWS Solutions Architect, SnowPro Core, or dbt certification.
For a more comprehensive list of opportunities that we have on offer, do visit our website -
Requirements
Data Engineer, Python, SQL, AWS, S3, Glue, Lambda, Snowflake, Airflow, dbt, T-SQL, SSIS, GitHub, Terraform, CI/CD, Data Governance, PII, Power BI
Skills
- AI
- Airbyte
- Airflow
- Analytics
- Automation
- AWS
- CDK
- CI/CD
- Cloud
- CloudFormation
- Dagster
- Data Governance
- Data Mesh
- Data Pipelines
- Data Quality
- dbt
- Dimensional Modeling
- Fivetran
- GitHub
- Infrastructure as Code
- Lambda
- LLM
- Medallion Architecture
- Metadata Management
- Performance Management
- Power BI
- PySpark
- Python
- Reverse Engineering
- Root Cause Analysis
- S3
- Snowflake
- SQL
- SQL Server
- SSIS
- AWS Step Functions
- Terraform
- Test Automation
- Version Control