Data Engineer
Description
We are currently building our IT talent database and are looking to connect with experienced Data Engineers for current and future opportunities. We are particularly interested in professionals with experience in data ingestion, ETL/ELT, SQL, data modelling, orchestration and cloud data platforms. If you enjoy building scalable data solutions and improving data quality, we'd love to hear from you.
Job Experience & Skills Required / Ideal Candidate Profile
Key Responsibilities
- Develop and maintain reliable data pipelines for batch and/or streaming data ingestion.
- Build ETL/ELT processes and transform data for analytics, reporting and downstream applications.
- Design and optimise data models, database queries and data integration workflows.
- Monitor pipeline quality and performance, troubleshoot issues and document data processes.
Education
A degree, diploma or equivalent relevant qualification in Computer Science, Information Systems, Data Engineering or a related field is advantageous.
Relevant cloud, database or data engineering certifications will be advantageous.
Training in analytics platforms or data architecture will be beneficial.
Demonstrable hands-on data engineering experience is valued.
Experience
Typically 4+ years of experience in data engineering, ETL development or a closely related role.
Strong SQL skills and experience developing data pipelines or ETL/ELT processes.
Experience with relational databases, data modelling and data quality controls.
Cloud data platforms, Python, orchestration tools or streaming technologies will be highly advantageous.
Skills
SQL, data modelling and database performance awareness.
ETL/ELT, data ingestion, transformation and pipeline orchestration.
Python or another scripting language.
Cloud data services, data quality, monitoring and documentation.
Location: Gauteng