Junior data engineer
Summary
Junior data engineer at betting software company BETSoftware (Gauteng, South Africa, on-site), building and supporting batch data pipelines: writing SQL, assisting with ETL/ELT and data validation, monitoring scheduled runs, and documenting flows. Stack includes SQL Server, Python, Airflow, Git/Azure DevOps, Spark, Kafka, and ClickHouse.
The platform may include a combination of established and modern technologies such as, SQL Server, Python, Airflow, Azure Dev Ops / Git, Spark or Py Spark, Object storage, Iceberg, Kafka, or Redpanda, Click House or similar columnar analytical stores and CI/CD tooling and engineering workflows.
Qualifications Degree, diploma, or relevant certification in IT, Computer Science, Engineering, Information Systems, or a related technical discipline. Minimum 1+ years proven experience in data engineering, software development, ETL/ELT, database development, or a related technical role. Foundational SQL skills, including writing queries, joining datasets, and working with basic transformations. Some exposure to Python, data processing, scripting, or automation. Understanding of relational databases and structured data concepts. Willingness to learn modern data platform tools, engineering practices, and production support processes. Technical SkillsYou have a basic working understanding of:
SQL and data querying fundamentals. Relational databases and structured data handling. Data pipelines, ETL/ELT, or batch-processing concepts. Debugging and troubleshooting technical issues. Version control concepts such as Git. Exposure To The Following Would Be Advantageous Python or similar scripting languages. Data warehousing, dimensional modelling, or analytical data concepts. Workflow orchestration tools such as Airflow or SQL Server Agent. Cloud or on-premises object storage concepts. Distributed processing, streaming, or lakehouse concepts. Tools such as Spark, Py Spark, Kafka, Redpanda, Click House, Iceberg, or Delta Lake. Platform & Engineering Practices Interest in learning monitoring, alerting, observability, and operational support for data workloads. Exposure to CI/CD, deployment automation, or engineering workflows is beneficial. Comfort working with documentation, runbooks, and team standards. Personal Attributes Positive learning mindset and willingness to ask questions. Strong sense of accountability and follow-through. Good problem-solving and communication skills. Comfortable collaborating with both technical and non-technical stakeholders. Attention to detail and willingness to work carefully with business-critical data. Motivation to build a long-term career in data engineering. Living the Spirit Engages in cross-functional collaboration and problem solving while contributing to an inclusive team culture. Supports a culture of adaptability and shared accountability across the department and wider business. Shows up authentically and contributes to team success by working effectively with diverse colleagues and perspectives. Approaches challenges as opportunities to learn, improve, and help others grow.