Data Engineer

Minimum requirements:

• B Degree in Business Commerce/ Information Studies/ Information Technology
• 5 -7 years experience in building databases, warehouses, reporting and data integration solutions.
• Experience building and optimising big data data-pipelines, architectures and data sets. Experience in creating and integrating APIs.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• 8 -10 years understanding of data pipelining and performance optimisation, data principles, how data fits in an organisation, including customers, products and transactional information.
• Knowledge of integration patterns, styles, protocols and systems theory
• 8 -10 years experience in database programming languages including SQL, PL/SQL, SPARK and or appropriate data tooling.
• Experience with data pipeline and workflow management tools

Responsibilities:

• To develop and maintain complete data architecture across several application platforms, provide capability across application platforms.
• To design, build, operationalise, secure and monitor data pipelines and data stores to applicable architecture, solution designs, standards, policies and governance requirements thus making data accessible for the evaluation and optimisation for downstream use case consumption.
• To execute data engineering duties according to standards, frameworks, and roadmaps to develop and maintain complete data architecture across several application platforms, provide capability across application platforms.
• To design, build, operationalise, secure and monitor data pipelines and data stores to applicable architecture, solution designs, standards, policies and governance requirements thus making data accessible for the evaluation and optimisation for downstream use case consumption.
• To execute data engineering duties according to standards, frameworks, and roadmaps