Data Engineer
Posted 6
views
Summary
Senior data engineer (5-10 yrs) in Johannesburg who designs Kimball-methodology data warehouses and builds ETL pipelines, working with SQL (ideally SAS Data Studio), AWS, Python or R, and file formats like CSV/JSON. Role covers data quality assurance, documentation, dimensional database design, and stakeholder communication.
Minimum Requirements:
- 3 Year IT related degree
- Post graduate qualification (advantageous)
- 5-10 Years experience and understanding in designing and developing data warehouses according to the Kimball methodology
- Adept at design and development of ETL processes
- SQL development experience, preferably SAS data studio and AWS experience
- Ability to ingest/output CSV, JSON and other flat file types and any related data sources
- Proficient in Python or R
- Experience within Retail, Financial Services and Logistics environments
- Ensure highest data quality assurance, data accuracy, and data completeness through regular and in-depth review and testing of work
- Create easily understandable technical documentation that are kept up to date
- Conduct data design, database architecture, metadata and repository creation activities and tasks as required by business Stakeholder
- Translate business needs into long-term architecture solutions
- Define, design, and build dimensional databases
- Design the ETL pipelines
- Develop data warehousing blueprints, evaluating hardware and software platforms, and integrating systems
- Evaluate reusability of current data for additional analysis
- Translate Meta data into explanatory reports and visuals for easy understanding to end user
- Perform data pre-processing which includes data manipulation, transformation, normalisation, standardisation, visualisation, and derivation of new variables/features, as applicable to developing specific algorithms or models
- Build data quality metrics and conduct data validation testing
- Follow the IT governance process when implementing a change to ensure governance standards and protocols are followed
- Provide feedback to business owners on identified problems to ensure quality of data is rectified
- Conduct training and upskilling on new reports and or self-service analytics platforms to relevant Stakeholders
- Communicate with Stakeholders to keep them abreast of current developments within the function and to manage expectations
- Deal effectively and timeously with Customer complaints and ensure that complaints are resolved or escalated in line with agreed standards
- Deliver services and products to the customer within the parameters of the agreed SLA
- Only if you meet the minimum job requirements and experience as mentioned above, you may submit a detailed updated CV.
- Please Apply Online and complete your registration via our website to enable and protect you as a candidate and to accept the new POPIA terms and conditions.
- This will then create your permanent profile with which you can apply for all jobs as advertised by AJ PERSONNEL.
- However, you may remove your profile from AJ PERSONNEL when you are no longer in the job market.
- Please take note that the applicants who do not adhere to the minimum requirements will not be considered for the respective position.
- Note our clients may expire jobs at their own discretion.
- AJ PERSONNEL will only respond to shortlisted candidates.
- If you have not received a response within two (2) weeks from applying, your application was then unsuccessful for that specific position, however your profile remains on our system for future opportunities.