Data Engineer
Posted Updated
Description
Swan iT Recruitment Ltd is seeking a Data Engineer in Cape Town to design and maintain scalable data pipelines and ETL processes that consolidate data from diverse sources into a centralized data warehouse or data lake.
You will build data models, ensure data quality, collaborate with analysts, and monitor performance and security of data systems while adopting new technologies. The role requires Python and SQL expertise and a postgraduate degree in CS/IS/Maths/Stats/Business/Actuarial.
Design and develop scalable data pipelines and ETL processes to collect, process and integrate data into a central data warehouse or data lake. Implement data models, schemas and database structures to optimize data storage for efficient retrieval, writing and analysis. Collaborate with analysts to understand data requirements and provide infrastructure and tools for data exploration and visualization. Ensure data quality and consistency via validation, cleaning and transformation procedures. Monitor and maintain performance, availability, and security of data systems and processing frameworks. Up to 3 years’ experience with database management, data analysis and ETL at scale. Basic understanding of financial instruments and markets. Exceptional skill and experience in Python and SQL.Skills
Sign in to read and join the discussion.