Senior Data Engineer
Posted Updated
Description
HR On Site is seeking a seasoned Data Engineer to design, build, and monitor data pipelines and data solutions. You will work across cloud data services, optimize SQL queries, and implement ETL processes that ensure data availability and quality for business insights.
The role requires 5+ years in data engineering, experience with Azure and multiple DBMS, and strong scripting and documentation skills. This is an on-site position based in Milnerton, Western Cape.
Design, develop, schedule, deploy, and monitor data pipelines. Optimize, improve, and validate data pipelines. Design and deploy data table structures, forms, reports, and queries. Produce ad-hoc queries and develop reports for business needs. Develop security-aware cloud data solutions. Process data into Parquet, JSON, Avro formats. Apply engines to data processing (Graph, Relational, NoSQL). Create and maintain technical documentation. Support data architecture initiatives and strategies. Engage with business stakeholders on data initiatives. Bachelor’s degree in a data-focused field or equivalent. Minimum 5 years as a data engineer with visual pipeline designers (SSIS, Talend, Informatica, or Azure Data Factory). Minimum 2 years data engineering in a commercial cloud environment like Azure. Advanced SQL skills and query optimization experience. Experience with multiple DBMS (PostgreSQL, MySQL, MSSQL). Experience in ETL development, data loading from diverse sources, and data governance.Skills
Sign in to read and join the discussion.