Senior Data Engineer
Summary
A senior data engineer who designs, builds, and maintains scalable ETL/ELT pipelines, data warehouses/lakes, and data-quality processes for a client's analytics team in Paarl. The core stack spans SQL databases (PostgreSQL, SQL Server, Snowflake), Python or Scala/Java, big data tools like Spark, Hadoop, and Kafka, and cloud data services on AWS, Azure, or GCP.
About the Role
Our client is seeking a highly skilled Senior Data Engineer to join their growing analytics team in Paarl . This role is pivotal in designing, building, and maintaining scalable data pipelines and infrastructure that support the organization's data-driven initiatives. You will work with large volumes of data, implementing robust ETL processes, ensuring data quality, and optimizing data warehousing solutions. The ideal candidate possesses a strong understanding of data architecture, excellent programming skills, and a passion for transforming raw data into actionable insights that drive business growth in the beautiful Western Cape region.
Key Responsibilities
- Design, develop, and optimize robust and scalable data pipelines (ETL/ELT) to ingest and process data from various sources.
- Build and maintain data warehouses, data lakes, and other data storage solutions.
- Ensure data quality, integrity, and security across all data platforms.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Implement data modeling best practices and standards.
- Monitor data systems performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
- 5+ years of experience in data engineering, with a focus on building and managing large-scale data infrastructure.
- Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, SQL Server, Snowflake).
- Strong programming skills in Python or Scala/Java.
- Experience with big data technologies such as Spark, Hadoop, Kafka.
- Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
Benefits
- Competitive salary and attractive bonus structure.
- Comprehensive health, dental, and vision insurance.
- Hybrid work model offering a flexible work environment.
- Opportunities for professional development, including training and certifications.
- Collaborative team environment focused on innovation and data excellence in Paarl .