Senior data engineer
Summary
Senior Data Engineer based out of Mahikeng (fully remote) who designs, builds, and maintains ETL/ELT pipelines and cloud data warehouses/lakes to support analytics and machine learning. Core stack includes SQL, Python or Scala, Spark/Hadoop, and cloud platforms like AWS Redshift, Snowflake, and BigQuery.
Our client is seeking an experienced Senior Data Engineer to join their growing data platform team in Mahikeng. This role is critical for designing, building, and maintaining robust data pipelines and infrastructure that support the organization's data analytics and machine learning initiatives. You will work with large-scale datasets, ensuring data quality, reliability, and accessibility. The ideal candidate is proficient in data warehousing, ETL processes, and cloud-based data solutions, with a passion for enabling data-driven insights.
Key Responsibilities Design, build, and optimize scalable ETL/ELT pipelines for ingesting and transforming data from various sources. Develop and maintain data warehouses and data lakes using cloud technologies (e.g., AWS Redshift , Snowflake , Big Query ). Ensure data quality, integrity, and consistency across all data platforms. Collaborate with data scientists and analysts to understand their data needs and provide efficient data solutions. Implement data governance and security best practices. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Requirements Bachelor's degree in Computer Science, Engineering, or a related quantitative field. 5+ years of experience in data engineering or a related role. Strong proficiency in SQL and experience with relational and No SQL databases. Expertise in programming languages such as Python or Scala for data manipulation and pipeline development. Hands-on experience with cloud data platforms and big data technologies (e.g., Spark, Hadoop). Experience with ETL tools and data warehousing concepts. Benefits Competitive salary and annual bonus structure. Comprehensive health, dental, and vision coverage. Retirement savings plan with employer matching. Opportunities for professional development and training in data technologies. A fully remote work environment, offering maximum flexibility, based out of Mahikeng. Work on challenging projects involving big data and cutting-edge analytics tools.