Lead Data Engineer
Summary
Lead a data engineering team remotely, designing, building, and maintaining scalable ETL/ELT pipelines, data warehouses, and data lakes that serve data scientists and analysts. Core tech includes SQL, Python or Scala, Spark/Hadoop/Kafka, and cloud data platforms such as AWS Redshift, Azure Synapse, and GCP BigQuery.
About the Role
Our client is seeking an experienced and motivated Lead Data Engineer to build and manage their data infrastructure, working remotely to support operations near Kimberley . This role is crucial for designing, developing, and maintaining scalable data pipelines and systems that empower data scientists and analysts. You will lead a team, set technical direction, and ensure the reliability and efficiency of our data platforms. The ideal candidate possesses a deep understanding of data warehousing, ETL processes, and big data technologies, and is passionate about enabling data-driven insights in a fully remote setting.
Key Responsibilities
- Design, build, and maintain robust, scalable, and reliable data pipelines (ETL/ELT) using modern tools and technologies.
- Develop and manage data warehouses and data lakes, ensuring data quality, integrity, and accessibility.
- Lead and mentor a team of data engineers, providing technical guidance and fostering best practices.
- Optimize data processing performance and implement strategies for efficient data storage and retrieval.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
- Implement monitoring, alerting, and automated testing for data pipelines and infrastructure.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering, with at least 2 years in a lead or senior role.
- Strong proficiency in SQL and experience with at least one programming language like Python or Scala .
- Hands-on experience with big data technologies such as Spark, Hadoop, or Kafka .
- Experience with cloud data platforms (AWS Redshift, S3, Glue; Azure Data Lake, Synapse; GCP BigQuery ).
- Familiarity with data warehousing concepts, ETL/ELT tools, and data modeling techniques.
Benefits
- Excellent remote salary package with performance bonuses.
- Comprehensive health, dental, and vision insurance.
- Significant budget for professional development and attending industry events.
- Flexible remote working hours and a supportive team culture.
- Opportunity to work with a diverse range of data technologies and solve complex challenges.