Senior Data Engineer
Posted Updated
Description
The candidate will have responsibilities across the following functions:
Infrastructure Maintenance and Optimisation:
- Design and review data pipeline diagrams for both client and internal projects.
- Build data pipelines by writing clean, efficient SQL queries for data analysis and quality checks.
- Monitor data pipeline performance and infrastructure costs, proactively resolving issues and identifying opportunities to improve reliability, efficiency, and cost-effectiveness.
- Maintain and upgrade Goalkeep's internal tech infrastructure.
Tech Leadership and Team Enablement:
- Provide technical guidance, troubleshooting support, and coaching to strengthen data analysts' skills so that they can successfully deliver on client projects.
- Create technical documentation, troubleshooting guides and reusable resources that improve team efficiency.
- Foster a culture of curiosity, continuous learning and knowledge sharing across the team.
AI-Enabled Data Engineering and Innovation:
- Explore and leverage AI tools to improve the efficiency, reliability and scalability of Goalkeep's data engineering workflows.
- Identify opportunities to automate repetitive engineering and data quality tasks using AI-assisted approaches.
- Work with internal teams to embed AI into engineering workflows while ensuring reliability, transparency and maintainability.
The core requirements for the job include the following:
Hard Skills:
- Data modelling and database management (PostgreSQL, MySQL, or SQL Server).
- Data engineering: writing efficient SQL, designing pipelines.
- Installing and maintaining software on Linux systems.
- Familiarity with cloud-based platforms (AWS / GCP / Azure) is a must.
Soft Skills and Mindsets:
- Ability to coach others through patient communication & technical guidance.
- Curiosity and accountability when investigating system issues.
- Strong problem-solving ability with a structured and analytical approach.
Preferred Qualifications:
- Engineering degree with a minimum of 4 years of experience working as a data scientist/data analyst/ data engineer.
- Bachelor's degree in any STEM field.
- Experience in SQL (any dialect).
- Knowledge of software engineering best practices and version control (Git).