Team Lead Data Engineering & Analytics
Description
As the Team Lead Data Engineering & Analytics, you will play a pivotal role in designing, building, and managing the organisation's data infrastructure, application databases, and business intelligence ecosystem.
This is a hands-on technical leadership role that involves leading a team of data engineers and analysts while actively contributing to database architecture, ETL/ELT pipelines, business system integrations, and reporting solutions.
You will be responsible for establishing a reliable, centralised source of truth across the organisation, ensuring data accuracy, scalability, and accessibility. Working closely with cross-functional teams, you will translate business requirements into robust technical solutions that enable data-driven decision-making and operational efficiency.
You will also explore opportunities to leverage AI, machine learning, and predictive analytics to enhance business intelligence and automation.
What You'll Do:
- Design and develop scalable relational database architectures and schemas from scratch for business applications, including LMS, CRM, ERP, and student management systems.
- Define database entities, relationships, constraints, indexing strategies, and data models using PostgreSQL.
- Ensure transactional integrity, data consistency, security, and optimal performance across application databases.
- Collaborate with backend development teams to align database structures with application logic, APIs, and evolving business requirements.
- Plan and execute database migrations, schema versioning, performance optimisation, and scalability improvements.
- Design, develop, and maintain robust ETL/ELT pipelines to integrate data from CRM, websites, LMS, marketing platforms, and other business systems.
- Build automated data ingestion, transformation, and processing workflows using SQL, APIs, Python, and relevant integration tools.
- Implement incremental data loading, data validation, deduplication, error handling, retry mechanisms, and pipeline monitoring.
- Establish a centralised analytical data architecture with standardised data definitions and reliable historical records.
- Optimise data pipeline performance, processing efficiency, system reliability, and infrastructure costs.
- Consolidate existing reporting systems and establish standardised business metrics across departments.
- Develop reliable reporting datasets, analytical data models, and dashboards using BI platforms such as Looker Studio, Power BI, or Tableau.
- Collaborate with stakeholders to translate business requirements into accurate, actionable, and scalable reporting solutions.
- Identify and resolve reporting discrepancies, eliminate manual reporting processes, and improve data accessibility.
- Enable leadership and business teams to make informed decisions using consistent, trustworthy, and timely data.
- Lead, mentor, and guide data engineers and analysts while ensuring clear ownership, accountability, and timely project delivery.
- Conduct technical reviews of SQL queries, database designs, data pipelines, and engineering implementations.
- Establish development standards, documentation practices, quality assurance processes, and technical best practices.
- Collaborate with technology, marketing, sales, finance, and academic teams to understand requirements and prioritise data initiatives.
- Remain actively involved in complex technical implementations, troubleshooting, and solution design while managing team responsibilities.
- Identify opportunities to apply artificial intelligence, machine learning, and advanced analytics to improve business operations.
- Contribute to AI-enabled data solutions, automated insights, and intelligent reporting systems.
- Support predictive analytics initiatives, including lead conversion prediction, forecasting, customer segmentation, and trend analysis.
- Evaluate and implement relevant AI-driven solutions that improve operational efficiency and business decision-making.
- Establish and maintain a reliable, centralised data platform that supports seamless integration across business applications.
- Continuously improve data accuracy, database performance, reporting efficiency, and overall system reliability.
- Drive automation initiatives to reduce manual dependencies and enhance data engineering productivity.
- Ensure the team delivers maintainable, scalable, well-documented technical solutions aligned with organisational objectives.
- Perform any other reasonable duties as requested by management, aligned with the broad scope of the position.
Requirements:
- 2-6 years of relevant experience in data engineering, database development, analytics engineering, or related technical roles.
- Exposure to AI/ML initiatives, LLM integrations, predictive modelling, or business forecasting solutions.
- Strong hands-on expertise in SQL and PostgreSQL, including query optimisation and database performance management.
- Proven experience designing relational database architectures for production applications, including ER modelling, normalisation, constraints, indexing, and transaction management.
- Strong understanding of OLTP databases, data integrity, transactional consistency, and backend application integration.
- Demonstrated experience designing, developing, and maintaining ETL/ELT pipelines and integrating multiple data sources.
- Proficiency in data modelling, data warehousing concepts, data transformation, and data quality management.
- Experience developing reporting datasets, consolidating business information, and standardising organisational metrics.
- Previous experience leading or mentoring data engineers, analysts, or other technical team members.
- Strong analytical thinking, problem-solving abilities, and the capability to independently own complex technical implementations.
- Ability to collaborate effectively with technical and non-technical stakeholders while translating business requirements into scalable data solutions.
- Proficiency in Python for data processing, automation, scripting, and pipeline development.
- Experience working with cloud-based data warehouse platforms such as BigQuery, Snowflake, or Amazon Redshift.
- Familiarity with data orchestration and transformation tools such as Apache Airflow, dbt, or Dagster.
- Experience developing dashboards and business intelligence solutions using Looker Studio, Power BI, or Tableau.
- Working knowledge of REST APIs, cloud infrastructure, database deployments, and system integration practices.
- Experience implementing automated data validation, monitoring, and performance optimisation processes.
- Familiarity with Spring Boot, Java, or other backend application development frameworks.
- Experience supporting predictive analytics use cases such as lead scoring, customer segmentation, or conversion forecasting.
- Relevant certifications or professional training in cloud platforms, database engineering, data analytics, or AI/ML technologies.
- Prior experience working with education technology platforms, LMS, CRM, ERP, or student management systems.
Who You'll Thrive As:
- Is a hands-on technical leader who enjoys designing and building scalable data solutions as much as guiding a team.
- Has a strong foundation in SQL, PostgreSQL, database architecture, and data engineering, with a passion for solving complex technical challenges.
- Thinks beyond individual reports and pipelines, focusing on building reliable, integrated, and future-ready data ecosystems.
- Takes complete ownership of technical initiatives, from understanding business requirements to architecture, implementation, and ongoing optimisation.
- Is passionate about data accuracy, consistency, automation, and establishing a single source of truth across the organisation.
- Can translate complex business problems into practical, scalable technical solutions that create measurable impact.
- Enjoys mentoring team members, establishing engineering best practices, and fostering a culture of accountability and continuous improvement.
- Communicates effectively with cross-functional stakeholders and understands how technology supports broader business objectives.
- Is curious about emerging technologies, AI, machine learning, and predictive analytics, and actively explores opportunities to apply them.
- Thrives in a dynamic, fast-paced environment where independent thinking, collaboration, and hands-on execution are equally valued.
Skills
- Accessibility
- AI
- Airflow
- Analytics
- API
- Automation
- BigQuery
- Business Intelligence
- Cloud
- CRM
- Dagster
- Data Analytics
- Data Engineering
- Data Ingestion
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- dbt
- ELT
- ERP
- ETL
- Java
- LLM
- Looker
- Looker Studio
- Machine Learning
- Performance Management
- PostgreSQL
- Power BI
- Predictive Analytics
- Predictive Modeling
- Python
- RDBMS
- Redshift
- REST
- Snowflake
- Solution Design
- Spring
- SQL
- System Integration
- Tableau
Sign in to read and join the discussion.