Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

IIDE

NewBe an early applicant

Team Lead Data Engineering & Analytics

Posted Updated

Description

As the Team Lead Data Engineering & Analytics, you will play a pivotal role in designing, building, and managing the organisation's data infrastructure, application databases, and business intelligence ecosystem.


This is a hands-on technical leadership role that involves leading a team of data engineers and analysts while actively contributing to database architecture, ETL/ELT pipelines, business system integrations, and reporting solutions.


You will be responsible for establishing a reliable, centralised source of truth across the organisation, ensuring data accuracy, scalability, and accessibility. Working closely with cross-functional teams, you will translate business requirements into robust technical solutions that enable data-driven decision-making and operational efficiency.


You will also explore opportunities to leverage AI, machine learning, and predictive analytics to enhance business intelligence and automation.


What You'll Do:

  • Design and develop scalable relational database architectures and schemas from scratch for business applications, including LMS, CRM, ERP, and student management systems.
  • Define database entities, relationships, constraints, indexing strategies, and data models using PostgreSQL.
  • Ensure transactional integrity, data consistency, security, and optimal performance across application databases.
  • Collaborate with backend development teams to align database structures with application logic, APIs, and evolving business requirements.
  • Plan and execute database migrations, schema versioning, performance optimisation, and scalability improvements.
  • Design, develop, and maintain robust ETL/ELT pipelines to integrate data from CRM, websites, LMS, marketing platforms, and other business systems.
  • Build automated data ingestion, transformation, and processing workflows using SQL, APIs, Python, and relevant integration tools.
  • Implement incremental data loading, data validation, deduplication, error handling, retry mechanisms, and pipeline monitoring.
  • Establish a centralised analytical data architecture with standardised data definitions and reliable historical records.
  • Optimise data pipeline performance, processing efficiency, system reliability, and infrastructure costs.
  • Consolidate existing reporting systems and establish standardised business metrics across departments.
  • Develop reliable reporting datasets, analytical data models, and dashboards using BI platforms such as Looker Studio, Power BI, or Tableau.
  • Collaborate with stakeholders to translate business requirements into accurate, actionable, and scalable reporting solutions.
  • Identify and resolve reporting discrepancies, eliminate manual reporting processes, and improve data accessibility.
  • Enable leadership and business teams to make informed decisions using consistent, trustworthy, and timely data.
  • Lead, mentor, and guide data engineers and analysts while ensuring clear ownership, accountability, and timely project delivery.
  • Conduct technical reviews of SQL queries, database designs, data pipelines, and engineering implementations.
  • Establish development standards, documentation practices, quality assurance processes, and technical best practices.
  • Collaborate with technology, marketing, sales, finance, and academic teams to understand requirements and prioritise data initiatives.
  • Remain actively involved in complex technical implementations, troubleshooting, and solution design while managing team responsibilities.
  • Identify opportunities to apply artificial intelligence, machine learning, and advanced analytics to improve business operations.
  • Contribute to AI-enabled data solutions, automated insights, and intelligent reporting systems.
  • Support predictive analytics initiatives, including lead conversion prediction, forecasting, customer segmentation, and trend analysis.
  • Evaluate and implement relevant AI-driven solutions that improve operational efficiency and business decision-making.
  • Establish and maintain a reliable, centralised data platform that supports seamless integration across business applications.
  • Continuously improve data accuracy, database performance, reporting efficiency, and overall system reliability.
  • Drive automation initiatives to reduce manual dependencies and enhance data engineering productivity.
  • Ensure the team delivers maintainable, scalable, well-documented technical solutions aligned with organisational objectives.
  • Perform any other reasonable duties as requested by management, aligned with the broad scope of the position.


Requirements:

  • 2-6 years of relevant experience in data engineering, database development, analytics engineering, or related technical roles.
  • Exposure to AI/ML initiatives, LLM integrations, predictive modelling, or business forecasting solutions.
  • Strong hands-on expertise in SQL and PostgreSQL, including query optimisation and database performance management.
  • Proven experience designing relational database architectures for production applications, including ER modelling, normalisation, constraints, indexing, and transaction management.
  • Strong understanding of OLTP databases, data integrity, transactional consistency, and backend application integration.
  • Demonstrated experience designing, developing, and maintaining ETL/ELT pipelines and integrating multiple data sources.
  • Proficiency in data modelling, data warehousing concepts, data transformation, and data quality management.
  • Experience developing reporting datasets, consolidating business information, and standardising organisational metrics.
  • Previous experience leading or mentoring data engineers, analysts, or other technical team members.
  • Strong analytical thinking, problem-solving abilities, and the capability to independently own complex technical implementations.
  • Ability to collaborate effectively with technical and non-technical stakeholders while translating business requirements into scalable data solutions.
  • Proficiency in Python for data processing, automation, scripting, and pipeline development.
  • Experience working with cloud-based data warehouse platforms such as BigQuery, Snowflake, or Amazon Redshift.
  • Familiarity with data orchestration and transformation tools such as Apache Airflow, dbt, or Dagster.
  • Experience developing dashboards and business intelligence solutions using Looker Studio, Power BI, or Tableau.
  • Working knowledge of REST APIs, cloud infrastructure, database deployments, and system integration practices.
  • Experience implementing automated data validation, monitoring, and performance optimisation processes.
  • Familiarity with Spring Boot, Java, or other backend application development frameworks.
  • Experience supporting predictive analytics use cases such as lead scoring, customer segmentation, or conversion forecasting.
  • Relevant certifications or professional training in cloud platforms, database engineering, data analytics, or AI/ML technologies.
  • Prior experience working with education technology platforms, LMS, CRM, ERP, or student management systems.


Who You'll Thrive As:

  • Is a hands-on technical leader who enjoys designing and building scalable data solutions as much as guiding a team.
  • Has a strong foundation in SQL, PostgreSQL, database architecture, and data engineering, with a passion for solving complex technical challenges.
  • Thinks beyond individual reports and pipelines, focusing on building reliable, integrated, and future-ready data ecosystems.
  • Takes complete ownership of technical initiatives, from understanding business requirements to architecture, implementation, and ongoing optimisation.
  • Is passionate about data accuracy, consistency, automation, and establishing a single source of truth across the organisation.
  • Can translate complex business problems into practical, scalable technical solutions that create measurable impact.
  • Enjoys mentoring team members, establishing engineering best practices, and fostering a culture of accountability and continuous improvement.
  • Communicates effectively with cross-functional stakeholders and understands how technology supports broader business objectives.
  • Is curious about emerging technologies, AI, machine learning, and predictive analytics, and actively explores opportunities to apply them.
  • Thrives in a dynamic, fast-paced environment where independent thinking, collaboration, and hands-on execution are equally valued.

Skills

What Lead Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →