Technical Lead - Data Engineer
Posted
Summary
Technical Lead overseeing the design, development, and maintenance of large-scale Microsoft BI solutions—SQL Server, SSIS, SSRS, SSAS, and Power BI—alongside open-source data pipelines, in an on-site Singapore role.
Job Description:
Bachelor's degree in Computer Science, IT, Engineering, or related field with demonstrated continuous learning ethos.
Minimum 10 years of hands-on experience in the design, development, and maintenance of large-scale Microsoft BI solutions in enterprise environments, ideally within banking, financial services, or a similarly regulated industry.
Proven experience delivering end-to-end BI solutions from requirements gathering through to production support, across multiple concurrent business domains.
Demonstrated experience in a technical lead or senior individual contributor capacity, including solution design ownership, code reviews, and team mentoring.
Solid understanding of SDLC and/or Agile/Scrum development frameworks and methodologies.
Must-have qualifications:
SQL Server (2017, 2019, 2022): Deep expertise in the database engine, query optimisation, indexing strategies, and complex data retrieval and manipulation at scale.
ETL Development: Proficient in designing and building robust, large-scale ETL pipelines using SSIS, including custom scripting with C# for advanced data manipulation tasks experience with BIML for automated SSIS package generation is a strong advantage.
Reporting & Visualisation: Hands-on experience developing enterprise reports and dashboards using SSRS and Power BI, including Power BI Service, Row-Level Security, and deployment pipelines.
SSAS & Analytical Modelling: Strong expertise in SSAS Tabular model development.
Proficient in DAX and MDX for complex analytical calculations and KPI modelling.
Data Warehousing & Architecture: Strong command of data warehouse design principles including dimensional modelling (star/snowflake schemas), data marts, slowly changing dimensions, and data lineage - with experience maintaining and evolving large-scale DWH environments.
Open-Source Data Pipelines: Hands-on experience building and maintaining data pipelines using open-source frameworks such as Apache Airflow, Apache Spark / PySpark, or dbt, complementing the core Microsoft BI stack.
Broader Database & DWH Platforms: Working experience with non-Microsoft database and DWH platforms such as PostgreSQL, MySQL, Snowflake, Amazon Redshift, or Google BigQuery, demonstrating versatility across data ecosystems.
CI/CD & DevOps: Experience implementing Continuous Integration / Continuous Deployment pipelines using Azure DevOps or equivalent tooling, including automated testing and release management for BI artefacts.
Requirements:
Preferred qualifications:
Experience with on-premise data virtualization or logical data warehouse concepts.
Understanding of data mesh or data fabric architecture patterns.
Familiarity with Kubernetes, microservices architectures, or containerised data workloads in a hybrid environment.
Metadata management and data lineage tools.
Experience mentoring junior engineers or leading technical initiatives.
Agile delivery methodologies and product-oriented data architecture.
Other Professional Skills and Mind-set:
Autonomous Work Ethic - Work independently on complex problems while proactively seeking collaboration.
Continuous Learning - Committed to staying current with data engineering trends and best practices.
Analytical & Problem-Solving - Approaches complex data and business challenges with structured thinking, sound judgement, and a pragmatic, solution-oriented mindset.
Skills
- Agile
- Airflow
- Azure
- Azure DevOps
- BigQuery
- CI/CD
- C#
- Data Engineering
- Data Lineage
- Data Pipelines
- Data Warehousing
- dbt
- DevOps
- Dimensional Modeling
- ETL
- Kubernetes
- Metadata Management
- Microservices
- MySQL
- PostgreSQL
- Power BI
- PySpark
- Redshift
- Requirements Gathering
- Scrum
- SDLC
- Snowflake
- Solution Design
- Spark
- SQL
- SQL Server
- SSIS
- SSRS
- Test Automation
- Virtualization