Engineering Manager
Description
We are looking for an experienced Engineering Manager (Data) with 7-14 years of experience in data engineering and at least 3 years of experience leading data teams as a Tech Lead or Engineering Manager. The role involves leading distributed data engineering teams, building scalable and reliable data platforms, and driving data architecture across Azure, Databricks, and ClickHouse.
The ideal candidate should have strong hands-on expertise in Databricks, Spark, Delta Lake, Unity Catalog, advanced SQL, dbt, and Azure data services. Experience with real-time analytical databases, data governance, security, reporting, and regulated environments such as fintech or financial services is highly desirable.
Roles and Responsibilities:
- 7-14 years of experience in Data Engineering, with 3+ years in technical leadership or engineering management.
- Strong hands-on experience with Databricks, including Spark, Delta Lake, and Unity Catalog.
- Advanced SQL skills and experience with ClickHouse or similar real-time analytical databases.
- Strong experience with dbt, including data modelling, testing, documentation, and data quality frameworks.
- Good knowledge of Azure data services, including ADLS Gen2, Azure Data Factory, Event Hubs, Key Vault, Microsoft Entra ID, and Microsoft Purview.
- Strong understanding of data governance, security, RBAC, row/column-level security, encryption, masking, auditing, and data retention.
- Experience with Power BI or similar reporting and alerting tools.
- Hands-on experience with CI/CD for data using Azure DevOps or GitHub Actions.
- Experience working in Agile environments with global stakeholders across different time zones.
Preferred Skills:
- Experience with Power BI and Microsoft Fabric.
- Streaming data experience with Event Hubs, Kafka, or Spark Structured Streaming.
- Background in fintech, financial services, trading, or other regulated industries.
- Familiarity with GDPR, data privacy, and regulatory reporting requirements.
What would you do here:
Key Responsibilities:
- Lead and grow distributed teams of Data Engineers and Analytics Engineers building data platforms on Azure, Databricks, and ClickHouse.
- Own the end-to-end data lifecycle, including ingestion, data modelling, pipelines, reporting, dashboards, and alerting.
- Drive the development of reliable, scalable, and high-performance data platforms.
- Define technical direction for data architecture, modelling standards, and data contracts.
- Determine the appropriate use of Databricks and ClickHouse based on business and technical requirements.
- Drive dbt-based pipeline development, testing, and data validation to ensure data accuracy and reliability.
- Establish best practices for data quality, performance optimization, and platform scalability.
- Own data governance, cataloguing, lineage, and access control.
- Ensure PII protection, regulatory compliance, and data security through appropriate access management and governance practices.
- Implement security controls covering encryption, masking, auditing, and data retention.
- Work closely with Product, Finance, Risk, Compliance, and Engineering teams to prioritize data requirements and deliver reliable reporting solutions.
- Collaborate with global stakeholders and distributed teams across time zones.
- Drive Agile delivery practices and ensure effective team collaboration.
- Ensure platform reliability and cost efficiency through SLAs, monitoring, and alerting.
- Establish CI/CD practices for data engineering workflows.
- Oversee reporting and dashboards to provide trusted and accurate business insights.
Skills
- Agile
- Analytics
- Azure
- Azure Data Factory
- Azure DevOps
- CI/CD
- ClickHouse
- Data Engineering
- Data Governance
- Data Modeling
- Data Quality
- Databricks
- dbt
- Delta Lake
- DevOps
- Entra ID
- Fintech
- Gdpr
- GitHub
- GitHub Actions
- Kafka
- Microsoft Fabric
- Microsoft Purview
- Power BI
- RBAC
- Regulatory Compliance
- Spark
- SQL
- Unity
- Unity Catalog
- Vault
Sign in to read and join the discussion.