Data Platform Engineer - AI
Posted 1
view
Summary
A hands-on technical lead role designing, building, and operating enterprise-scale data platforms on Microsoft Azure — ETL/ELT pipelines, Lakehouse/Medallion architectures (ADLS Gen2, Delta Lake), and C#/.NET REST APIs and backend services, plus CI/CD via Azure DevOps, Docker/Kubernetes workloads, and monitoring with Azure Monitor.
We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.
Key Responsibilities:
- Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
- Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers
- Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
- Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
- Implement microservices and event-driven processing patterns with secure authentication and authorization.
Modernization & Reliability
- Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
- Support platform and data migrations while ensuring functional and data parity.
- Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights
Cloud, DevOps & Technical Leadership
- Build and maintain CI/CD pipelines using Azure DevOps and Git.
- Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
- Support Docker and Kubernetes/AKS-based workloads where applicable.
Mandatory Skills:
- ETL/ELT, Data Warehousing & Data Modeling
- Lakehouse / Medallion Architecture