Azure Data Engineer - Team Lead
Posted Updated
Description
Job Title: Data Engineer - Lead
Experience Required: 8+ Years
Location: Hyderabad/Ahmedabad
Employment Type: Full-time
Position Overview
We are seeking an experienced Data Engineer with over 8 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor engineering teams to deliver scalable and reliable data systems that power business intelligence, AI, and analytics.
Roles & Responsibilities
· Design and implement modern data architectures across cloud and hybrid environments.
- Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data.
- Lead data platform modernization initiatives using cutting-edge tools and frameworks.
- Define and enforce data governance, security, and compliance standards.
- Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance.
- Provide technical leadership and mentorship to data engineers and developers.
- Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring.
- Continuously evaluate and introduce innovative data technologies that enhance efficiency and scalability.
- Translate business requirements into robust and scalable technical data solutions.
- Support real-time and streaming data architectures for analytics and ML workloads.
- Designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
Required Skills & Qualifications
- Bachelor’s or master’s in computer science, Engineering, or related field.
- 8+ years in Data Engineering or Data Architecture roles.
- Expertise in Python, SQL, Spark, Kafka, and Airflow.
- Proven experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Snowflake, Databricks, or Delta Lake.
- Strong understanding of data modelling, governance, and lineage tools.
- Excellent problem-solving, leadership, and communication skills.
Good to Have Skills:
· C#, .NET Core, Azure PaaS, Problem-Solving, REST API Development, EF Core, Leadership, Agile Practices.
· Blazor UI, Azure IPaaS (Azure Integration Services), Design Patterns, and Cloud Security best practices.
Skills
- Agile
- AI
- Airflow
- Analytics
- API
- AWS
- Azure
- Blazor
- Business Intelligence
- Cloud
- Cloud Security
- C#
- Data Engineering
- Data Governance
- Data Modeling
- Data Pipelines
- Data Science
- Databricks
- Delta Lake
- Design Patterns
- DevOps
- .NET
- ELT
- ETL
- GCP
- Kafka
- Machine Learning
- Python
- REST
- Snowflake
- Spark
- SQL
- Test Automation