Azure Data Engineer
Summary
Design, build, and maintain scalable data pipelines on Azure for clients, optimizing performance and ensuring data quality, integrity, and security. Core tech: Azure Data Factory, SQL, PySpark, Python, and Databricks in a hybrid Hyderabad/Bangalore/Pune setup.
About the job
We are seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our clients.
Position-Azure Data Engineer
Experience: 7+ years
Location: Hybrid- Hyderabad/ Bangalore/Pune
Mandatory Skills: ADF, SQL, Pyspark, Python, Databricks
Key Responsibilities
- Design, develop, and maintain data pipelines.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data workflows for performance and scalability within the Azure environment.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Monitor and troubleshoot data processing issues to maintain smooth operations.
- Document processes, architectures, and data models for knowledge sharing and compliance.
- Stay updated with the latest trends and technologies in data engineering and cloud computing.
Qualifications:
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
- Proven 7+ experience as a Data Engineer, with a focus on AFD, Pyspark, Python and SQL.
- Proficiency in SQL and experience with programming languages such as Python or Scala.
- Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication and collaboration skills to work effectively across teams.