Senior Data Engineer
Posted Updated
Description
We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Haryana. The ideal candidate will have extensive experience in data engineering and a strong background in cloud technologies, particularly within the Azure ecosystem. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and implement data pipelines using Azure Synapse, Databricks, and PySpark to ensure efficient data processing and storage.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Manage and optimize data storage solutions using Azure Data Lake Storage (ADLS) and Delta Lake.
- Implement CI/CD practices using Azure DevOps to streamline data engineering workflows and enhance deployment processes.
- Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability.
- Stay updated with the latest trends and technologies in data engineering and cloud computing to continuously improve our data infrastructure.
Required Skills:
- Proficiency in Azure Synapse, Databricks, and PySpark.
- Strong experience with Azure Data Lake Storage (ADLS) and Delta Lake.
- Solid understanding of SQL and data engineering principles.
- Familiarity with CI/CD practices and Azure DevOps.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply for this exciting opportunity.