Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data architecture and engineering, with expertise in Apache Spark, Azure Data Lake, Azure Synapse, and Azure Databricks. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives. Key Responsibilities: - Develop and maintain robust data pipelines using Apache Spark and Azure Databricks to ensure efficient data processing and transformation. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets for analysis. - Design and implement data models and architectures that support data storage and retrieval in Azure Data Lake and Azure Synapse. - Monitor and optimize data workflows for performance and reliability. - Ensure data quality and integrity through rigorous testing and validation processes. - Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives. Required Skills: - Proficiency in Apache Spark and Pyspark for big data processing. - Experience with Azure Data Lake and Azure Synapse for data storage and analytics. - Strong understanding of data architecture principles and best practices. - Familiarity with data engineering concepts and methodologies. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply for this exciting opportunity.