Azure Data Engineer

We are seeking an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure technologies, and will be responsible for designing, implementing, and maintaining data pipelines and workflows. You will work closely with data scientists and analysts to ensure that data is accessible and usable for analytics and reporting purposes. Key Responsibilities: - Design and develop data pipelines using Azure Databricks and Azure Data Factory (ADF) to ingest, process, and store data from various sources. - Write efficient and reusable code in Python to automate data processing tasks and enhance data workflows. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Monitor and optimize data pipelines for performance and reliability, ensuring data quality and integrity. - Utilize Unix scripting for automation and management of data processes. - Stay updated with the latest trends and technologies in data engineering and Azure services. Required Skills: - Proficiency in Azure Databricks and Azure Data Factory (ADF). - Strong programming skills in Python. - Experience with Unix scripting. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. - Strong problem-solving skills and attention to detail. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply and join our innovative team.