Senior Data Engineer

We are seeking a Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using modern data engineering practices. You will be responsible for building and maintaining data pipelines, ensuring data quality, and optimizing data storage solutions. Your expertise in Azure technologies, including ADLS Gen2, Azure Data Factory (ADF), and Synapse Analytics, will be crucial in developing scalable data architectures. Additionally, familiarity with Lakehouse architecture will be beneficial in enhancing our data processing capabilities. Key Responsibilities: - Design, develop, and maintain robust data pipelines using Azure Data Factory and Synapse Analytics. - Implement data storage solutions leveraging ADLS Gen2 and Delta Lake. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets. - Optimize data workflows and ensure data integrity and quality across various platforms. - Utilize Python and PySpark for data transformation and processing tasks. - Manage version control and deployment processes using Azure DevOps. - Automate tasks and processes using PowerShell scripting. Required Skills: - Strong proficiency in Python and SQL for data manipulation and analysis. - Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory (ADF). - Knowledge of Synapse Analytics and Lakehouse architecture. - Familiarity with Delta Lake and its functionalities. - Proficient in using PySpark for big data processing. - Understanding of Azure DevOps for CI/CD practices. - Excellent problem-solving skills and ability to work collaboratively in a team environment. If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply and join our innovative team.