Senior Data Engineer

We are seeking a Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using Azure technologies. As a Senior Data Engineer, you will be responsible for building and maintaining data pipelines, ensuring data integrity, and optimizing data storage solutions. You will work closely with data scientists and analysts to provide them with the necessary data infrastructure to support their analytics and reporting needs. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake Storage Gen2 (ADLS Gen2). - Implement data integration solutions using Azure Synapse and Azure Data Factory. - Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions. - Utilize Terraform for infrastructure as code to manage and provision Azure resources. - Optimize data storage and retrieval processes to enhance performance and reduce costs. - Write efficient scripts in Python, Bash, and PowerShell for automation and data manipulation. - Monitor and troubleshoot data pipeline performance and resolve issues as they arise. Required Skills: - Strong experience with Azure Databricks, ADLS Gen2, and Azure Synapse. - Proficiency in Python, Bash, and PowerShell scripting. - Familiarity with Terraform for managing cloud infrastructure. - Knowledge of data lake architectures and cloud data platforms. - Excellent problem-solving skills and attention to detail. - Ability to work collaboratively in a fast-paced environment. If you are passionate about data engineering and have a strong background in Azure technologies, we encourage you to apply for this exciting opportunity to make a significant impact on our data initiatives.