Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in cloud engineering and data engineering, with a strong focus on utilizing platforms such as AWS and Azure. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven initiatives. Key Responsibilities: - Design and implement scalable data solutions using cloud technologies, primarily AWS and Azure. - Develop and maintain ETL processes using Azure Data Factory (ADF) and other relevant tools. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data sets. - Optimize data storage and retrieval processes using Azure Data Lake Storage (ADLS) and other cloud storage solutions. - Write efficient and reusable code in Python and PySpark to process large datasets. - Ensure data quality and integrity through rigorous testing and validation processes. - Stay updated with the latest trends and technologies in cloud computing and data engineering. Required Skills: - Strong experience with cloud platforms, specifically AWS and Azure. - Proficiency in data engineering tools and frameworks, including Azure Data Factory and Azure Data Lake Storage. - Solid programming skills in Python and PySpark. - Experience in building and optimizing data pipelines and architectures. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and cloud technologies, and you thrive in a fast-paced environment, we would love to hear from you. Join us in driving innovation and excellence in our data initiatives.