Senior Data Engineer

We are seeking a Senior Data Engineer with extensive experience in big data technologies and cloud platforms. The ideal candidate will have a strong background in Hadoop, Hive, and HDFS, along with proficiency in Databricks and Azure. This role focuses on the migration and modernization of data systems, leveraging advanced technologies such as LLM, GenAI, and OpenAI to enhance data processing capabilities. Key Responsibilities: - Design, develop, and implement data pipelines and architectures that support data migration and modernization initiatives. - Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions. - Optimize existing data workflows and processes to improve efficiency and performance. - Utilize Databricks for data processing and analytics, ensuring high availability and reliability of data systems. - Stay updated with the latest trends and technologies in big data and cloud computing, and apply them to enhance our data infrastructure. - Troubleshoot and resolve data-related issues, ensuring data integrity and security. Required Skills: - Strong expertise in Hadoop, Hive, and HDFS. - Proficiency in Databricks and Azure cloud services. - Experience with data migration and modernization projects. - Familiarity with LLM, GenAI, and OpenAI technologies. - Excellent problem-solving skills and ability to work in a fast-paced environment. - Strong communication and collaboration skills to work effectively with various stakeholders. If you are passionate about data engineering and looking to make a significant impact in a dynamic environment, we encourage you to apply for this exciting opportunity.