Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in ETL processes, Hadoop, Python, and PySpark. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data analytics and business intelligence initiatives. Key Responsibilities: - Develop and maintain robust ETL processes to extract, transform, and load data from various sources into our data warehouse. - Collaborate with data scientists and analysts to understand data requirements and ensure data availability for analysis. - Optimize data pipelines for performance and scalability, ensuring high availability and reliability of data. - Implement data quality checks and monitoring to ensure the integrity of data. - Work with big data technologies, particularly Hadoop, to manage and process large datasets efficiently. - Utilize Python and PySpark for data manipulation and analysis, ensuring best practices in coding and documentation. - Stay updated with the latest trends and technologies in data engineering and big data. Required Skills: - Strong experience with ETL tools and processes. - Proficiency in Hadoop ecosystem components. - Solid programming skills in Python, with experience in data manipulation libraries. - Familiarity with PySpark for big data processing. - Excellent problem-solving skills and attention to detail. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data and have the skills to drive data initiatives, we encourage you to apply for this exciting opportunity.