Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in data engineering and a passion for working with data streaming technologies. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our banking and BFSI operations. You will work closely with data scientists and analysts to ensure that data is accessible and usable for various analytical purposes.
Key Responsibilities:
- Design and implement robust data pipelines using Apache Flink, Spark, and other data streaming technologies.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Optimize data storage and retrieval processes using AWS services such as EMR, S3, and Glue.
- Ensure data quality and integrity throughout the data lifecycle.
- Monitor and troubleshoot data pipeline performance issues, implementing solutions as necessary.
- Stay updated with the latest trends and technologies in data engineering and streaming.
Required Skills:
- Proficiency in data engineering concepts and practices.
- Strong experience with Apache Flink and Spark for data processing.
- Solid programming skills in Python and PySpark.
- Familiarity with AWS services, particularly EMR, S3, and Glue.
- Understanding of data streaming technologies and their applications in the banking and BFSI sectors.
- Excellent problem-solving skills and attention to detail.
If you are passionate about data and eager to contribute to innovative projects in the banking sector, we encourage you to apply for this exciting opportunity.