Senior Data Engineer
Posted Updated 3
views
Summary
Senior Data Engineer working onsite across Indian cities (Bangalore, Chennai, Nagpur, Pune) to design, build, and optimize scalable data pipelines using PySpark and Databricks, ensuring data quality and governance while collaborating with data scientists and analysts. Cloud platform experience (AWS/Azure) is a plus.
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using PySpark and Databricks. As a Senior Data Engineer, you will play a crucial role in managing and optimizing our data pipelines, ensuring data quality, and enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize data processing workflows for performance and efficiency.
- Monitor and troubleshoot data pipeline issues, ensuring data integrity and availability.
- Implement best practices for data governance and security.
- Stay updated with the latest industry trends and technologies related to data engineering.
Required Skills:
- Proficiency in PySpark and experience with Databricks.
- Strong understanding of data modeling, ETL processes, and data warehousing concepts.
- Experience with cloud platforms (e.g., AWS, Azure) is a plus.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a fast-paced environment.
If you are passionate about data engineering and want to make a significant impact in a growing organization, we encourage you to apply for this exciting opportunity.