Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Karnataka or Andhra Pradesh. The ideal candidate will have extensive experience in designing and implementing data solutions using Azure Databricks, PySpark, and Python. As a Senior Data Engineer, you will play a crucial role in transforming raw data into actionable insights, enabling data-driven decision-making across the organization. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks and PySpark. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Optimize data processing workflows for performance and efficiency. - Implement data governance and security best practices to ensure data integrity and compliance. - Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives. Required Skills: - Proficiency in Azure Databricks and PySpark for big data processing. - Strong programming skills in Python, with experience in data manipulation and analysis. - Familiarity with Generative AI concepts and applications. - Excellent problem-solving skills and the ability to work collaboratively in a team environment. - Strong communication skills to effectively convey technical concepts to non-technical stakeholders. If you are passionate about data engineering and eager to work on innovative projects, we encourage you to apply for this exciting opportunity.