Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have extensive experience in designing and implementing data solutions using modern data engineering tools and frameworks. As a Senior Data Engineer, you will be responsible for building and maintaining scalable data pipelines, ensuring data quality, and optimizing data workflows to support analytics and business intelligence initiatives. Key Responsibilities: - Design, develop, and maintain robust data pipelines using Spark and Databricks to process large datasets efficiently. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Write efficient SQL queries to extract, transform, and load data from various sources into data warehouses. - Utilize Python and PySpark for data manipulation and processing tasks. - Monitor and troubleshoot data pipeline performance, ensuring timely delivery of data to stakeholders. - Implement best practices for data governance and security to protect sensitive information. - Stay updated with the latest trends and technologies in data engineering and contribute to continuous improvement initiatives. Required Skills: - Strong proficiency in Spark and Databricks for big data processing. - Expertise in Python and PySpark for data manipulation and analysis. - Solid experience with SQL for querying and managing relational databases. - Familiarity with data warehousing concepts and ETL processes. - Excellent problem-solving skills and the ability to work in a fast-paced environment. - Strong communication skills to collaborate effectively with cross-functional teams. If you are passionate about data engineering and want to make a significant impact in a growing organization, we encourage you to apply for this exciting opportunity.