Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and architectures. As a Senior Data Engineer, you will play a crucial role in transforming raw data into actionable insights, enabling data-driven decision-making across the organization. Key Responsibilities: - Design and implement robust data pipelines using Google Cloud Platform (GCP) services such as Dataflow and BigQuery. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Utilize PySpark and Python for data processing and transformation tasks. - Develop and maintain ETL processes to ensure data integrity and availability. - Monitor and optimize data workflows using Apache Airflow to ensure timely data delivery. - Work closely with cross-functional teams to identify opportunities for data-driven improvements and innovations. - Ensure best practices in data governance, security, and compliance are followed. Required Skills: - Strong experience with GCP and its data services. - Proficiency in PySpark and Python programming. - Solid understanding of SQL and experience with relational databases. - Familiarity with data modeling and data warehousing concepts. - Experience with data pipeline orchestration tools, particularly Apache Airflow. - Excellent problem-solving skills and the ability to work in a fast-paced environment. - Strong communication skills to collaborate effectively with technical and non-technical stakeholders. If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply for this exciting opportunity.