Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Andhra Pradesh. The ideal candidate will have extensive experience in designing and implementing data pipelines and architectures that support our data-driven decision-making processes. As a Senior Data Engineer, you will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure is robust, scalable, and efficient. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using AWS services, PySpark, and Airflow. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Optimize data storage and retrieval processes using SQL and Redshift to ensure high performance and reliability. - Monitor and troubleshoot data pipeline performance, implementing improvements as necessary. - Ensure data quality and integrity through rigorous testing and validation processes. - Stay updated with the latest industry trends and technologies to continuously improve our data engineering practices. Required Skills: - Proficiency in AWS services and architecture. - Strong experience with PySpark for big data processing. - Advanced knowledge of Python programming. - Expertise in SQL for data manipulation and querying. - Familiarity with Airflow for workflow management. - Experience with Redshift for data warehousing solutions. If you are passionate about data engineering and want to make a significant impact in a fast-paced environment, we encourage you to apply for this exciting opportunity.