Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in various technologies that facilitate data processing and analysis. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and usable for analytical purposes. Key Responsibilities: - Design and implement robust data pipelines using Python and PySpark to process large datasets efficiently. - Develop and maintain SQL queries for data extraction, transformation, and loading (ETL) processes. - Utilize AWS services to deploy and manage data infrastructure, ensuring high availability and performance. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Monitor and optimize data workflows to improve performance and reduce costs. - Ensure data quality and integrity through rigorous testing and validation processes. Required Skills: - Proficiency in Python and PySpark for data processing. - Strong SQL skills for database management and querying. - Experience with AWS services related to data storage and processing. - Familiarity with data modeling and data warehousing concepts. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and eager to contribute to innovative projects, we encourage you to apply and join our team in Karnataka, Maharashtra, Tamil Nadu, or Andhra Pradesh.