Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Karnataka or Andhra Pradesh. The ideal candidate will have a strong background in data engineering and be proficient in utilizing various tools and technologies to manage and analyze large datasets. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that support our data analytics and business intelligence initiatives. Key Responsibilities: - Develop and maintain scalable data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Dataproc, and Apache Spark. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Optimize data processing workflows and ensure data integrity and availability. - Implement data transformation processes using PySpark and Scala to prepare data for analysis. - Monitor and troubleshoot data pipeline performance and resolve any issues that arise. - Stay updated with the latest trends and technologies in data engineering and cloud computing. Required Skills: - Proficiency in Google Cloud Platform (GCP) and its services, particularly BigQuery and Dataproc. - Strong programming skills in Python and experience with PySpark. - Familiarity with Apache Spark and Scala for data processing. - Experience in building and maintaining data pipelines and ETL processes. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply for this exciting opportunity.