Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have a strong background in data engineering, with a focus on building and maintaining data pipelines and workflows. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data processing systems that leverage Apache Airflow for orchestration and Kubernetes for container management. Your expertise in Google Cloud Platform (GCP) will be essential in deploying scalable data solutions that meet our business needs. Key Responsibilities: - Design and develop robust data pipelines using Apache Airflow to ensure efficient data flow and processing. - Utilize Kubernetes for container orchestration to manage and scale data applications effectively. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Monitor and troubleshoot data workflows to ensure reliability and performance. - Implement best practices for data governance and security within the data engineering processes. - Stay updated with the latest trends and technologies in data engineering and cloud computing. Required Skills: - Proficiency in Apache Airflow for workflow management. - Experience with Kubernetes for container orchestration. - Strong knowledge of Google Cloud Platform (GCP) services and tools. - Familiarity with data modeling, ETL processes, and data warehousing concepts. - Excellent problem-solving skills and attention to detail. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and eager to work in a fast-paced environment, we encourage you to apply for this exciting opportunity.