Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our team in Karnataka. The ideal candidate will have a strong background in data engineering and be proficient in various technologies and methodologies that drive data flow and management. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and ETL processes that ensure the efficient flow of data across our systems. You will work closely with data scientists and analysts to understand their data needs and provide them with the necessary infrastructure to support their analyses.
Key Responsibilities:
- Design and develop robust data pipelines to facilitate data flow from various sources to data warehouses.
- Implement ETL processes to ensure data is cleaned, transformed, and loaded efficiently.
- Utilize GCP services to manage and optimize data storage and processing.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Implement CI/CD practices to streamline the deployment of data solutions.
- Maintain documentation of data models, pipelines, and processes for future reference.
Required Skills:
- Strong experience with data engineering concepts and practices.
- Proficiency in Python for data manipulation and automation tasks.
- Familiarity with ETL tools and processes.
- Experience with GCP and its data services.
- Knowledge of data modeling techniques and best practices.
- Familiarity with CI/CD tools such as Jenkins and configuration management tools like Ansible.
If you are passionate about data and have the skills to drive data solutions, we encourage you to apply for this exciting opportunity.