Posted Updated
We are seeking a skilled Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have a strong background in data processing and analytics, with expertise in Spark and Databricks, as well as proficiency in Python programming. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes.
Key Responsibilities:
- Develop and maintain robust data pipelines using Spark and Databricks to ensure efficient data processing and analysis.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize data workflows for performance and scalability, ensuring data integrity and availability.
- Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
- Document data processes and workflows to ensure clarity and maintainability.
Required Skills:
- Strong experience with Spark and Databricks for big data processing.
- Proficiency in Python for data manipulation and analysis.
- Familiarity with data warehousing concepts and ETL processes.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Strong problem-solving skills and attention to detail.
If you are passionate about data engineering and want to work in a fast-paced environment, we encourage you to apply. Join us in leveraging data to drive business success.
See also
Data Engineering jobs by country — openings, pay and top skills →