Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in utilizing various technologies to manage and optimize data pipelines. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data architectures that support our analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and maintain robust data pipelines using Azure, Python, PySpark, and Databricks.
- Collaborate with data scientists and analysts to understand data requirements and ensure data availability for analysis.
- Optimize data storage and retrieval processes to enhance performance and efficiency.
- Implement data quality checks and monitoring to ensure the integrity of data.
- Work with cross-functional teams to integrate data from various sources and ensure seamless data flow.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Required Skills:
- Proficiency in Azure cloud services and data engineering tools.
- Strong programming skills in Python, with experience in PySpark for big data processing.
- Familiarity with Databricks for collaborative data engineering and analytics.
- Understanding of data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
If you are passionate about data and have the skills to drive data solutions, we encourage you to apply and be a part of our innovative team.