Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in Python, PySpark, SQL, and AWS. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data-driven decision-making processes. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and usable for various analytical purposes.
Key Responsibilities:
- Develop and maintain robust data pipelines using Python and PySpark to process large datasets efficiently.
- Design and implement data storage solutions using SQL and AWS services to ensure data integrity and availability.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Monitor and optimize data workflows for performance and reliability.
- Troubleshoot and resolve data-related issues in a timely manner.
- Stay updated with the latest industry trends and technologies in data engineering.
Required Skills:
- Proficiency in Python and PySpark for data processing.
- Strong knowledge of SQL for database management and querying.
- Experience with AWS services related to data storage and processing.
- Familiarity with Nextdata OS is a plus.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment.
If you are passionate about data engineering and want to make a significant impact in a fast-paced environment, we encourage you to apply for this exciting opportunity.