Data Engineer
Posted Updated
Description
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in various technologies that facilitate data processing and analysis. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and ready for analysis.
Key Responsibilities:
- Design and implement robust data pipelines using Python, AWS, and SQL to ensure efficient data flow and processing.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Utilize PySpark for large-scale data processing and transformation tasks.
- Monitor and optimize data systems for performance and reliability.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Required Skills:
- Proficiency in Python and experience with data engineering frameworks.
- Strong knowledge of AWS services related to data storage and processing.
- Experience with SQL for data querying and manipulation.
- Familiarity with PySpark for handling big data workloads.
- Understanding of Next OS and its applications in data engineering.
If you are passionate about data and have the skills to drive impactful data solutions, we encourage you to apply and be part of our innovative team.