Data Engineer

Data Engineer

Position overview

We are looking for an experienced Data Engineer to join our Engineering team. The ideal candidate will have a strong background in developing scalable, high-performance data systems, with a particular focus on enterprise data systems. With our company's growing reliance on cloud technologies, especially AWS, and big data systems, your role will be pivotal in shaping the backbone of our tech infrastructure.

Key responsibilities

• Design, develop, and maintain scalable, high-availability Data systems.
• Work closely with the development team to integrate cloud services and solutions, specifically within the AWS ecosystem.
• Implement and manage big data systems, including but not limited to Kafka, EMR, and data pipelines, to support data-driven decision-making.

• Ensure the security and integrity of application data in compliance with industry standards.

• Collaborate with cross-functional teams to identify and resolve performance bottlenecks.

• Provide technical mentorship to junior team members.

Qualifications

Basic Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.

• 4+ years of experience in working with Data systems and Data pipeline , preferably for enterprise-level applications.

• Solid experience with big data systems, including Kafka, Apache Airflow, and building data pipelines.

• Familiarity with data modeling, ETL processes, and data warehousing.

• Understanding in cloud technologies like AWS (Amazon Web Services) related technologies such as Terraform, ECS, S3, RDS, and Opensearch.

• Experience with software development lifecycle (SDLC) practices, including coding standards, code reviews, source control management, build processes, and testing.

Preferred Qualifications

• Knowledge of Large Language Models (LLMs) is a significant plus.

• Strong analytical skills and the ability to tackle issues with innovative solutions.

• Security background and experience developing secure applications for enterprises is a plus.

• Ability to work in a fast-paced and dynamic environment and have a growth mindset.