freehire launches on Product Hunt on 26 August.

Follow →

Associate Engineer/Engineer, Data Engineering

Summary

Builds and maintains scalable data pipelines and frameworks for ingestion, processing, and storage using big-data tools like Spark, Kafka, and Airflow.

Role Summary

Based in Singapore, this role will report to the Engineering Manager.

Key Responsibilities
  • Translating the pipelines into reusable and scalable data pipelines and frameworks for ingestion, processing, storage and consumption
  • Perform root cause analysis on internal and external data systems to answer specific business questions
  • Improving and maintaining the existing application & workflows’ correctness, performance, SLAs and architecture’s integrity
  • Upholding adherence to the right data engineering practices while building the data systems and pipelines, such as writing clean, efficient code, proper automation testing, CI / CD, logging, monitoring and alerting
  • Participate in code reviews and ensuring high standards of code quality, in addition to ensuring that development guidelines are followed
Requirements
  • Bachelors or Masters in Computer Science or a related field
  • 1-4 years of experience in Data/Backend/SRE/Platform Engineering
  • Fresh graduates are also encouraged to apply and will be considered
  • Good communication skills and are able to explain technical concepts, thoughts, ideas or issues to the other members of the team
  • A self-starter and self-driven attitude with an appetite for continuous learning and improvement
  • Good working SQL knowledge and experience working with relational databases
  • Experience building ‘big data’ data pipelines and data sets
  • Working knowledge of the ‘big data’ stack such as
    • Hadoop, Spark, Kafka, Hive, etc. or equivalent
    • SQL and NoSQL databases
    • Orchestration or workflow management tools such as Airflow or equivalent
    • Any Cloud experience is good to have, but not mandatory
    • Stream-processing systems: Flink, Spark-Streaming, etc. or equivalent
    • Experience with one or more object-oriented/object function scripting languages: Python, Scala or equivalent

Rakuten provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type. Rakuten considers applicants for employment without regard to race, color, religion, age, sex, national origin, disability status, genetic information, protected veteran status, sexual orientation, gender, gender identity or expression, or any other characteristic protected by federal, state, provincial or local laws.

See also