Data Engineer
Summary
Data Engineer building ABACUS digital's data infrastructure: integrating internal and external data sources, running large-scale pipelines and workflow management, serving real-time ML/AI inference, and implementing an experimentation platform. Requires proficiency in at least one language like Java, Scala, or Python, with big data tech (Spark, Kafka, Hadoop) highly desired.
What will you do
- Work closely with the team of engineers, strategists and data scientists to build customer-facing products to address business problems.
- Build state-of-the-art data infrastructure to unlock full potential of ABACUS digital' data analytics capabilities. This includes, but not limited to, data integration (from both internal and external sources), large-scale data pipelines, data workflow management, and ML/AI real-time inference service.
- Implement an experimentation platform that enables the team to conduct online experiments for quick product iterations.
Who we are looking for
- BS/MS degree in Computer Engineering, Computer Science, or a related field.
- Fresh grads are welcome! But having a full-time experience in tech or related industry is a plus.
- Proficiency with at least one of these programming languages: Java, Scala, Python, any other OOP languages, or other functional languages.
- Interested in building and troubleshooting large-scale distributed products.
- Interested in big data technologies such as Hadoop, Hive, Avro, Parquet, Presto, Spark, or Kafka is highly desired.