Data Engineer - Data Services
Posted 1
view
Summary
Data Engineer at Mox, a Hong Kong digital bank, designing, maintaining, and improving analytical and operational data infrastructure — data lake, pipelines, batch and real-time processing, and metadata/lineage systems. Core stack includes Python, Spark, Airflow, Kafka, Docker/Kubernetes, and AWS services.
About Mox
Mox is built by and for the ones who aspire to live life to the fullest – we call them Generation Mox!
The name Mox reflects the endless opportunities we can create, - Mobile eXperience; Money eXperience; Money X (multiplier), eXponential growth, eXploration… it’s all up for us to define together.
Why Mox
Mox helps you grow – your money, your world, your possibilities. We equip you with the financial management tools, information and insights you need to make your dreams, big or small, come true.
Everything at Mox – from our products, features, to rewards – is designed based on customer research, tailor made for your needs. We care about what customers care about, especially in data security and privacy. Data ethics is core to everyone here at Mox.
Mox rewards you with an array of banking and lifestyle benefits. Who says banking can’t be fun?
What we are looking for?
As a Data Engineer you'd be working with us to design, maintain, and improve various analytical and operational services and infrastructure which are critical for many other functions within the organization. These include the data lake, operational databases, data pipelines, large-scale batch and real-time data processing systems, a metadata and lineage repository, which all work in concert to provide the company with accurate, timely, and actionable metrics and insights to grow and improve our business using data. You may be collaborating with our data science team to design and implement processes to structure our data schemas and design data models, working with our product teams to integrate new data sources, or pairing with other data engineers to bring to fruition cutting-edge technologies in the data space.
Mox is built by and for the ones who aspire to live life to the fullest – we call them Generation Mox!
The name Mox reflects the endless opportunities we can create, - Mobile eXperience; Money eXperience; Money X (multiplier), eXponential growth, eXploration… it’s all up for us to define together.
Why Mox
Mox helps you grow – your money, your world, your possibilities. We equip you with the financial management tools, information and insights you need to make your dreams, big or small, come true.
Everything at Mox – from our products, features, to rewards – is designed based on customer research, tailor made for your needs. We care about what customers care about, especially in data security and privacy. Data ethics is core to everyone here at Mox.
Mox rewards you with an array of banking and lifestyle benefits. Who says banking can’t be fun?
What we are looking for?
As a Data Engineer you'd be working with us to design, maintain, and improve various analytical and operational services and infrastructure which are critical for many other functions within the organization. These include the data lake, operational databases, data pipelines, large-scale batch and real-time data processing systems, a metadata and lineage repository, which all work in concert to provide the company with accurate, timely, and actionable metrics and insights to grow and improve our business using data. You may be collaborating with our data science team to design and implement processes to structure our data schemas and design data models, working with our product teams to integrate new data sources, or pairing with other data engineers to bring to fruition cutting-edge technologies in the data space.
Highly relevant: (ideally familiar with at least one of the technologies in most of the below categories)
- General computing concepts and expertise: Unix environments, networking, distributed and cloud computing
- Python frameworks and tools: pip, pytest, boto3, pyspark, pylint, pandas, scikit-learn, keras
- Workflow scheduling and monitoring tools: Apache Airflow, Luigi, AWS Batch
- Columnar and big data databases: Athena, Redshift, Vertica, Hive/Hadoop
- Container management and orchestration: Docker, Docker Swarm, ECS, EKS/Kubernetes, Mesos
- CI / CD tools: CircleCI, Jenkins, TravisCI, Spinnaker, AWS CodePipeline
- Distributed messaging and event streaming systems: Kafka, Pulsar, RabbitMQ, Google Pub/Sub
- Streaming data processing frameworks: Spark Streaming, Apache Beam, Apache Flink
- General AWS or Cloud services: Glue, EMR, EC2, ELB, EFS, S3, Lambda, API Gateway, IAM, Cloudwatch
- Version control: git commands, branching strategies, collaboration etiquette, documentation best practices
- Agile/Lean project methodologies and rituals: Scrum, Kanban
Also good to have: (familiarity with any of the below concepts or technologies are a plus)
- JVM languages, frameworks and tools: Kotlin, Java, Scala / Maven, Spring, Lombok, Spark, JDK Mission Control
- RDBMS and NoSQL databases: MySQL, PostgreSQL / DynamoDB, Redis, Hbase
- Enterprise BI tools: Tableau, Qlik, Looker, Superset, PowerBI, Quicksight
- Data science environments: AWS Sagemaker, Project Jupyter, Databricks
- Log ingestion and monitoring: ELK stack (Elasticsearch, Logstash, Kibana), Datadog, Prometheus, Grafana
- Metadata catalogue and lineage systems: Amundsen, Databook, Apache Atlas, Alation, uMetric
- Data privacy and security tools and concepts: Tokenization, Hashing and encryption algorithms, Apache Ranger
Skills
- Agile
- Airflow
- API
- Athena
- AWS
- CircleCI
- Cloud
- CloudWatch
- Data Lake
- Data Pipelines
- Data Science
- Databricks
- Datadog
- Docker
- DynamoDB
- EC2
- ECS
- EKS
- Elasticsearch
- ELK
- Flink
- Git
- Grafana
- Hadoop
- HBase
- Hive
- IAM
- Java
- Jenkins
- Jupyter
- JVM
- Kafka
- Kanban
- Keras
- Kibana
- Kotlin
- Kubernetes
- Lambda
- Logstash
- Looker
- Maven
- MySQL
- Networking
- NoSQL
- pandas
- PostgreSQL
- Power BI
- Prometheus
- Pulsar
- PySpark
- pytest
- Python
- Qlik
- RabbitMQ
- RDBMS
- Redis
- Redshift
- SageMaker
- Scala
- scikit-learn
- Scrum
- Spark
- Spring
- Superset
- Tableau
- Unix
- Version Control