Data Engineer
Responsibilities:
Create and maintain optimal data pipeline architecture.
Assemble large, complex datasets that meet functional / non-functional business requirements.
Work with data scientists, engineers, and cross functional teams to productionalize data science solutions for current and future business needs, with high scalability, reliability and availability.
Research and implement best practices to enhance existing data infrastructure and process.
Support machine learning and data science, whether it be towards prototypes or production applications. You’ll have an integral role in enabling the team to pursue insights and applied breakthroughs, while also driving the solutions to 7-Eleven scale.
Qualifications:
Bachelor Degree or higher degree in Computer Science, Computer Engineering or related field.
Significant proficiency in SQL and NoSQL databases.
Significant proficiency in Python or Rust.
Familiar with data warehouse, Data Lake, and data lakehouse architectures (e.g.,Databricks).
Familiar with container-based technologies (e.g., Docker, Kubernetes), and orchestration tools (e.g., MLflow, Argo Workflow, Airflow).
Experience with Git/GitLab, working with major cloud providers (e.g., AWS, GCP).
Strong comfort with Linux/Unix shell.
Strong analytic skills related to working with large unstructured datasets.
Proficiency with big data platforms such as Spark.
Experience with CI / CD and infrastructure-as-code tools (e.g., Terraform).
Strong communication skills and collaborative mindset.
Self-driven with willingness to learn and improve, outstanding structural thinking skills, and ability to work under pressure.
Knowledge in retail business is a plus.
Knowledge in domain-driven design(DDD)is a plus.
Knowledge of ML algorithms and packages is an advantage
#for further information - 02-071-9524