(Senior) Data Engineer-1
Summary
Build and maintain scalable data platforms and pipelines using Snowflake, DBT Cloud, and Python/SQL to power AI/ML products and analytics for a global building-materials company.
Job Overview
Senior Data Engineer – Malaysia (Data Science & Engineering team). This role focuses on Snowflake, DBT Cloud, and leading data engineering aspects for AI/ML products. The position reports to the team lead, works with teams in Denmark, Poland, and globally, and collaborates with a small engineering group.
Responsibilities
- Run & maintain scalable data platforms and pipelines (batch & streaming).
- Program in Python and SQL to maintain and improve existing codebases.
- Build and maintain data models, data marts, and data warehouses for analytics and reporting.
- Implement data validation, monitoring, and alerting to ensure data quality and governance.
- Collaborate with data stewards and data scientists to define schemas, metadata, and lineage.
- Enforce data security, access control, and compliance with industry regulations.
- Profile, tune, and optimize SQL queries, transformations, and storage layers to meet SLAs.
- Evaluate and recommend new technologies or architectural patterns to improve throughput and reduce costs.
- Automate infrastructure provisioning (IaC) and CI/CD processes for data workloads.
- Guide and coach junior and mid‑level engineers in data engineering and platform development.
- Innovate and proactively harden data platforms against potential issues.
Requirements (Must Have)
- Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or related field.
- 5–7 years of hands‑on experience in data engineering, building, and maintaining large‑scale data platforms.
- Proficient in SQL and one or more programming languages (Python, Scala, Java, Snowpark).
- Experience with DBT, Snowflake, IaaC concepts (Terraform, CloudFormation, Jenkins/GitHub Actions) and Jinja.
- Hands‑on experience with ETL/ELT workflow tools such as Snowpipe.
- Strong data modelling skills (star, snowflake, data vault, etc.).
- Hands‑on experience with Azure Functions, Azure Data Lake, and Iceberg.
- Experience designing and optimizing data warehouses, data lakes, and/or data lakehouse architectures.
- Knowledge of data quality frameworks, cataloging, and metadata management tools.
- Excellent problem‑solving, detail‑oriented, and troubleshooting skills under tight SLAs.
- Strong communication skills with technical and non‑technical stakeholders.
- Proactive mindset with continuous improvement attitude.
- Familiarity with LLM tools (e.g., ChatGPT, GitHub Copilot).
- Extensive experience in relational databases and version control systems such as Git.
Nice to Have
- Master’s degree or higher in relevant field.
- Hands‑on experience with Supermetrics, Informatica, Kafka, Databricks, Spark, Airflow, Docker, and Kubernetes.
- Experience with managed data services (AWS Redshift, Azure Synapse).
- Experience with cloud platforms (Azure, AWS, GCP).
- Familiarity with observability tools (Prometheus, Grafana, ELK stack).
- Ability to work in Scrum or Kanban using Jira.
- International work experience.
Equal Opportunity
We employ 79 different nationalities worldwide and are committed to providing equal opportunities to all employees, promoting diversity, and working against all forms of discrimination.