Data Platform Engineer
Posted
Summary
Data Platform Engineer in Singapore who designs, builds and operates scalable data and logging platforms, developing ingestion, streaming and pipeline solutions across hybrid on-premise and AWS/Azure cloud environments. Core tooling includes Terraform/OpenTofu, Ansible, CI/CD, Docker, and Python/PowerShell/Bash scripting.
Job Responsibilities
- Design, build and operate scalable data and logging platforms.
- Develop solutions for collecting, processing, routing, storing and searching operational data.
- Integrate data from applications, servers, databases, networks, cloud services and other enterprise sources.
- Build data ingestion and streaming solutions across on-premise and cloud environments.
- Develop data pipelines involving filtering, enrichment, transformation and data movement.
- Work with AWS/Azure cloud-native services and hybrid environments.
- Implement Infrastructure as Code and automated deployment using Terraform/OpenTofu, Ansible, CI/CD and related technologies.
- Design platforms for scalability, high availability, resilience and recovery.
- Monitor platform performance, reliability, capacity and cost.
- Support incident investigation and continuous platform improvements.
- Work closely with Observability, Data Engineering, Application and Infrastructure teams.
Job Requirement
- Minimum 3 years of experience in Cloud Engineering, Platform Engineering, DevOps, SRE, Data Platform Engineering or related fields.
- Hands-on experience with production data ingestion, streaming, logging or platform environments.
- Experience with AWS and/or Azure.
- Experience working with hybrid cloud and on-premise environments.
- Knowledge of data pipelines, streaming, routing, storage, indexing or search platforms.
- Experience with Terraform/OpenTofu, Ansible and CI/CD.
- Scripting experience in Python, PowerShell, Bash or similar.
- Familiarity with Docker or containerised environments.
- Strong problem-solving and troubleshooting abilities.