Cloud & Data Platform Engineer
Posted Updated
Description
台灣做為 Sgcarmart 在新加坡海外的第一個據點,將成為軟體開發中心,協助開發Sgcarmart 全球範圍的軟體系統,並推動 Sgcarmart 業務往海外市場擴張發展。因此 Sgcarmart 台灣殷切尋求優秀的軟體開發人才,邀請您加入國際化的團隊,參與更大的市場及舞台展現您的影響力!
Role Overview
- We are seeking an experienced **Cloud & Data Platform Engineer** to design, operate, and improve our cloud infrastructure and data platforms. The role focuses on reliability, security, scalability, automation, and operational excellence.
- The ideal candidate has hands-on experience with **Microsoft Azure or AWS**, Linux, cloud networking, DevOps automation, and data platforms such as **Databricks, Spark, or Data Factory**.
Key Responsibilities
Cloud Infrastructure
- Design, deploy, and maintain cloud infrastructure.
- Manage compute, networking, storage, load balancing, databases, App Services, and containers.
- Improve availability, security, performance, scalability, and cost efficiency.
- Automate and standardize infrastructure provisioning.
Security and Governance
- Implement cloud security best practices.
- Manage IAM, RBAC, policies, and secrets using Azure Key Vault, AWS Secrets Manager, or equivalent.
- Support governance, compliance, vulnerability remediation, and security monitoring.
Data Platform
- Support cloud analytics and data platforms.
- Build and maintain ETL/ELT pipelines.
- Manage data lake, warehouse, and lakehouse solutions.
- Work with Databricks, Spark, or similar technologies.
- Improve data quality, performance, scalability, and monitoring.
DevOps and Automation
- Build and maintain CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, or similar tools.
- Implement Infrastructure as Code with Terraform, Bicep, ARM, CloudFormation, or equivalent.
- Automate operational tasks with Python, Bash, or PowerShell.
Operations
- Administer Linux production environments.
- Troubleshoot infrastructure, networking, application, and performance issues.
- Support monitoring, patching, backups, disaster recovery, incident response, and root cause analysis.
- Maintain technical documentation and procedures.
Requirements
- At least **5 years of experience** in cloud, platform, DevOps, infrastructure, data engineering, or a related field.
- Hands-on experience with Azure and/or AWS.
- Strong knowledge of cloud networking, compute, storage, IAM, and security.
- Experience with Linux, CI/CD, Infrastructure as Code, and observability tools.
- Strong understanding of DNS, VPN, routing, firewalls, SSL/TLS, and load balancing.
- Scripting experience with Python, Bash, or PowerShell.
- Experience with one or more of:
- Databricks, Spark, Azure Data Factory, or Synapse
- AWS Glue, EMR, Airflow, or Kafka
- Delta Lake, data lake, lakehouse, or ETL/ELT
- SQL and data modelling
Soft Skills
- Strong ownership and accountability.
- Able to work independently and proactively.
- Strong troubleshooting and analytical skills.
- Effective communication and stakeholder management.
- Comfortable in a fast-paced, collaborative environment.
Preferred Qualifications
- Azure or AWS certifications.
- Experience with Databricks, Kubernetes, SaaS, or large-scale web applications.
- Familiarity with data warehousing, analytics, business intelligence, and FinOps.
What Success Looks Like
- Stable, secure, scalable, and cost-efficient cloud infrastructure.
- Reliable and automated deployment and data pipelines.
- Strong security, governance, observability, and operational processes.
- Proactive issue resolution and continuous platform improvement.
- Effective collaboration across engineering, product, security, and data teams.
Skills
- Airflow
- Analytics
- Automation
- AWS
- Aws Glue
- Azure
- Azure Data Factory
- Azure DevOps
- Bash
- Bicep
- Business Intelligence
- CI/CD
- Cloud
- Cloud Security
- CloudFormation
- Data Engineering
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- Delta Lake
- DevOps
- DNS
- ELT
- ETL
- FinOps
- Firewall
- GitHub
- GitHub Actions
- IAM
- Infrastructure as Code
- Jenkins
- Kafka
- Kubernetes
- Lakehouse
- Linux
- Networking
- Observability
- PowerShell
- Python
- RBAC
- Root Cause Analysis
- SaaS
- Spark
- SQL
- SSL
- Stakeholder Management
- Terraform
- TLS
- Vault
- VPN