Senior Staff Software Engineer (Data Platform)
Summary
Define and scale a cloud-native, petabyte-scale data lakehouse for a biotechnology research company in Singapore (hybrid, 2 days WFH). Day to day: architecture leadership, cost/performance ownership, and cross-functional collaboration using Java, Python, Apache Iceberg, Parquet, AWS Glue, and Spark/Trino, while championing AI-assisted development.
about company
I am currently working with a well-known biotechnology research company. Office located in Woodlands - but there's shuttle bus provided from multiple MRT stations.
Attractive salary package! Hybrid working arrangement - 2 days WFH. Working hours 8am to 5pm. Can end work early and have more personal time.Will need to take 7am calls with US teams.
about job
- Define the technical architecture to build, modernize, and scale a cloud-native lakehouse and high-performance data platform
- Establish standardized design patterns for low-latency analysis on open table formats at petabyte/population scale
- Provide architectural leadership and partner closely with cross-functional global teams to translate scientific needs into commercial product strategy
- Own the operability, performance, and unit economics of the data platform. Orchestrating and cost-optimizing workloads spanning concurrent jobs
- Champion AI-assisted development tools and workflows to enhance engineering capabilities, productivity, and software quality
- Tech Stack: Java, Python, Apache Iceberg, Parquet, AWS Glue, Spark/Trino, REST/gRPC APIs
Requirements:
- Min 12 years of hands-on experience designing complex, large-scale data platforms or software architectures
- Strong hands-on experience with big data lakehouse architectures, specifically Apache Iceberg internals, Parquet columnar storage, and catalog services like AWS Glue
- Demonstrated experience with cloud hyperscalers (AWS, GCP, or Azure), containerization (Docker), orchestration, and infrastructure automation
- Demonstrated experience utilizing AI tools within software development workflows to accelerate productivity