Senior Data Platform Engineer Lakehouse
Summary
Senior Data Platform Engineer at Hyve Solutions builds and operates a petabyte-scale Apache Iceberg lakehouse: leading the migration from Hadoop/HDFS to object storage, developing metadata/catalog/governance services, and optimizing Spark workloads on Kubernetes for batch, streaming, and incremental pipelines.
Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.
This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale.
Key Responsibilities:
- Design and operate Apache Iceberg Lakehouse platforms
- Lead Hadoop and HDFS migration to object storage
- Develop metadata, catalog, governance, and access services
- Optimize Spark performance, reliability, and cost efficiency
- Operate Kubernetes workloads and resource management
Requirements:
- Expert knowledge of Apache Spark execution and optimization
- Experience with Iceberg, Hudi, or Delta Lake
- Hands-on Kubernetes data workload deployment experience
- Cloud object storage and Lakehouse architecture knowledge
- Three or more years in data platform engineering
Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ modern Lakehouse platform.
Skills
Sign in to read and join the discussion.