Platform Data Engineer
Posted Updated 6
views
Summary
Leads data-warehouse architecture and ELT pipelines for credit & risk at a consulting firm, building a layered ODS/DWD/DWS/ADS model on Databricks Lakehouse and Alibaba Cloud DataWorks, driving lakehouse migration, data governance, and mentoring 3-5 engineers. Core stack: Databricks, Delta Lake, Spark SQL/PySpark, DataWorks, SQL.
About Us
Hytech is a global management consulting firm headquartered in Australia and Singapore, specializing in digital transformation for fintech and financial services companies. We empower our clients with comprehensive consulting solutions and robust middle- and back-office support, enabling streamlined operations and forward-thinking strategies.
With a team of over 2,000 professionals, Hytech serves a diverse portfolio of clients, including the world's second-largest CFD trading platform and several leading cryptocurrency exchanges. Our global presence spans across Australia, Singapore, Malaysia, Taiwan, the Philippines, Thailand, Morocco, Cyprus, and more.
Responsibilities Own the data-warehouse architecture and ELT pipelines for credit & risk; build a layered model (ODS / DWD / DWS / ADS) on Databricks Lakehouse + Alibaba Cloud DataWorks. Lead subject-area modeling for customer, underwriting, disbursement, repayment, collection and anti-fraud; productize reusable metrics and customer profiles. Drive the migration from classic batch warehousing to a lakehouse (Delta Lake / Iceberg) — unified streaming + batch writes, consistency, rollback and schema evolution. Define and operate the bar for data quality, metadata, lineage, SLA and change-management; guard warehouse and pipeline reliability. Partner deeply with risk modeling, product, finance and compliance to land a single source of truth and self-service consumption. Lead and mentor a team of 3–5 engineers; own coding standards, review process and on-call rotation.
Requirements Bachelor's or above in CS / Software / Math / Statistics; 3+ years building warehouses in banking, consumer credit, lending or payments. Expert in Kimball dimensional modeling, SCD and metric-layer design. Hands-on with Databricks (Delta Lake, Unity Catalog, Spark SQL / PySpark, DLT) and Alibaba Cloud DataWorks (MaxCompute, Hologres, Flink, DataHub). Deep SQL & Spark tuning — partitioning, Z-Order, shuffle, broadcast, AQE. Familiar with governance tooling (DataHub / Atlas / Data Map). Strong cross-functional, upward-communication and written-spec skills. Familiarity with AI frameworks and tools such as
LangChain, LangGraph, Dify, n8n, and OpenClaw
, with hands-on experience applying AI capabilities to solve problems in real-world projects.
Hytech is a global management consulting firm headquartered in Australia and Singapore, specializing in digital transformation for fintech and financial services companies. We empower our clients with comprehensive consulting solutions and robust middle- and back-office support, enabling streamlined operations and forward-thinking strategies.
With a team of over 2,000 professionals, Hytech serves a diverse portfolio of clients, including the world's second-largest CFD trading platform and several leading cryptocurrency exchanges. Our global presence spans across Australia, Singapore, Malaysia, Taiwan, the Philippines, Thailand, Morocco, Cyprus, and more.
Responsibilities Own the data-warehouse architecture and ELT pipelines for credit & risk; build a layered model (ODS / DWD / DWS / ADS) on Databricks Lakehouse + Alibaba Cloud DataWorks. Lead subject-area modeling for customer, underwriting, disbursement, repayment, collection and anti-fraud; productize reusable metrics and customer profiles. Drive the migration from classic batch warehousing to a lakehouse (Delta Lake / Iceberg) — unified streaming + batch writes, consistency, rollback and schema evolution. Define and operate the bar for data quality, metadata, lineage, SLA and change-management; guard warehouse and pipeline reliability. Partner deeply with risk modeling, product, finance and compliance to land a single source of truth and self-service consumption. Lead and mentor a team of 3–5 engineers; own coding standards, review process and on-call rotation.
Requirements Bachelor's or above in CS / Software / Math / Statistics; 3+ years building warehouses in banking, consumer credit, lending or payments. Expert in Kimball dimensional modeling, SCD and metric-layer design. Hands-on with Databricks (Delta Lake, Unity Catalog, Spark SQL / PySpark, DLT) and Alibaba Cloud DataWorks (MaxCompute, Hologres, Flink, DataHub). Deep SQL & Spark tuning — partitioning, Z-Order, shuffle, broadcast, AQE. Familiar with governance tooling (DataHub / Atlas / Data Map). Strong cross-functional, upward-communication and written-spec skills. Familiarity with AI frameworks and tools such as
LangChain, LangGraph, Dify, n8n, and OpenClaw
, with hands-on experience applying AI capabilities to solve problems in real-world projects.