AI Harness Architect - Senior Data Engineer
Summary
A senior data engineer at NCS designs and builds the AI harness for a modern data platform based on Apache Iceberg, Trino, and Parquet. Day to day, they create a multi-agent framework with stateful workflows and develop agents that discover Iceberg catalogs, profile datasets, generate metadata, ingest data, and optimize data structures.
NCS PTE. LTD. is seeking an autonomous AI Engineer to design and build the AI Harness for a modern data platform based on Apache Iceberg, Trino, and Parquet.
You will focus on creating the agent framework to enable multi-agent collaboration, stateful workflows, and end-to-end data engineering capabilities. Responsibilities include developing specialized agents to discover Iceberg catalogs, profile datasets, generate metadata, ingest data from diverse sources, and optimize data structures.