Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

J&L Apex Advisory

NewBe an early applicant

Senior Member of Technical Staff (AI Data)

Posted 14 views

Description

What you will do:

- Own collection pipelines end to end — sourcing, ingestion, storage, and versioning — for SFT, preference, and agent-trajectory data.

- Build cleaning and quality control that is measurable: deduplication, filtering, labelling standards, spot checks, and batch acceptance criteria that a vendor can be held to.

- Manage vendor relationships: scope the work, define quality bars, run trials, audit deliveries, and hold suppliers to the standard rather than hoping for it. Renegotiate or replace when the data does not clear the bar.

- Build the tooling that makes quality visible — dashboards, per-batch reports, and failure taxonomies the model teams can act on rather than merely read.

- Work with researchers so that data supply tracks what training actually needs, not what is easy to collect or what a vendor already has lying around.

- Build evaluation baselines for the domains that matter to us now: software engineering (coding agents) and video generation.

- On the coding side: curate and lock datasets, build reproducible end-to-end runs, and report model-level metrics that survive review by people who do not trust benchmarks by default.

- On the video side: design a consistency-evaluation scheme, generate evaluation sets at meaningful scale, and produce model comparisons with conclusions rather than scores.

- Build the infrastructure — test-case definition, metric plumbing, latency/token/cost accounting — so that evaluating a new model is a routine operation rather than a project.

- Keep the loop honest: detect contamination, judge drift, and the gap between offline metrics and how the thing actually feels in use, and say so when the numbers and the experience disagree.

What we are looking for:

- Strong data engineering skills: pipelines, storage, schema discipline, and code that others can maintain after you move on.

- A strong academic background is expected; publications are a strong plus, ideally including work on data quality, evaluation, benchmarks, or reproducibility.

- We equally welcome people whose excellence shows in shipped data platforms, competition results, or rigorous operational work we can inspect.

- Real experience with data quality at scale, and the scepticism to distrust a dataset that has not been audited.

- Fluency in Python; comfort with the realities of scored, noisy metrics and with setting standards an external vendor must meet.

Nice to have:

- Experience with agent trajectory or UI-interaction data.

- Familiarity with annotation platforms and human-in-the-loop quality processes.

- Experience with LLM-as-judge calibration and its failure modes.

- Background in privacy-aware data handling, given that personal data is the point of our product.

- Experience with cost control on storage and processing at scale.


HOW TO APPLY

Apply via LinkedIn. All applications are handled in strict confidence. Only shortlisted candidates will be contacted.


J&L Apex Advisory Pte. Ltd. | EA No. 26S3529 | EA Personnel No. R1329267


Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

See also

Software Engineering jobs by country — openings, pay and top skills →