Senior AI Data Engineer - LLM Evaluation
Summary
Senior AI data engineer on Procore's Auckland data science team, owning the accuracy of LLM-powered features by building data pipelines, tooling, and evaluation infrastructure. Works hands-on with Python and SQL, evaluation datasets, prompt engineering, and label quality controls.
Procore seeks a Senior Software Engineer for its Data Science team in Auckland. You will own the accuracy of LLM-powered features by building data, tooling, and evaluation infrastructure to make AI more reliable.
You’ll collaborate with engineering, product, and AI teams to integrate data and models from candidate selection to production, using Python, SQL, and evaluation skills. The role requires hands-on experience with evaluation datasets, prompt engineering, and label quality controls, with