Python Developer-AI Evaluation
Posted Updated
Description
ZettaMine Labs Pvt. Ltd. in Canada is seeking Senior Software Engineers for a remote, freelance Python/TypeScript evaluation project focused on improving AI models through high-quality training data and data rubric development.
You will design evaluation rubrics, build data pipelines, review data quality, and collaborate with researchers to translate qualitative judgments into scalable processes. Immediate availability and strong communication are valued.
Design, develop, and improve evaluation rubrics and criteria for preference data. Review and label data ensuring high quality and accuracy. Identify subtle issues in data and evaluation results. Build and maintain pipelines/infrastructure for data generation, collection, and evaluation. Analyze findings and prepare clear reports and recommendations. Collaborate with researchers and engineers to scale qualitative judgments. Support AI training/evaluation workflows to improve model outputs. Communicate technical findings and suggest improvements to teams. Experience building, maintaining, and improving software pipelines and infrastructure. Hands-on experience with preference data collection and/or rubric creation. Ability to review technical data and evaluate quality using defined criteria. Strong analytical, problem-solving, and technical judgment skills. Experience working with large codebases; VS Code is an advantage. Excellent written and verbal communication skills. Fully remote work environment Cutting-edge AI projects Competitive hourly compensationSkills
Sign in to read and join the discussion.