Member of Technical Staff - Pre-Training Data

You will design and implement techniques to source, curate, and filter large-scale web, text, and code data. You will develop data-quality analyses, run data experiments, evaluate dataset changes, address privacy, safety, and licensing risks, and publish research and datasets.

Responsibilities

• Design and implement techniques for sourcing, curating, and filtering large-scale web, text, and code data
• Develop data-quality metrics and analyses for coverage, diversity, and representativeness
• Design and run data experiments with infrastructure teams
• Investigate and mitigate data privacy, safety, and licensing risks
• Evaluate dataset changes through ablations and scaling experiments
• Publish and present research, code, datasets, and insights

Requirements

• Proficiency in Python
• Familiarity with at least one deep learning framework, such as PyTorch or JAX
• Experience debugging distributed workloads and writing scalable code
• Bachelor’s degree or equivalent experience in a related discipline
• Clear written communication and ability to explain complex technical ideas

Benefits

• Stock options
• Comprehensive medical, dental, vision, and life insurance
• Annual wellness allowance
• Daily office lunch and dinner
• 22 weeks of paid parental leave
• Unlimited paid time off in the U.S.
• 30 days of paid time off in the U.K.
• Visa sponsorship support
• Regular off-sites, happy hours, and team celebrations