Member of Technical Staff - Pre-Training
Posted 2
views
Summary
Research-focused engineer on Reflection's pre-training team: designs and runs experiments on language-model scaling, data efficiency, optimizers, and model architecture; implements deep learning methods, leads small research projects, and optimizes distributed training infrastructure, primarily using Python and PyTorch.
You will research and build solutions for algorithms, scaling laws, data processing, optimizers, and model architecture. You will run experiments on language-model scaling and data efficiency, implement deep learning methods, lead research projects, optimize training infrastructure, and contribute from low-level optimization through high-level model design.
Responsibilities
- Research and build solutions across algorithms scaling laws data processing optimizers and model architecture
- Design and run experiments on language model scaling and data efficiency
- Implement deep learning methods
- Lead small research projects
- Optimize training infrastructure for efficient scaling
- Contribute from low-level optimization through high-level model design
Requirements
- Computer science
- Machine learning
- Software engineering
- ETL
- Training data
- Language model
- Distributed training
- Python
- PyTorch
- Deep learning
- Communication
Benefits
- Stock options
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Annual wellness allowance
- Daily office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 days of vacation in the U.K.
- Visa sponsorship
- Regular off-sites
- Happy hours
- Team celebrations