Member of Technical Staff (Training Performance Engineer)
Posted Updated
Description
- As a Performance Engineer in the Pre-Training team you will be responsible for optimizing the performance of our advanced language models and systems
- Their primary focus is on improving key model training metrics, such as training throughput, ensuring high accelerator utilization
- The team combines expertise in software engineering, machine learning, and low-level kernel design and development to design robust systems and enhance model performance
- You will work on identifying and removing performance bottlenecks, develop cutting-edge training and profiling tools to help Cohere’s mission of providing efficient and reliable language understanding and generation capabilities and drive innovation in the field of natural language processing
- Design and write high-performant and scalable software for training
- Understand architectural modifications and design choices and their effects on training throughput and quality
- Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators
- Research, implement, and experiment with ideas on our supercompute and data infrastructure
- Learn from and work with the best researchers in the field
Benefits
- Six weeks’ paid vacation
- Equity / stock options
- RRSP, 401(k), and Pension Scheme contributions
- Coverage for 100% of your insurance premiums across health, dental, vision, and travel
- Additional coverage for accessing mental health providers/services
- Six months of fully paid parental leave, including adoption and surrogacy
- Financial support for egg freezing and IVF in Canada and the UK
- A monthly fitness and wellness allowance
- Globally dispersed company that supports a remote work culture
- A $2,000 annual education benefit for professional development
- A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
- A monthly arts and culture allowance
- A monthly quality time allowance
- Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
- Experience writing kernels for GPUs using CUDA, triton, etc
- Extremely strong software engineering skills
- Experience using large-scale distributed training strategies
- Familiarity with autoregressive sequence models, such as Transformers
- Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
- If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!
Skills
Sign in to read and join the discussion.