Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Cohere

Member of Technical Staff (Training Performance Engineer)

Posted Updated

Description

  • As a Performance Engineer in the Pre-Training team you will be responsible for optimizing the performance of our advanced language models and systems
  • Their primary focus is on improving key model training metrics, such as training throughput, ensuring high accelerator utilization
  • The team combines expertise in software engineering, machine learning, and low-level kernel design and development to design robust systems and enhance model performance
  • You will work on identifying and removing performance bottlenecks, develop cutting-edge training and profiling tools to help Cohere’s mission of providing efficient and reliable language understanding and generation capabilities and drive innovation in the field of natural language processing
  • Design and write high-performant and scalable software for training
  • Understand architectural modifications and design choices and their effects on training throughput and quality
  • Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators
  • Research, implement, and experiment with ideas on our supercompute and data infrastructure
  • Learn from and work with the best researchers in the field

Benefits

  • Six weeks’ paid vacation
  • Equity / stock options
  • RRSP, 401(k), and Pension Scheme contributions
  • Coverage for 100% of your insurance premiums across health, dental, vision, and travel
  • Additional coverage for accessing mental health providers/services
  • Six months of fully paid parental leave, including adoption and surrogacy
  • Financial support for egg freezing and IVF in Canada and the UK
  • A monthly fitness and wellness allowance
  • Globally dispersed company that supports a remote work culture
  • A $2,000 annual education benefit for professional development
  • A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
  • A monthly arts and culture allowance
  • A monthly quality time allowance
  • Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
  • Experience writing kernels for GPUs using CUDA, triton, etc
  • Extremely strong software engineering skills
  • Experience using large-scale distributed training strategies
  • Familiarity with autoregressive sequence models, such as Transformers
  • Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
  • If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

Skills

Apply

See also

Software Engineering jobs by country — openings, pay and top skills →