Llm Pre-Training & Distributed Engineer (Ai Infrastructure)
Posted 4
views
Summary
Orchestrates large-scale LLM pre-training runs across ~1,000-GPU clusters and optimizes the distributed infrastructure behind them, using frameworks like PyTorch, DeepSpeed, and Megatron-LM to keep training efficient and reliable.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes. Responsibilities: Orchestrate distributed training runs across 1,000 GPUs using PyTorch, DeepSpeed, or Megatron-LM. Optimize…