Senior/Lead AI/ML Performance Engineer

We are looking for a Senior/Lead AI/ML Performance Engineer to benchmark and profile AI/ML workloads on TPU hardware to generate the empirical performance data that feeds the optimization solver's cost model.

Responsibilities

• Conduct JAX/XLA benchmarking on physical TPU slices
• Capture and analyze TPU Profiler traces
• Build hardware coefficient matrices for use in the optimizer's cost model
• Profile LLM training/inference performance (FLOPS, memory access, token throughput)
• Collaborate with Optimization Engineers to calibrate solver inputs

Requirements

• Strong understanding of the modern AI/ML landscape and LLM architectures
• Hands-on experience with LLM models/pipelines (training and inference)
• Proficiency in Python and/or Golang
• Familiarity with TensorFlow, PyTorch, and LangChain
• Experience with JAX/XLA and TPU-specific profiling tools

Nice to have

• Experience with GPU/TPU performance benchmarking at scale
• Background in ML systems or MLPerf-style benchmarking

Benefits

• Opportunity to work in a fast-paced, agile, software engineering culture
• Comfortable modern office in Prague 7, with support of hybrid or fully remote mode
• Benefit program (5 weeks of vacation, paid sick days, paid days off for special occasions, meal vouchers, flexi pass, Prague city public transport annual coupon, multisport cards, optional contribution to pension fund, health insurance for family member)
• EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
• English language courses
• Czech language courses upon request
• Referral bonuses for recommended candidates
• Mobile Phone Tariff’s program for managerial-level candidates
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more

• Opportunity to work in a fast-paced, agile, software engineering culture
• Benefit program (5 weeks of vacation, 5 paid sick days, meal vouchers, cafeteria and recreation bonuses, reimbursement of glasses, contribution to pension fund)
• Referral bonuses for recommended candidates
• English language courses
• Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more