Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Gemini, Cursor and Grok
Connect

ZecData Technology

NewBe an early applicant

GPU & ML Infrastructure Engineer(Exp 10+ yrs)

Posted Updated
Discussion

Description

GPU & ML Infrastructure Engineer(Exp : 10+ yrs) Company: ZecData Technology Job Location: Remote (Work from home), India Employment Type: Full-time Experience Required: 10+ years Salary: 1.5L1.75L a month Experience: 10+ years preferred (8+ years for exceptional candidates) Location: Remote Overlap: Must be available until 11:00 AM PST Role : Were looking for an experienced GPU & ML Infrastructure Engineer to build and maintain infrastructure for NVIDIA GPU benchmarking, stress testing, ML workloads, telemetry, and data generation across data-center and edge/embedded platforms. Responsibilities Deploy and optimize LLM inference/training workloads, including Llama-family models. Build GPU benchmarks and synthetic workloads: GEMM, convolution, compute, memory bandwidth, multi-GPU, and vision. Collect and validate GPU/hardware telemetry using NVML, DCGM, BMC, IPMI, and Redfish. Automate infrastructure deployment, workload execution, logging, data collection, and validation. Diagnose GPU sensor, sampling, timing, power, and thermal issues. Ensure workloads are reproducible and telemetry/data is accurate and well documented. Maintain hardware, driver, firmware, workload, and run metadata. Required Skills Strong experience with NVIDIA GPUs and Linux systems. Hands-on LLM inference/training experience. Experience with quantized and full-precision models. Strong knowledge of GPU drivers, process orchestration, scheduling, and automation. Experience collecting and analyzing hardware telemetry programmatically. Understanding of workload reproducibility and performance benchmarking. Strong scripting/automation skills. Nice to Have NCCL, multi-GPU scaling, tensor/pipeline parallelismGPU benchmarking/stress-testingGPU power/thermal management and throttling Hardware qualification or performance testing Time-series telemetry and data-quality validation Ideal candidate: An independent engineer comfortable owning the complete workflowfrom bringing up new GPU platforms and running ML workloads to collecting reliable telemetry and producing reproducible datasets. Compensation: 150,000.00 - 175,000.00 per month Benefits: Provident Fund Work Location: Remote .

Skills

Apply

See also

DevOps jobs by country — openings, pay and top skills →