Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Kodense

AI Systems Engineer (3+ Years Experience)

Posted 185 views

Summary

Deploy and optimize production AI inference at Kodense: run open-weight LLMs (Llama 3, Mistral, DeepSeek) with vLLM/Ollama/Triton, build low-latency Python/FastAPI microservices, and manage secure private-cloud GPU infrastructure. Hybrid role at Koramangala, Bengaluru; ₹7,00,000 fixed CTC.

Compensation: ₹7L – ₹7L • No equity

We're hiring an AI Systems Engineer (3+ Years Experience) at Kodense in Koramangala, Bengaluru (Hybrid).

Kodense builds private cloud AI infrastructure and forward-deployed engineering teams for enterprise environments. You’ll be working directly on production AI systems—no wrapper apps, no slow corporate bureaucracy.

What You'll Work On: • High-Throughput Inference: Deploy and optimize open-weight models (Llama 3, Mistral, DeepSeek) in production using vLLM, Ollama, and Triton. • Private Cloud Infrastructure: Set up secure, isolated VPC environments and GPU compute instances with zero public data leakage. • Low-Latency AI APIs: Build production Python & FastAPI microservices with real-time token streaming, rate limiting, and 99.9% uptime. • Model Optimization: Fine-tune latency and memory footprint using quantization (AWQ/GGUF), KV caching, and GPU memory tuning.

What We Look For: • 3+ years of production experience in Python, Docker, Linux, and backend API engineering. • Hands-on experience serving LLMs in production (vLLM, Hugging Face, or Triton). • Familiarity with cloud environments (AWS, GCP, or Azure) and private networking. • Strong systems fundamentals (concurrency, memory management, and debugging).

Compensation & Benefits: • ₹7,00,000 Fixed CTC (100% fixed cash: ₹58,333/month, zero withheld variable). • ~98% take-home salary under Section 115BAC near-zero tax threshold. • Up to ₹30,000 notice period buyout support. • Hybrid work model at Prestige Cube, Koramangala, Bengaluru. • Fast 48-hour hiring turnaround with direct founder review.

Apply directly in 2 minutes: https://kodense.ai/careers

Skills

Apply

See also

Software Engineering jobs by country — openings, pay and top skills →