AI Engineer (Mid - Senior Level)
Posted Updated
Description
We are looking for a mid-Senior AI Engineer who can own AI features end-to-end—from shaping the approach with product and design to architecting, shipping, and running them in production. You will be a hands-on builder first, while also setting technical direction, raising engineering standards, and mentoring engineers around you.
Responsibilities:
- Partner with product, design, and business stakeholders to shape and deliver conversational AI experiences for our users, translating product goals into technical plans.
- Own the end-to-end design and architecture of LLM-powered features, making and documenting key technical decisions and trade-offs.
- Deliver independently and take full ownership of outcomes, from early prototype through production and ongoing iteration.
- Understand the data we have and identify how it can be leveraged to create more personalized experiences for our users.
- Lead fine-tuning of models on data specific to our use case, and decide when fine-tuning, RAG, or prompting is the right approach.
- Design and optimize RAG pipelines (retrieval, chunking, re-ranking, hybrid search) to augment what the LLM already knows.
- Architect agentic systems that plan, call tools, and hold state across multi-step conversations.
- Define and own the evaluation strategy, build eval sets, and keep prompts and context versioned and tested against them.
- Serve models in production and own the numbers—latency, throughput, and cost.
- Keep systems reliable as they scale: monitoring, evals, guardrails, fallbacks, and no silent regressions.
- Help extend our products to work well in Indian languages and across voice, text, and documents.
- Mentor and guide junior and mid-level engineers through code reviews, design reviews, and pairing.
- Establish best practices, reusable components, and tooling for the wider AI engineering team.
- Stay current with the latest research, evaluate new models and techniques quickly, and ship what actually works.
- Set up new workflows, systems, and tools from the ground up (you will have support, but we're a startup building things from scratch, so be ready to do whatever it takes).
Requirements:
- 5-8 years of experience building production systems spanning AI and software engineering, including at least 2 years of hands-on experience with LLMs and generative AI.
- Proven track record of taking at least one LLM-based product or feature from design to production and owning it post-launch.
- Strong experience with agentic frameworks and orchestration, and with building conversational bots.
- Hands-on experience fine-tuning models (e. g., LoRA/QLoRA, distillation, DPO/RLHF, or other open-weight model adaptation).
- Deep experience with RAG-based approaches, including retrieval quality measurement and optimization.
- Experience designing evaluation frameworks and running LLM systems with monitoring and observability.
- Strong coding, system design, and architecture fundamentals; able to lead technical design discussions.
- Experience mentoring engineers or acting as a technical lead on a project.
- Clear communicator who can explain technical trade-offs to non-technical stakeholders.
- Experience with high-throughput model serving (e. g., vLLM, SGLang, TensorRT-LLM) and GPU performance tuning is a plus.
- Experience with Indic-language NLP, speech (ASR/TTS), or multimodal document understanding is a plus.
- Open-source contributions, patents, or publications in the LLM/AI space are a plus.
- Understanding of financial concepts and investing would be a big plus but not required.
Skills
Sign in to read and join the discussion.