AI / ML Engineer
Posted Updated
Description
Key Responsibilities:
- Conversational AI & Personalization. Build context-aware LLM experiences that remember user preferences, goals, and past interactions across sessions.
- RAG & Long-Term Memory. Design retrieval pipelines (vector, graph, structured) and user-profile memory systems that manage relevance, deduplication, and data freshness.
- LLM Orchestration & Optimization. Architect multi-step AI pipelines that balance quality, speed, and cost by optimizing prompts, routing, tool calls, and lightweight ML models alongside reliable fallbacks.
- Quality Evaluation & Testing. Create evaluation datasets, regression tests, and production metrics to continuously measure and improve retrieval, memory accuracy, and response consistency.
- End-to-End Production Engineering. Own Python services and APIs from design through deployment, monitoring token costs, latency, and security in collaboration with product teams.
Must-Have:
- 3-7 years of experience in software engineering, AI/ML engineering, applied ML, or a closely related role.
- Strong Python programming and software engineering fundamentals, including clean code, API design, debugging, testing, and maintainable architecture.
- Hands-on experience building and deploying AI/ML applications using LLMs, generative AI, NLP, or related technologies.
- Practical understanding of RAG, retrieval, embeddings, search, or context-selection systems.
- Experience building backend services and integrating AI capabilities into real applications.
- Understanding of evaluation methods for AI systems, including how to measure quality and detect regressions.
- Experience with production deployment, Docker, and cloud infrastructure such as AWS or an equivalent platform.
- Ability to reason about system design, latency, cost, reliability, and failure handling.
- Ownership mindset: able to independently take a feature from problem definition through implementation, testing, and deployment.
Good to Have:
- Experience with vector databases or search systems such as Qdrant, pgvector, or similar technologies.
- Experience with graph databases such as Neo4j, knowledge graphs, or graph-based retrieval.
- Familiarity with LLM orchestration frameworks such as LangChain, LlamaIndex, or comparable tools.
- Experience with Redis, PostgreSQL, S3, background jobs, queues, and asynchronous processing.
- Familiarity with Hugging Face, model serving, vLLM, fine-tuning, or model optimization.
- Experience with recommendation systems, ranking, user modeling, or personalization.
- Experience with observability and evaluation tools such as Langfuse, tracing platforms, or equivalent solutions.
- Experience with multilingual NLP, Indic languages, or domain-specific knowledge systems.
- Interest in astrology, behavioral personalization, or building AI products that improve with continued user interaction.
What Success Looks Like:
- Ship reliable AI features that are used in the MyNaksh product.
- Improve memory, retrieval, and personalization quality using measurable metrics.
- Reduce unnecessary model calls, inference costs, and response latency without compromising quality.
- Build repeatable evaluation and regression-testing workflows for AI features.
Skills
Sign in to read and join the discussion.