freehire launches on Product Hunt on 26 August.

Follow →

Senior AI Engineer

Summary

Build and deploy production-grade AI systems using RAG, agentic frameworks (LangGraph, AutoGen), and vector search (Azure AI Search, pgvector) with Python and cloud tools.

We are seeking a Senior AI Engineer to design and build scalable AI solutions with a strong focus on Agentic AI, RAG systems, and production-grade LLM applications. The role emphasizes hands‑on development, practical system design, and reliable production deployment, along with structured evaluation and observability practices.

Responsibilities

  • Design and implement RAG‑based AI systems with hybrid search, embeddings, and optimized retrieval strategies.
  • Build and deploy AI agents using modern agentic AI frameworks.
  • Develop multi‑step workflows and tool‑using agents for real‑world business use cases.
  • Build conversational AI systems with context handling and multi‑turn interactions.
  • Design scalable AI services for real‑time and batch use cases.
  • Design and implement solutions using at least one of the following frameworks:
    • LangGraph
    • Semantic Kernel
    • AutoGen
    • CrewAI
    • OpenAI Agents SDK
  • Demonstrate working knowledge of multiple agent frameworks and their trade‑offs.
  • Apply prompt engineering, few‑shot learning, and retrieval techniques to improve LLM performance.
  • Build reusable components for agent orchestration, tool usage, and workflow design.
  • Design and implement semantic search and vector‑based retrieval systems.
  • Hands‑on experience with Azure AI Search and PostgreSQL (pgvector).
  • Optimize embedding strategies, indexing, and query performance.
  • Implement LLM evaluation approaches (offline testing, basic automated evaluation pipelines).
  • Define and track quality metrics such as accuracy, relevance, and response quality.
  • Apply techniques for hallucination detection and mitigation.
  • Build basic monitoring and observability for AI systems (logs, traces, performance metrics).
  • Continuously improve model performance based on evaluation insights.
  • Develop APIs and microservices for integrating AI systems.
  • Work with cloud platforms (Azure/AWS/GCP) and containerization (Docker).
  • Contribute to deployment pipelines and production readiness.
  • Prototype and validate solutions through POCs and pilots.

Requirements

  • 6–9 years of experience in AI/ML.
  • Strong Python skills and experience with ML frameworks (PyTorch or TensorFlow).
  • Practical experience building LLM‑based applications and RAG pipelines.
  • Hands‑on experience with at least one agentic AI framework:
    • LangGraph, Semantic Kernel, AutoGen, CrewAI, or OpenAI Agents SDK.
  • Familiarity with multi‑agent workflows and orchestration patterns.
  • Experience with vector databases and semantic search systems.
  • Hands‑on exposure to Azure AI Search and pgvector (PostgreSQL).
  • Understanding of embeddings and similarity search.
  • Experience or strong understanding of:
    • LLM evaluation techniques.
    • Output quality measurement.
    • Hallucination detection approaches.
    • Monitoring and observability concepts.
  • Agentic AI frameworks: LangGraph, Semantic Kernel, AutoGen, CrewAI, OpenAI Agents SDK.
  • RAG frameworks: LangChain, LlamaIndex.
  • Vector databases: Azure AI Search, pgvector.
  • LLM/ML: PyTorch, OpenAI APIs.
  • Serving: FastAPI.
  • Infrastructure: Azure/AWS/GCP, Docker.
  • Monitoring: LangSmith (or similar).
  • Languages: Python.

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available