freehire launches on Product Hunt on 26 August.

Follow →

Senior AI Engineer with Kubernetes

Open 35d posting dated 3 weeks ago

Summary

Build and scale production-grade AI systems using LLM frameworks, vector databases (Milvus/Qdrant), and Kubernetes, deploying embeddings and containerized microservices.

We are seeking a highly skilled Senior AI Engineer with strong expertise in Kubernetes and vector database technologies to join our team. In this role, you will design, build, and scale production-grade AI systems, working with cutting-edge LLM frameworks, embeddings, and cloud-native infrastructure to deliver robust and high-performance solutions.

Responsibilities

  • Deploy and manage Milvus vector databases, including schema design and index tuning (HNSW, IVF-FLAT)
  • Build and maintain embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere
  • Manage Kubernetes clusters, Helm charts, and containerized microservices in production
  • Develop and maintain Docker containerization workflows, including multi-stage builds and registry management
  • Design and deliver production-grade Python applications, integrating with Go, Java, or C++ where required
  • Integrate object storage systems such as AWS S3, MinIO, or Google Cloud Storage
  • Evaluate and implement alternative vector database solutions, including Qdrant, Pinecone, and Weaviate
  • Collaborate cross-functionally with team members to deliver reliable, scalable AI services
  • Ensure operational excellence, observability, and performance of deployed AI workloads

Requirements

  • Bachelor's degree in Engineering with 5+ years of relevant experience
  • Expertise in Milvus deployment, schema design, and index tuning (HNSW, IVF-FLAT)
  • Familiarity with vector database alternatives such as Qdrant, Pinecone, Weaviate, PGVector, or Chroma
  • Proficiency in building embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere
  • Skills in Kubernetes cluster management, Helm charts, and containerized microservices
  • Background in Docker containerization, multi-stage builds, and registry management
  • Production-level Python development along with Go, Java, or C++
  • Knowledge of object storage integration, including AWS S3, MinIO, or Google Cloud Storage
  • Excellent verbal and written communication skills with strong team collaboration abilities
  • Proficiency in English at an Upper-Intermediate level (B2) or higher

Nice to have

  • Experience supporting large-scale RAG applications and multi-agent platforms
  • Hands-on familiarity with LangChain, LlamaIndex, or custom pipelines
  • Understanding of GPU scheduling, resource optimization, and inference acceleration
  • Production experience with hybrid search, metadata filtering, and index tuning
  • Implementation of LLM evaluation, governance, tracing, and monitoring tools
  • Familiarity with CI/CD pipelines, Infrastructure-as-Code, and cloud-native deployment practices
  • Prior work experience in the Oil and Gas industry
  • Experience with Dataiku DSS
  • Knowledge of SRE practices

Benefits

We connect like-minded people

  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events

We invest in your growth

  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers

We cover it all

  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Five trust days per year (sick leave without a medical certificate)
  • Benefits package (sports activities, a variety of stores and services)

We connect like-minded people

  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events

We invest in your growth

  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers

We cover it all

  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Four trust days per year for personal needs
  • Discounts for fitness clubs
  • Benefits package (hotels, restaurants, stores and services)

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events

We invest in your growth:

  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers
  • Discounts in local language schools, including online courses for the Kazakh language

We cover it all:

  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Medical & family care package
  • Six trust days per year (sick leave without a medical certificate)
  • Coverage of psychology sessions of your choice
  • Benefits package (sports activities, a variety of stores and services)
  • Housing support program: preferential mortgage access via Otbasy Bank partnership

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events

We invest in your growth:

  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers

We cover it all:

  • Monetary bonuses for engaging in the referral program
  • Medical & family care package
  • Six trust days per year (sick leave without a medical certificate)
  • Coverage of psychology sessions of your choice
  • Discounts for fitness clubs and sports programs
  • Benefits package (sports activities, a variety of stores and services)

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events

We invest in your growth:

  • Leadership development, career advising, soft skills and well-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to EPAM's internal learning database
  • Free English classes with certified teachers
  • Discounts in local language schools, including offline courses for the Uzbek language

We cover it all:

  • Monetary bonuses for engaging in the referral program
  • Medical & family care package
  • Four trust days per year (sick leave without a medical certificate)
  • Discounts for fitness clubs, dance schools and sports programs
  • Benefits package (sports activities, a variety of stores and services)

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available