Senior AI Engineer with Kubernetes
Summary
Build and scale production-grade AI systems using LLM frameworks, vector databases (Milvus/Qdrant), and Kubernetes, deploying embeddings and containerized microservices.
We are seeking a highly skilled Senior AI Engineer with strong expertise in Kubernetes and vector database technologies to join our team. In this role, you will design, build, and scale production-grade AI systems, working with cutting-edge LLM frameworks, embeddings, and cloud-native infrastructure to deliver robust and high-performance solutions.
Responsibilities
- Deploy and manage Milvus vector databases, including schema design and index tuning (HNSW, IVF-FLAT)
- Build and maintain embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere
- Manage Kubernetes clusters, Helm charts, and containerized microservices in production
- Develop and maintain Docker containerization workflows, including multi-stage builds and registry management
- Design and deliver production-grade Python applications, integrating with Go, Java, or C++ where required
- Integrate object storage systems such as AWS S3, MinIO, or Google Cloud Storage
- Evaluate and implement alternative vector database solutions, including Qdrant, Pinecone, and Weaviate
- Collaborate cross-functionally with team members to deliver reliable, scalable AI services
- Ensure operational excellence, observability, and performance of deployed AI workloads
Requirements
- Bachelor's degree in Engineering with 5+ years of relevant experience
- Expertise in Milvus deployment, schema design, and index tuning (HNSW, IVF-FLAT)
- Familiarity with vector database alternatives such as Qdrant, Pinecone, Weaviate, PGVector, or Chroma
- Proficiency in building embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere
- Skills in Kubernetes cluster management, Helm charts, and containerized microservices
- Background in Docker containerization, multi-stage builds, and registry management
- Production-level Python development along with Go, Java, or C++
- Knowledge of object storage integration, including AWS S3, MinIO, or Google Cloud Storage
- Excellent verbal and written communication skills with strong team collaboration abilities
- Proficiency in English at an Upper-Intermediate level (B2) or higher
Nice to have
- Experience supporting large-scale RAG applications and multi-agent platforms
- Hands-on familiarity with LangChain, LlamaIndex, or custom pipelines
- Understanding of GPU scheduling, resource optimization, and inference acceleration
- Production experience with hybrid search, metadata filtering, and index tuning
- Implementation of LLM evaluation, governance, tracing, and monitoring tools
- Familiarity with CI/CD pipelines, Infrastructure-as-Code, and cloud-native deployment practices
- Prior work experience in the Oil and Gas industry
- Experience with Dataiku DSS
- Knowledge of SRE practices
Benefits
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Four trust days per year for personal needs
- Discounts for fitness clubs
- Benefits package (hotels, restaurants, stores and services)
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
- Discounts in local language schools, including online courses for the Kazakh language
We cover it all:
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Benefits package (sports activities, a variety of stores and services)
- Housing support program: preferential mortgage access via Otbasy Bank partnership
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all:
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Discounts for fitness clubs and sports programs
- Benefits package (sports activities, a variety of stores and services)
We connect like-minded people:
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth:
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
Discounts in local language schools, including offline courses for the Uzbek language
We cover it all:
- Monetary bonuses for engaging in the referral program
- Medical & family care package
- Four trust days per year (sick leave without a medical certificate)
- Discounts for fitness clubs, dance schools and sports programs
- Benefits package (sports activities, a variety of stores and services)