Principal AI Solutions Engineer
Summary
Designs, deploys, and maintains infrastructure for AI training, fine-tuning, and inference workloads in a banking-sector AI transformation program, deploying Kubernetes (OpenShift/RKE2/Charmed) on virtualized and bare-metal environments with GPU support. Core stack: Linux, Python, Terraform, Ansible, GPU orchestration.
- Principal AI Solutions Engineer
- 100% Remote
About Our Cliente:
We are expanding several Artificial Intelligence and infrastructure teams for one of the most ambitious AI transformation and automation programs within the banking sector.
Job Description:
We are looking for an experienced Principal AI Infrastructure Engineer to design, deploy, and maintain the infrastructure supporting AI training, fine-tuning, and inference workloads.
You will work across infrastructure, AI/ML, networking, cybersecurity, and operations teams, helping build scalable, secure, and highly available environments for next-generation AI workloads.
Key Responsibilities:
- Design, deploy, and maintain AI infrastructure supporting training, fine-tuning, and inference workloads.
- Deploy and administer Kubernetes platforms in virtualized and bare-metal environments.
- Implement infrastructure automation using Python, Terraform, and Ansible.
- Support and optimize GPU-enabled environments for AI and Generative AI workloads.
- Collaborate with AI/ML, networking, security, and operations teams to deliver scalable and secure AI platforms.
- Troubleshoot, optimize, and improve platform performance, reliability, and high availability
Profile (M/F/D)
- 8+ years of experience with Kubernetes and container orchestration in business-critical environments.
- Strong Linux experience, particularly RHEL, RHCOS, SUSE, or Ubuntu.
- Hands-on experience with Kubernetes platforms such as OpenShift, RKE2, or Charmed Kubernetes.
- Strong knowledge of data center infrastructure, networking, storage, virtualization, and bare metal.
- Experience with GPU infrastructure, including vGPU, passthrough, MIG, and GPU orchestration.
- Strong skills in Python, Ansible, and Terraform.
- Knowledge of GenAI, LLMs, RAG, AI training, and inference workloads.
- Experience with monitoring, distributed systems, high availability, and infrastructure security.
- High level of English
Nice to Have
- Experience with VMware ESXi, vSAN, VMFS, or NFS.
- Experience with Machine Learning / Deep Learning platforms and MLOps.
- Previous experience in banking or other regulated environments.
Conditions
- 100% Remote
- Highly collaborative and international environment
- Challenging projects involving AI, GenAI, Kubernetes, and GPU infrastructure
- Highly competitive environment