Principal AI/ML Infra Engineer (GPU & Cloud)
Posted Updated
Description
Oracle is seeking a Principal Core Infrastructure Engineer (AI/ML Forward Deployed Infrastructure Engineer) to design, implement, and maintain AI/ML infrastructure for customer deployments in Hong Kong. You will partner with data scientists, software engineers, and internal cloud services to deploy AI/ML solutions securely, efficiently, and at scale.
The role emphasizes end-to-end technical execution, including POCs, troubleshooting, and post-sales support.
Design, deploy, and manage infrastructure components to support AI/ML workflows. Collaborate with scientists and engineers to understand infrastructure requirements. Implement automation for provisioning, configuring, and monitoring AI/ML infrastructure. Optimize infrastructure performance and resource utilization. Ensure security and compliance across the AI/ML stack. Troubleshoot performance, scalability, and reliability issues and mitigate downtime. Document designs, configurations, and procedures for knowledge sharing. Experience with scripting and automation using Ansible, Terraform, Python and/or Kubernetes. Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (like Slurm, PBS, etc.) for managing distributed systems. Solid understanding of networking concepts, security principles, and best practices. Excellent problem-solving skills, with the ability to troubleshoot complex issues and drive resolution in a fast-paced environment. Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams and convey technical concepts to non-technical stakeholders. Strong documentation skills with experience documenting infrastructure designs, configurations, procedures, and troubleshooting steps to facilitate knowledge sharing, ensure maintainability, and enhance team collaboration. Strong Linux skills with hands-on experience in Oracle Linux/RHEL/CentOS, Ubuntu, and Debian distributions, including system administration, package management, shell scripting, and performance optimization.Skills
Sign in to read and join the discussion.