Software Engineer III, Infrastructure
Summary
Infrastructure software engineer on Google Cloud optimizing the Lustre parallel file system on GCP for large-scale AI/ML training and inferencing workloads. Day to day: writing system code, profiling and tuning storage performance, debugging issues, and integrating Lustre with GCP services like GKE, GCS, and Vertex AI. Key tech: C, Linux kernel, distributed systems.
In this role, you will optimize Lustre on Google Cloud Platform (GCP) and enable AI/ML customers to bring more of their training and inferencing workloads to GCP, Generative AI, and AI/ML in general, has seen a massive explosion in adoption and application. As a part of this role, you will work with Lustre, a leading parallel file system designed to scale to petabytes of data and deliver massive storage performance to thousands of GPUs for Large Language Model (LLM) training workloads that require high-throughput, low-latency access to large datasets.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits
Learn more about benefits at Google.
- Write product or system development code.
- Measure Lustre performance measurements, investigating bottlenecks, and performance improvements, collaborate with teams across GCP to unlock all of Lustre's potential.
- Work with customers on their Lustre deployment to diagnose problems and optimize performance, and help customers profile their workload, and tune it for GCP.
- Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
- Develop Lustre features that integrate with GCP technologies, enabling customers to bring their AI/ML workloads to GCP, collaborate with partner teams like GKE, GCS, Vertex AI, GCE, etc. to optimize the GCP stack end-to-end.
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture.
- 2 years of experience with open source or developer technologies.
- 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
- Experience with performance analysis and computer architecture.
Preferred qualifications:
- Master's degree or PhD in Computer Science or related technical fields.
- 2 year of experience in linux kernel programming.
- Experience with Lustre Parallel File Systems.
- Storage Performance investigations and tuning experience.
- Strong programming ability in one or more languages C; solid understanding of general data structures, and algorithms.
Sequoia