AI-Focused Software Engineer, Data Systems
Summary
Build and optimize petabyte-scale data infrastructure for AI training, using Python, Kubernetes, and distributed systems to ensure data integrity and performance.
Be at the forefront of AI advancement as a Software Engineer focusing on Data Systems. Tackle unique challenges with petabyte-scale storage and help drive data integrity in AI training.
This position is ideal for someone with over 4 years of experience in data infrastructure. Your expertise in Python and Kubernetes, combined with a passion for AI, will contribute significantly to creating a powerful data layer. Engage directly with talented engineers and researchers while solving the complexities of data storage.
Key Responsibilities:
• Design and enhance petabyte-scale data infrastructures
• Solve networking and performance issues effectively
• Collaborate with elite research teams in AI
• Convert unstructured data into optimized stores
• Use tools like BigQuery and Airflow as needed
Requirements:
• 4+ years in data storage experience
• Strong programming skills in Python
• Experience with Kubernetes storage components
• Knowledge of distributed data processing platforms
• Enthusiasm for AI and its developments
Shape the future of AI through innovative data infrastructure solutions in this unique software engineering role.