Software Development Engineer II, Frontier AI - Data Tranformation
Description
- Architect and build robust, scalable data processing systems that ingest, transform, and enrich large-scale datasets across multiple languages
- Drive data quality by developing automated validation frameworks, quality tracking tools, and drift-detection mechanisms to ensure the highest standards of data integrity
- Optimize end-to-end pipelines, from ingestion through segmentation, enrichment, and delivery, to accelerate model training timelines
- Collaborate cross-functionally with applied scientists, ML engineers, and product teams to define data requirements and deliver production-ready datasets that meet evolving model needs
- Innovate at scale by leveraging cloud-native technologies to process petabyte-scale corpora efficiently and cost-effectively
