Staff Data Engineer, Enterprise AI Data Platform Lead
Posted Updated
Description
Robots & Pencils is seeking a Staff Data Engineer to join a multi-disciplinary team building enterprise-grade data platforms. You will define data strategy, own platform decisions end-to-end, and mentor engineers to raise the team's craft.
You'll design scalable data lakes, warehouses, and pipelines, establish governance and quality standards, and drive modernization with a focus on performance, reliability, and security across real-time and batch workloads.
Define data architecture and platform strategy, leading design across pipelines, warehouses, and data lakes. Build and optimize scalable data pipelines supporting batch and real-time processing. Define and enforce data governance, quality standards, and compliance frameworks across the platform. Build monitoring, logging, and alerting for data pipelines and services, and contribute to CI/CD workflows for data deployment. Drive data platform modernization, optimizing for performance, cost, and scalability. Bring an AI-forward mindset to daily work, leveraging modern AI tools to ship high-quality work. Design and implement data contracts and event flows with backend and platform teams. Lead data pipelines for production AI/ML systems, including embeddings, vector stores, and training/inference data flows. Integrate data services with APIs, middleware, and third-party systems to support end-to-end data consumption. 7+ years of professional data engineering experience with leading complex data platform initiatives. Strong system architecture background with expertise in distributed data systems. Expert proficiency in Python, Scala, and SQL. Deep expertise with cloud-native data platforms and enterprise data warehousing. Strong expertise in data pipeline orchestration and processing. Strong experience with streaming platforms and real-time data processing (e.g., Kafka, Kinesis, Pub/Sub). Strong data modeling expertise and experience with data transformation. Strong experience with data quality, governance, and compliance frameworks.Skills
Sign in to read and join the discussion.