Data Platform Architect — AI-Driven Data & Governance
Summary
Data engineer/architect to lead Atlante's Data Platform & AI team in Milan, redesigning the data platform to serve both people and AI agents. Day to day: build lakehouse pipelines with Spark, SQL, Trino and Athena, own the semantic layer and governance, and connect docs, catalogs and data to AI agents.
Atlante is seeking a Data Engineer to lead the Data Platform & AI team in Milan. You will redesign the data platform to serve both people and AI agents, establishing end-to-end architecture, standards and governance for data production, modeling and consumption.
You will drive a semantic layer, data products and a knowledge management spine connecting docs, catalogs and business glossary to AI systems, while building robust pipelines on Spark, SQL, Trino and Athena.
Review current data architecture end-to-end, map weaknesses and technical debt, and define target architecture and roadmap Design and build the agentic harness architecture for AI agents to access and act on Atlante’s data with permissions and observability Own the semantic layer with shared definitions and metrics across BI, analytics and AI agents Set up knowledge management connecting documentation, data catalog and business glossary to AI systems Develop and operate reliable data pipelines on the lakehouse (Spark, SQL, Trino, Athena) with built-in testing and data quality Define data products with clear owners, contracts, SLAs and consumers Promote agentic development and review practices to keep outputs production-grade Spread data engineering standards across Atlante including modeling conventions, CI/CD and governance Stay updated with latest data and AI tech and bring valuable tools to the platform 4+ years of software development in Python or equivalent in production Hands-on agentic software development: coding agents and spec-driven development Solid knowledge of lakehouse technologies: Spark, SQL, Trino, Athena Good knowledge of cloud platforms, preferably AWS, and infrastructure as code Strong understanding of data platform design, data modeling and semantic layers Familiarity with MCP, RAG and knowledge management patterns for AI systems Ownership mindset: make architectural decisions and stand by them