[GFI] Senior Data Engineer (Databricks, Python, AI)
Summary
Senior Data Engineer building an AI-powered analytics 'Intelligence Layer' on Databricks for a travel/aviation client: designing governed data pipelines, Metric Views, and Genie Agents for conversational analytics, plus multi-agent orchestration with MLflow tracing. Core stack: Databricks, Unity Catalog, SQL, Python, MLflow.
Project – the aim you’ll have
Join a forward-thinking technology team building a next-generation Intelligence Layer - a governed, AI-powered analytics platform that delivers trusted, real-time answers to questions for both customers and internal users. You'll work on a cutting-edge Databricks stack within a collaborative engineering team, contributing to a system that directly shapes how AI interfaces with business-critical data.
Position – how you’ll contribute
- Design, build, and maintain data pipelines and curated datasets within Databricks Unity Catalog
- Develop and document Metric Views defining core business metrics (schedules, on-time performance, bookings, pricing) to ensure consistency across the platform
- Configure and tune domain-specific Genie Agents for conversational analytics
- Contribute to the multi-agent orchestration architecture, including the Supervisor Agent layer
- Implement MLflow tracing and evaluation to monitor agent quality and manage versioning
- Support the integration of the intelligence layer with external AI tools via the MCP Server
- Collaborate with data and product teams to translate business questions into governed, reusable data definitions
Expectations – the experience you need
- Proven hands-on experience with Databricks (non-negotiable)
- Minimum 4 years of relevant data engineering or analytics engineering experience
- Strong knowledge of data modelling, Delta Tables, Metric Views, and Genie Agents
- Excellent skills in SQL and Python
- Experience building solutions using agentic AI methods and patterns
- Familiarity with Unity Catalog or similar data governance and lineage frameworks
- Track record of delivering reliable, production-grade data pipelines and analytical systems
Additional skills – the edge you have
- Experience with MLflow for experiment tracking, model/agent evaluation, or observability
- Knowledge of multi-agent orchestration patterns in enterprise data environments
- Familiarity with Model Context Protocol (MCP) or exposing AI capabilities via APIs
- Background in the aviation or travel industry and understanding of flight data concepts
Our offer – professional development, personal growth:
- Professional development, personal growth
- Flexible employment and hybrid work
- Non-corporate atmosphere
- Lunch tickets
- Private healthcare and insurance
- Multisport card
- Well-being initiatives
- Travel programs
- More intriguing benefits will be revealed during our interviews
Position at: Software Mind Poland