Senior Data Engineer, AI
Summary
Designs and optimizes data pipelines on Azure Lakehouse for analytics and AI, focusing on performance, quality, and AI-assisted development practices.
Responsibilities
- Design and evolve data processing on an Azure Lakehouse architecture.
- Collect, integrate, structure, and model data.
- Optimize processing performance and ensure data quality.
- Prepare datasets for analytics and AI use cases.
- Promote AI-assisted development practices including code generation, refactoring, testing, and documentation.
- Provide technical expertise to support data projects in an international transformation context.
Requirements
- At least five years of experience in Data Engineering, BI, or Cloud Data Engineering.
- Significant experience with Cloud and Lakehouse architectures.
- Strong command of Databricks, including Delta Lake and Lakehouse performance optimization.
- Expertise in data modeling, including analytical schemas, slowly changing dimensions (SCD), and data structuring.
- Familiarity with AI-assisted development tools.