Data engineer for advertising and marketing spend
Summary
Data Engineer building Azure-based reporting pipelines for a global food & beverage client: connecting marketing and advertising data sources, ingesting them via Azure Data Factory, transforming data with PySpark and SQL in Databricks, and consolidating ad/marketing spend KPIs into a single master source of truth while collaborating closely with business stakeholders.
Описание
We are seeking a Data Engineer to join a newly launched business reporting initiative for a global food and beverage leader with a portfolio of widely recognized consumer brands. In this role, you will work between business stakeholders and a diverse landscape of existing reporting tools, connecting multiple data sources, building ingestion and transformation pipelines on Azure, and consolidating advertising and marketing spend KPIs into a single source of truth.
Задачи
- Establish connections with each of the existing reporting tools and data sources, choosing the right ingestion approach based on each source’s capabilities.
- Design and build data pipelines in Azure Data Factory to bring advertising and marketing expense data onto the platform reliably.
- Process, clean and model data in Databricks using PySpark and SQL to produce consistent, comparable KPIs across sources.
- Consolidate key KPIs into a central Master table that serves as the single source of truth for marketing and advertising expense reporting.
- Work closely with business stakeholders to clarify, refine and adapt to evolving requirements as the project takes shape.
Требования
- Commercial experience as a Data Engineer on the Azure platform.
- Hands-on experience building data processing logic with PySpark and SQL.
- Practical experience designing and orchestrating data pipelines in ADF.
- General understanding of the Azure platform structure, its major services and how they relate to each other.
- Confident communication with business stakeholders and comfort working in a new project where requirements are not yet fixed.
- Ability to ask the right questions, propose solutions and bring structure to ambiguous tasks.
- Будет плюсом: Experience building CI/CD pipelines for Azure Data Factory;
- Будет плюсом: Experience setting up DevOps pipelines for Databricks workloads
Условия
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office