Data Engineer
Posted 4
views
Summary
Build and maintain data pipelines for media analytics, sourcing from APIs and BigQuery, transforming data for performance dashboards, and optimizing GCP deployments.
Senior Data Engineer/Data Analyst profile to manage applications related to the CDMO (Chief Digital & Marketing Office) business, within a dynamic team with diverse roles (Tech Lead, Full Stack Developer, Data Scientist, Product Owner, QA, etc.).
One of the applications, One Creative, provides a comprehensive view of media asset performance and optimization—from global strategy down to local activation.
Mission Includes:
- Developing and maintaining data pipelines for:
- Data sourcing (BigQuery Datalake)
- Downloading video assets via social media platform APIs
- Creative analysis (internal Augmented DAM application)
- Automation of AI workflows (embedding, clustering)
- Transforming raw Datalake data into optimized tables for the One Creative application (merging performance KPIs, metadata, creative data, etc.)
- Optimizing backend deployment on GCP
- Improving the codebase by adding unit and integration tests to Python code
- Developing an initial monitoring layer for retrieved data (assets, KPIs)
- Modernizing technical components (thumbnails, product detection, encoder) with more modern and efficient approaches
- Optimizing the CI/CD pipeline
- Working on the migration of the Augmented DAM backend (another internal application used as a service within One Creative)
- Developing SQL queries to source data into Datalake tables, based on inputs from the Data Business Owner
- Documenting data extracted from the Datalake using documentation and data diagrams