Data Engineer
Posted 32
views
Summary
Build and maintain data pipelines for media analytics, sourcing from APIs and BigQuery, transforming data for performance dashboards, and optimizing GCP deployments.
Senior Data Engineer/Data Analyst profile to manage applications related to the CDMO (Chief Digital & Marketing Office) business, within a dynamic team with diverse roles (Tech Lead, Full Stack Developer, Data Scientist, Product Owner, QA, etc.).
One of the applications, One Creative, provides a comprehensive view of media asset performance and optimization—from global strategy down to local activation.
Mission Includes:
- Developing and maintaining data pipelines for:
- Data sourcing (BigQuery Datalake)
- Downloading video assets via social media platform APIs
- Creative analysis (internal Augmented DAM application)
- Automation of AI workflows (embedding, clustering)
- Transforming raw Datalake data into optimized tables for the One Creative application (merging performance KPIs, metadata, creative data, etc.)
- Optimizing backend deployment on GCP
- Improving the codebase by adding unit and integration tests to Python code
- Developing an initial monitoring layer for retrieved data (assets, KPIs)
- Modernizing technical components (thumbnails, product detection, encoder) with more modern and efficient approaches
- Optimizing the CI/CD pipeline
- Working on the migration of the Augmented DAM backend (another internal application used as a service within One Creative)
- Developing SQL queries to source data into Datalake tables, based on inputs from the Data Business Owner
- Documenting data extracted from the Datalake using documentation and data diagrams
Skills
Sign in to read and join the discussion.