Stage – Data Engineer - F/H
Summary
Build and maintain cloud-based data pipelines on Azure, using Spark, Scala, Python, and SQL to feed a DataLake and power cost-tracking dashboards for FinOps.
Responsibilities
- Design expense tracking dashboards (FinOps) to help Data teams better understand Cloud consumption associated with their processing and maintain control over costs
- Design and implement DataLake feeding and data transformation processing
- Guarantee data quality by implementing appropriate measurement and monitoring tools
- Identify, collect, explore, understand and integrate the data necessary to resolve business and operational issues
- Ensure production monitoring
- Participate, with the team, in the development of the platform on Azure and the definition of good development practices
- Support business teams in getting started with the Azure platform and help them improve their programming skills by ensuring compliance with internal standards
- Technical environment: Spark, Scala, Python, SQL, Cloud Azure, PowerBI
Qualifications & Technical Skills
- With Bac+5 training (or more) in IT development / data engineering, you have been able to develop the following technical skills:
- Cloud Azure (DataFactory, ADLS, Databricks)
- Spark
- Scala + Python
- Good knowledge of data architectures and the cloud
- Knowledge of collaborative processes and development tools (DevOps, Git, CI/CD, etc.)
- SQL
- Data visualisation
Soft Skills
- Good ability to understand technological layers and tools
- Ability to work collaboratively within multidisciplinary teams
- Autonomy, great rigor, pragmatism and real ability to deliver
- Good level of English, spoken and written
Additional Knowledge (Nice to Have)
- OpenShift, Docker, Kubernetes
- Bases NoSQL
Location
The position is based in Suresnes (92) near La Défense.