Senior Data Engineer
Summary
Senior Data Engineer at Erasteel in Paris who owns the company's data governance and analytics roadmap: building and optimizing data pipelines and models in Azure Synapse and Data Factory, preparing data for data science projects, and providing 2nd-level support for the BI solution including FinOps cost control on Azure.
Overall purpose of the position:
Consultez l'aperçu du poste ci-dessous. Si vous êtes convaincu(e) d'avoir les bonnes compétences et l'expérience requise, postulez dès aujourd'hui.
As a Senior Data Engineer, you will play a key role in shaping and delivering the company´s data and analytics strategy:
- Manage Data governance, strategy, solutions
- Ensure maintenance & support of the BI solution
- Build activities & projects delivery according to business priorities
Essential Duties and Responsibilities:
Manage Data governance, strategy and related solutions & roadmap
- Ensure data quality, integrity, and governance across all data flows and models, support expansion of data driven culture
- Develop & implement roadmap to expand data availability according to business needs , make evolve the technical solutions to eventually new tools including integration tools
- Implement and maintain best practices in data security, access control, and compliance for sensitive financial and operational data.
Build & data related projects delivery
- Work with cross-functional teams to integrate and automate data processes, ensuring seamless data flow across different platforms and projects
- Build and manage data models in Azure Synapse Analytics to support business intelligence, reporting, and advanced analytics for business
- Design, develop, and optimize data pipelines for business needs (e.g. Sales, Supply, finances)
- Work with Azure Data Factory to create and orchestrate ETL/ELT workflows integrating data from multiple sources for analysis and reporting.
- Prepare data for data science projects, including cleaning, transforming, and organizing data to ensure it is ready for advanced analytics.
- Build visualizations
Ensure maintenance & support of the BI solution 2d level
- Optimize and troubleshoot data processing, storage solutions, and data models for performance, scalability, and cost-efficiency.
- The role will also involve FinOps responsibilities, ensuring efficient cloud resource usage and implementing cost-optimization strategies to keep Azure platform expenses under control
- Backup BI - integration engineer when necessary
Background
- Bachelor’s degree in computer science with 10 years’ experience or Masters with min. 5 years’ experience in computer science, Information Technology, or applied mathematics.
- 5+ years of experience in data engineering, with a strong background in Azure
- Fluent English
Technical skills
- Expertise in Azure Synapse Analytics and Azure Data Factory, Azure Devops, Azure Functions
- Appreciated : SAP HANA environment, Fabric ; AI & automation tools
- Strong proficiency in SQL, Python also appreciated
- Experience with big data processing frameworks
- Experience in data modeling and data preparation for data science and machine learning projects.
- Experience with ETL and ELT (e.g. Harmony/ Clarify) pipelines, data transformation, and data integration workflows.
- Knowledge of data architecture, data modeling, and data warehousing principles.
- Familiarity with machine learning workflows, and a strong understanding of how to structure and prepare data for advanced analytics, AI technology watch
Soft skills
- Ability to work in a transversal way across IT and with business teams
- Excellent problem-solving skills with the ability to troubleshoot and optimize data workflows.
- Familiarity with cloud security and data governance practices. xuezdbg
- Strong communication and collaboration skills to work effectively with cross-functional teams within IT, including business stakeholders and third parties
- Basic project management skills
- IOT & streaming data project experience is highly appreciated.