Data Engineer Analyst
Posted
Description
Experience:
- +2 years of experience in Data Engineering / Big Data environments.
Mandatory Skills:
- Big Data / DataLake
- SQL
- Python
- ETL development
- Data ingestion & transformation
- Data pipelines
- Data modeling
- Control-M / batch processing
- Data analysis and validation
- English Level minimum B2
Desirable:
- Atoti / ActiveViam
- Databricks
- REST APIs / Microservices
- Jira / Confluence
- Counterparty Risk / Limits knowledge
Responsiblities:
- Analyze and understand the existing data model, data flows and transformations.
- Understand existing datasets, mappings and dependencies in the DataLake.
- Develop and maintain Python processes, ETLs and data pipelines.
- Develop and maintain Control-M jobs and batch processes.
- Implement data ingestion, transformation and processing logic.
- Develop and adapt data models and datasets required for the Limits solution.
- Perform SQL analysis, data validation and reconciliation across different sources.
- Implement data quality controls and support resolution of data issues.
- Support testing, certification, deployment and production releases.
- Maintain technical documentation of data models, processes and transformations.
Skills
Sign in to read and join the discussion.