Data Engineer
Posted Updated 14
views
Summary
The Data Engineer will design and maintain data infrastructure on Azure, focusing on building ETL solutions, medallion architectures, and metadata-driven ingestion frameworks. The role involves processing, transforming, and securing data while ensuring high data quality and performance.
- Build data pipelines
- Build data quality frameworks
- Build medallion architecture
- Create metadata driven ingestion frameworks
- Design data infrastructure on Azure
- Develop ETL solutions
- Develop data transformations SCD1 and SCD2
- Implement data security and privacy measures
- Ingest data from multiple sources
- Monitor and troubleshoot data flows
- Optimize data storage and processing
- Process and transform data