Data Engineer, Azure Experience
Summary
Migrates and modernizes 115 SSIS packages into Azure Data Factory pipelines, categorizing complexity, designing modular ADF equivalents, and consolidating jobs into reusable components. Focuses on phased deployment, testing, documentation, and mentoring while assessing lift-and-shift vs. refactor tradeoffs.
- Review approximately 115 existing SSIS packages
- Categorize packages as simple, medium, or complex
- Design Azure Data Factory equivalents
- Consolidate similar jobs into reusable pipelines where feasible
- Build and deploy pipelines in phased batches
- Provide testing support and handover
- Advise on ADF architecture and best practices
- Provide rough effort estimates and resource planning
- Assess existing pipelines and produce migration approaches
- Make lift-and-shift versus refactor decisions
- Design modular, reusable ADF components
- Support unit testing and data validation
- Prepare documentation and knowledge transfer
- Provide best-practice guidance and mentoring
Requirements
- Bachelor's degree in Computer Science, IT, Data Science, Software Engineering, or a related technical field
- At least 2 years of experience in the Data Engineering field
- Strong hands-on experience with Azure Data Factory
- Experience designing pipelines, parameterized templates, reusable datasets, linked services, triggers and scheduling
- Experience with monitoring, logging, and error handling in ADF
- Experience with CI/CD for ADF using ARM, Bicep, Terraform, Azure DevOps, or GitHub
- Deep experience with SQL Server Integration Services
- Proven experience migrating pipelines to ADF
- Knowledge of ETL/ELT design patterns
- Experience with data transformation and ingestion from Excel, CSV, and flat files
- Experience working with Azure Virtual Machines
- Experience with Azure Storage accounts, Blob Storage, or ADLS
- Experience assessing existing pipelines and producing migration approaches
- Experience making lift-and-shift versus refactor decisions
- Experience consolidating similar jobs into parameterized pipelines
- Experience with batch delivery and phased releases
- Experience with unit testing and data validation
- Experience with documentation and knowledge transfer
- Experience providing best-practice guidance and mentoring
- Availability for 8:00 AM–5:00 PM UK time
Core Competencies
Demonstrates expertise in Azure Data Factory, including pipeline design, parameterized templates, and reusable components. Proficient in SQL Server Integration Services and experienced in data migration, transformation, and best practices in data engineering.
Highest-signal resume keywords
- Azure Data Factory
- SQL Server Integration Services
- Data Migration
- CI/CD for ADF
- ETL/ELT Design Patterns
ATS Optimization Keywords
Hard Skills
- Pipeline Design
- Parameterized Templates
- Reusable Datasets
- Triggers and Scheduling
- Monitoring and Logging
- Error Handling
- Data Transformation
- Data Ingestion
- Unit Testing
- Data Validation
Soft Skills
- Best-Practice Guidance
- Mentoring
Industry Keywords
- Data Engineering
- Migration Approaches
- Lift-and-Shift Decisions
- Phased Releases
- Documentation
- Knowledge Transfer
Tools & Technologies
- Azure DevOps
- GitHub
- ARM
- Bicep
- Terraform
- Azure Virtual Machines
- Azure Storage Accounts
- Blob Storage
- ADLS