Senior Data Engineer – 6 month contract
Summary
Build and maintain secure data pipelines using Microsoft Fabric, Azure Data Factory, and PySpark, ensuring compliance with financial regulations and integrating sensitive systems.
- Design, develop, and maintain data pipelines using Microsoft Fabric and Azure Data Factory (ADF)
- Ensure data security and compliance by implementing best practices
- Collaborate with data governance stakeholders to enforce data quality standards
- Design and implement monitoring solutions using Azure-native services
- Deliver data solutions in alignment with approved architecture
- Collaborate cross-functionally with Data Architects, Business Stakeholders, and data teams
- Develop, configure, and maintain CI/CD pipelines using Azure DevOps
- Produce and maintain comprehensive documentation in Confluence
- Ensure adherence to ITIL-based processes for incident and change management
- Proactively drive operational excellence by identifying recurring issues
- Conduct peer code reviews through pull requests
- Deliver against project commitments
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field
- 6+ years of experience in data engineering roles
- Hands-on experience in Microsoft Fabric and Azure data technologies
- Strong proficiency in Azure Data Factory (ADF), Microsoft Fabric, SQL, and Azure Storage services
- Proficiency in SQL and Python\PySpark for developing data transformation and processing workflows
- Strong understanding of ETL/ELT concepts, data pipeline design, and orchestration patterns
- Experience integrating financial systems and handling sensitive data (e.g., PII) in compliance with regulatory and security standards
- Experience with collaboration and delivery tools such as Jira, Confluence, and Azure DevOps
- Strong proficiency with Git and Azure DevOps, including repository management, branching strategies, pull requests, peer reviews, merge conflict resolution, release management, and CI/CD deployment practices supporting enterprise data engineering solutions
Core Competencies
Demonstrates expertise in designing and maintaining data pipelines using Microsoft Fabric and Azure Data Factory, with a strong focus on data security, compliance, and operational excellence. Proficient in SQL, Python, and CI/CD practices to deliver high-quality data solutions aligned with architectural standards.
Highest-signal resume keywords
- Microsoft Fabric
- Azure Data Factory (ADF)
- SQL
- Python/PySpark
- CI/CD Pipelines
ATS Optimization Keywords
Hard Skills
- Data Pipeline Design
- ETL/ELT Concepts
- Data Transformation
- Data Processing Workflows
- Data Quality Standards
- Monitoring Solutions
- Incident Management
- Change Management
- Data Governance
- Data Security Compliance
Soft Skills
- Collaboration
- Problem-Solving
- Documentation
Industry Keywords
- Data Engineering
- Financial Systems Integration
- Sensitive Data Handling
- Regulatory Standards
- ITIL Processes
Tools & Technologies
- Azure DevOps
- Confluence
- Jira
- Azure Storage Services
- Git