Data Engineer - Contract Position
Posted Updated
Job Role
We are seeking a skilled and experienced Database Engineer to join our team for a contract opportunity. The ideal candidate will play a critical role in designing, developing, and maintaining our Enterprise Data Warehouse (EDW). The role requires a deep understanding of Azure, SQL, data modeling, and optimization to ensure the efficiency, scalability, and reliability of our data infrastructure.
Responsibilities Include:
- Build, schedule, and monitor ETL/ELT pipelines using Azure Data Factory (ADF) and SQL Server Integration Services (SSIS).
- Implement change data capture (CDC), schema drift handling, and error-recovery patterns to keep pipelines reliable.
- Ingest, model, and process healthcare claims and cases data to support reporting and analytics.
- Use AI tools such as GitHub Copilot, Microsoft Copilot in Fabric, Snowflake Cortex, and LLM-based assistants to speed up pipeline development, code generation, documentation, testing, and troubleshooting.
- Develop and optimize data structures, warehouses, and workloads in Snowflake, including loading, transforming, and sharing data.
- Write efficient SQL queries and scripts to support data extraction, transformation, and loading (ETL) processes.
- Optimize database performance by analyzing, monitoring, and fine-tuning SQL queries and database structures.
- Contribute to CI/CD, version control (Git, Azure DevOps), and infrastructure-as-code practices.
- Manage database security, backup, and recovery strategies to ensure data integrity and availability.
- Develop and maintain data pipelines to ensure seamless data flow between various source systems and EDW.
- Perform regular data quality checks and troubleshooting to ensure the accuracy and consistency of data in the EDW.
- Monitor and maintain the performance of databases, addressing any issues related to performance, latency, and storage.
- Work with development teams to integrate databases with applications and ensure seamless interaction between data services and business systems.
- Keep up to date with emerging trends and best practices in database engineering, data warehousing, and SQL optimization.