Data Engineer II
Posted Updated 2
views
Summary
Designs and maintains ETL/ELT pipelines, data integrations, and cloud data processing in Azure, using AI to automate testing and workflows while ensuring data quality and reliability.
- Apply AI to automate testing documentation and optimization
- Coordinate SharePoint administration and troubleshooting
- Design ETL/ELT pipelines
- Design and maintain data integrations
- Develop Azure DevOps CI/CD pipelines
- Develop cloud data pipelines in Azure
- Develop data processing frameworks
- Develop stored procedures and data transformations
- Implement AI-assisted development workflows
- Implement data validation and quality controls
- Maintain technical documentation for data systems
- Monitor and improve pipeline performance and reliability
- Monitor data pipelines and troubleshoot failures
- Participate in code reviews and production deployments
- Support Azure Data Factory Azure SQL Azure Databricks
- Support Azure Synapse Analytics and Azure Functions
- Support data warehouses and dimensional models
- Translate business requirements into technical specifications
- Use Azure Key Vault for secure access
- Write and optimize SQL queries