Azure Data Engineering
Posted Updated 4
views
Description
- Experience in setting up data pipelines in Azure.
- Experience with Azure Data Factory
- Experience with setting up Azure Data Lake with structured/unstructured data.
- Candidate needs to be a self-starter and should be able to design, develop and deliver solution without much assistance or supervision.
- Strong knowledge of Azure services - Storage (AFS, Blob, Data Lake), Azure Functions.
- Strong knowledge of database - Should be able to write complex queries, schema design.
- Ability to set up CI/CD pipelines in Azure through GitHub.
- Bachelor’s or master’s degree in computer science, Information Technology
- Experience with batch job scheduling and identifying data/job dependencies.
Preferred Skills:
- Proficiency in data warehousing, ETL, and big data processing.
- Familiarity with the Pharma domain is a plus.