Azure Data Engineer - Python, AI, Artificial Intelligence
Posted Updated
Description
Role Summary
In the first few months, success will involve establishing reliable data pipelines and contributing to impactful data solutions using Azure technologies.
Responsibilities
- Design and implement robust data pipelines leveraging Azure Data Factory and complementary Azure services.
- Partner with data scientists and analysts to gather data requirements and deliver effective data solutions.
- Develop and deploy efficient data models and warehousing architectures that enable analytics and reporting capabilities.
- Utilize Python for intricate data manipulation and transformation tasks.
- Ensure comprehensive data quality through systematic testing and validation practices.
- Monitor, troubleshoot, and optimize data workflows to enhance performance and efficiency.
- Stay informed on emerging trends and advancements in data engineering, artificial intelligence, and related technologies.
Must-Have Skills
- Proficient in Azure services, particularly Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics.
- Strong programming expertise in Python, including experience with relevant data handling libraries.
- Solid understanding of SQL for database querying and management.
- Familiarity with AWS services is advantageous.
- Basic knowledge of AI and machine learning concepts as they pertain to data engineering.
- Strong analytical skills with a keen attention to detail.
- Effective communication skills for collaborative efforts within a team.
Good-to-Have Skills
- Experience with big data technologies or frameworks.
- Knowledge of ETL processes and tools beyond Azure services.
This role offers opportunities for growth in developing advanced technical expertise in cloud-based data engineering solutions while contributing to the evolution of our organization's data strategies.
Skills
Sign in to read and join the discussion.