Azure Data Engineer (Mid-Level)
Summary
Mid-level data engineer who designs, builds, and optimizes data pipelines and ETL/ELT workflows on Azure (Data Factory, Databricks, Synapse), models and integrates structured/unstructured data, administers Azure SQL/Synapse databases, and collaborates with analysts and business stakeholders while ensuring security, governance, and documentation.
Key Responsibilities
Data Pipeline Development Design build and maintain robust scalable and efficient data pipelines using Azure Data Factory Databricks and other Azure services
Data Integration Integrate structured and unstructured data from diverse sources into Azure-based data platforms
Data Modeling Develop and maintain data models to support analytical and reporting requirements
Optimization Monitor and optimize data pipelines for performance scalability and cost-efficiency
Database Management Administer and manage Azure Synapse Analytics Azure SQL Database and other database solutions
ETL Processes Design and implement Extract Transform Load ETL processes to transform raw data into actionable insights
Collaboration Work closely with data analysts business teams and other stakeholders to understand data needs and deliver effective solutions
Security and Compliance Ensure data solutions align with organizational security policies and industry regulations
Documentation Create and maintain comprehensive documentation for data workflows architectures and processes
Qualifications
Technical Skills Strong proficiency in Azure Data Services including Azure Data Factory Azure Synapse Analytics Azure Databricks and Azure Storage Experience with big data technologies such as Spark and Hadoop Proficiency in SQL for querying and managing relational databases Familiarity with NoSQL databases such as Cosmos DB or MongoDB Strong understanding of data integration and transformation using ETL ELT methodologies Hands-on experience with programming languages such as Python Scala or Java Knowledge of data visualization tools like Power BI is a plus Experience with Data Lake architecture and design Understanding of security and governance in Azure including RBAC and Azure Key Vault
Experience Strong 3 5 years of experience in data engineering or a similar role Experience working with large datasets and optimizing data pipelines in cloud environments Hands-on experience in implementing end-to-end data solutions on Azure
Soft Skills Excellent problem-solving and analytical skills Strong written and verbal communication abilities Team player with the ability to work collaboratively and independently
Education: Bachelor s degree in Computer Science, Data Engineering, Information Technology, or a related field (or equivalent experience).