Azure Data Engineer / Databricks

Must-Have

• Design, develop and implement data pipelines to perform (ETL) from multiple sources into Azure Services.
• Experience on Azure Data & Analytics PaaS Services: Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics and Azure SQL DB.
• Proficiency in programming languages (e.g., Python, SQL, PySpark etc.) and data manipulation tools.
• Manage Azure Data Storage Solutions including Azure Data Lake and different databases.
• Knowledge of DevOps tools.
• Manage and monitor the health of data integration processes, troubleshooting.
• Experience in Data Migrations (performing data migrations to Azure from on-premises or other platforms).
• Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps.
• Experience with exposing data to end-users via Power BI and Azure API Apps.
• Understanding of on-premises and cloud-based data architecture and integration.
• Knowledge of DevOps practices and tools.

Good-to-Have

• Knowledge of integrating different systems with Python.
• Good documentation skills.

Responsibilities / Expectations from the Role

1. Develop fully functional Azure data pipelines.
2. Data migrations.
3. Team player, responsive, organized.
4. Strong analytical, problem-solving, client-facing, troubleshooting and multi-tasking skills.
5. Data modeling, ETL processes and Data Warehousing.
6. Data security, compliance standards and data privacy policies.