Data Engineer Centurion
Posted Updated
Description
Mediro ICT Recruitment is seeking a data engineer to design, implement, and deploy data transformations using Python, PySpark, and SQL in Azure Databricks and Azure SQL. The role focuses on building robust ETL pipelines, data lake curation, and providing data for analytics across multiple Azure services.
You will work with streaming data, BI concepts, and containerised CI/CD pipelines in a dynamic environment with evolving requirements, ensuring high attention to detail.
Develop ETL pipelines using Python and SQL in Azure Databricks and Azure SQL. Combine and curate data in a central data lake for analytics. Serve data for applications and analytics via SQL, CosmosDB, Synapse and related tech. Build transformation pipelines into dimensions and facts using BI concepts. Implement streaming pipelines with IoT Hub, Event Hub, Databricks streaming and Azure stream tech. Bachelor's degree in a STEM field; solid foundation in data engineering concepts. Experience designing, developing and deploying ETL/ELT pipelines.Skills
Sign in to read and join the discussion.