Data Engineer with Databricks (Mid to Senior Level)

About the role

A Data Engineer role supporting the design of adequate solution architecture, extracting data from relevant online sources, and building stable and performing DataMart solutions. The role involves working with Azure technologies and data platforms to ensure compliance with client standards and timely delivery of project objectives.

Key responsibilities

• Support the design of an adequate solution architecture.

• Extract data from relevant online sources using various ingestion methods.

• Build a stable and performing DataMart solution conform functional and technical requirements.

• Build data pipelines that feed data into the data marts according to the data model.

• Set-up CI/CD pipelines to deploy solution components.

• Leverage technical components such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.

• Participate in project cycle and complete project artefacts where applicable.

• Work with the IADA team to ensure the timely delivery of project objectives.

About you

• Bachelor's degree in Computer Science/Information Systems or Information Technology/Accounting.

• 3-5 years of experience as a data engineer preferably for the banking sector and financial services sector.

• Experience in data technologies and systems such as SQL, PowerBI, Python, Azure DevOps, etc.

• Experience with Azure Data Ecosystem with tools such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.

• Experience in setting up DataMarts and able to liaise with relevant IT teams to develop effective solutions

• Strong communication skills in both spoken and written English.

• Experience working with ITIL and/or Scrum/Agile frameworks.

• Must be willing work on an initial full onsite then transition to hybrid work set-up.