Data Engineer (Mid to Lead Level)
Summary
Designs solution architecture and builds stable DataMart solutions and data pipelines on the Azure data stack (Data Factory, Data Lake, Databricks, Azure SQL, PowerBI), including CI/CD deployment, for a banking/financial-services client. Mid-to-lead level role, initially full onsite in the Philippines before moving to hybrid.
About the role
A Data Engineer role supporting the design of adequate solution architecture, extracting data from relevant online sources, and building stable and performing DataMart solutions. The role involves working with Azure technologies and data platforms to ensure compliance with client standards and timely delivery of project objectives.
Key responsibilities
Support the design of an adequate solution architecture
Extract data from relevant online sources using various ingestion methods
Ensure compliance with the client's Data Platform Architecture and Client's Software Engineering standards
Build a stable and performing DataMart solution conform functional and technical requirements
Build data pipelines that feed data into the data marts according to the data model
Set-up CI/CD pipelines to deploy solution components
Leverage technical components such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI
Participate in project cycle and complete project artefacts where applicable
Work with the IADA team to ensure the timely delivery of project objectives
About you
Bachelor's degree in Computer Science/Information Systems or Information Technology/Accounting
At least 3 years of experience as a Data Engineer preferably for the banking sector and financial services sector.
Experience in data technologies and systems such as SQL, PowerBI, Python etc.
Experience in Azure DevOps and DataMart Solutions.
Experience with Azure Data Ecosystem with tools such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob storage, Azure SQL Databases and PowerBI.
Able to liaise with relevant IT teams to develop effective solutions
Must be willing to work on an initial full onsite before transitioning to a hybrid work set-up.