Data Engineer
Posted Updated 8
views
Description
We are recruiting an experienced Data Engineer to join the engineering team in Limerick, Ireland.
The Data Engineer will be a collaborative member of an Agile Team and will be responsible for the design, development and maintenance of Azure Data Factory pipelines and complex T-SQL stored procedures, views and functions for Azure SQL Server, MS SQL Server and Azure Synapse servers. You will work closely with Product Owners, Software Engineers, Database Administrators, Data Architects across the organization to realise our data driven product vision.
Responsibilities:
- Understand the underlying Glass Lewis data
Build and maintain simple to complex Azure Data Factory pipelines - Create and maintain complex SQL queries
- Performance tuning Data Factory Pipelines and Integration Runtimes
- Work with Azure stack modules including Data Factory, Azure Synapse, SQL Server, Blob Storage
- Create and maintain documentation and wikis related to your work
- Work with other members of the data team, including DBA’s, Data Architect, Reporting
- Deal with other stakeholders/ end users in the software development lifecycle
- Working within an agile delivery methodology as part of a wider team.
Requirements:
Essential:
- 3 years of experience working with a data focused development team with a least 1 year of working with Azure Data Factory
- Strong proven SQL development and maintenance skills
- Strong proven Azure Data Factory pipeline development and maintenance skills
- Experience in an agile/scrum environment
- Experience of working with source control (git ideally) and CI CD
- Self-driven and collaborative
- A degree in computer science or other technical background
Desirable:
- Python coding skills highly desirable
- Fin-tech experience a plus
- Knowledge of Analysis Service an advantage
- Power Query, PowerBI or similar experience an advantage
- Experience of working with API’s and services
- CosmosDB, MongoDB or similar
- Knowledge of APIs, message que, event driven services
Benefits
- Employer pension contribution*
- Private health insurance*
- Life insurance*
- Long term illness cover*
- Supported Study Leave
*on completion of 6-month probation period