Senior Data Engineer
ISx4 is a dynamic and innovative team, we harness the power of artificial intelligence and cloud computing to drive real-world impact. We work at the forefront of Analytics and AI technology, leveraging leading cloud platforms to build scalable, intelligent solutions. We provide Insight through Strategy, Solutions, Services & Support (Sx4). Our industry experience help derive competitive advantage for our clients, taking them on the journey from Hindsight, through Insight to Foresight.
Job Role
- Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures
- Provide technical leadership across Databricks, Spark and cloud data platforms
- Drive delivery of data engineering workstreams within Agile programmes
- Engage with client stakeholders to translate business objectives into technical solutions
- Mentor engineers and establish engineering best practices
- Lead architecture and design discussions with architects and platform teams
- Oversee performance optimisation and platform reliability
- Support data migration strategy and execution
- Ensure governance, security and compliance standards are met
- Produce architecture documentation, design artefacts and delivery roadmaps
Key Responsibilities
- Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures
- Provide technical leadership across Databricks, Spark and cloud data platforms
- Drive delivery of data engineering workstreams within Agile programmes
- Engage with client stakeholders to translate business objectives into technical solutions
- Mentor engineers and establish engineering best practices
- Lead architecture and design discussions with architects and platform teams
- Oversee performance optimisation and platform reliabilty
- Support data migration strategy and execution
- Ensure governance, security and compliance standards are met
- Produce architecture documentation, design artefacts and delivery roadmaps
Key Requirements
- 7+ years experience in data engineering or data platform development
- Strong experience with Databricks, Spark and distributed data processing
- Experience with Unity Catalog, Delta Lake and streaming architectures
- Advanced Python and Microsoft SQL Server development
- Proven experience leading engineering teams or workstreams
- Strong stakeholder engagement and consulting skills
- Working knowledge of Hadoop
- Experience with test-driven development and CI/ CDREST APIs and Kafka experence
Nice to Have
- Experience leading data platform migrations
- Experience managing delivery in large transformation progr
- Experience delivering projects in regulated environments
This role requires 3 days onsite in Belfast city centre this is non negotiable.