Data Stage Data Engineer
Summary
An experienced DataStage data engineer is needed in London to design, build, and support ETL pipelines, data migration, and enterprise data warehouse solutions on AWS (Redshift, S3, QuickSight). Day to day involves Java/SQL development, CI/CD with GitHub/GitLab, and DevSecOps practices within an Agile delivery programme.
An exciting opportunity is available for an experienced DataStage Data Engineer to join a high-profile programme delivering complex data integration and migration solutions within a large-scale enterprise environment. The successful candidate will play a key role in designing, developing, and supporting robust data pipelines, ETL processes, and data warehouse solutions using a range of AWS and enterprise data technologies.
This role requires a strong technical background in data engineering, ETL development, cloud-based data platforms, and DevSecOps practices. You will work closely with architects, developers, business stakeholders, and delivery teams to ensure the successful movement, transformation, and management of critical business data.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data migration solutions using IBM DataStage.
- Build and optimise batch and real-time data integration pipelines to support business and operational requirements.
- Develop and enhance data warehouse solutions, ensuring high performance, resilience, and scalability.
- Design and implement data solutions using AWS services, including Amazon Redshift, Amazon S3, and Amazon QuickSight.
- Collaborate with cross-functional teams to analyse data requirements and translate them into technical solutions.
- Support the adoption of DevSecOps principles, ensuring secure and automated deployment practices.
- Develop and maintain high-quality code using Java and SQL.
- Design, query, and optimise relational database structures and data models.
- Implement source control, version management, and CI/CD processes using GitHub and/or GitLab.
- Troubleshoot and resolve data-related issues, ensuring data integrity and platform stability.
- Contribute to technical design reviews, code reviews, and best practice initiatives across the engineering team.
- Strong commercial experience with DataStage.
- Proven expertise in data migration and ETL development, including both batch and real-time processing.
- Experience designing and supporting enterprise data warehouse solutions.
- Hands-on experience with:
- Amazon Redshift
- Amazon S3
- Amazon QuickSight
- Strong understanding of DevSecOps methodologies and modern software delivery practices.
- Advanced SQL skills.
- Experience working with relational databases.
- Hands-on experience with GitHub and/or GitLab.
- Strong analytical, problem-solving, and stakeholder engagement skills.
- Ability to work effectively within Agile delivery environments.
- Experience implementing and monitoring data quality frameworks.
- Knowledge of XML technologies and data formats.
- AWS Certified Data Analytics or AWS Data Specialty Certification.
- Experience working within large-scale cloud migration or transformation programmes.
Candidate Profile
The ideal candidate will be a proactive and technically strong Data Engineer with a proven track record of delivering enterprise-scale data solutions. They will possess excellent communication skills, a collaborative approach to problem solving, and the ability to operate effectively within fast-paced, complex environments.