Senior data engineer

Lead Data Engineer | Contract Position with NCD

NCD is currently growing it's team and we're looking for a Senior Data Engineer who will be responsible for developing, supporting, maintaining, and modernizing data pipelines across a few data projects in banking space. The role requires a combination of strong data engineering capabilities and data engineering support experience, with a particular focus on improving reliability as well as reactions, redesigning & rewriting of existing & new data workloads.

Key Responsibilities Production Operations and Support Monitor, maintain, and support production ETL and data-processing jobs. Investigate and resolve production failures, data issues, and operational incidents. Perform root-cause analysis and implement permanent solutions for recurring incidents. Improve monitoring, alerting, error handling, and recoverability of production workloads. Data Engineering and ETL Development Design, develop, test, deploy, and maintain scalable ETL and data pipelines. Rewrite and optimize ETL processes. Refactor existing operational jobs to improve stability, reliability, maintainability, and performance. Modernize legacy source extracts to improve efficiency and long-term supportability. Implement appropriate data-quality checks, logging, exception handling, and operational controls. Identify and reduce technical debt within the existing data-processing environment. Cloud and Data Platform Migration Support the migration of applications and data workloads to AWS. Migrate existing workloads to Aqueduct and ABDW. Integrate new database sources into DWH environments. Re-engineer existing solutions where required to take advantage of target platform capabilities. Validate migrated workloads to ensure data accuracy, completeness, performance, and production readiness. Performance and Reliability Analyze long-running and resource-intensive workloads and identify opportunities for optimization. Improve ETL execution times and overall processing efficiency. Engineer resilient solutions that reduce production incidents and manual intervention. Improve the scalability of data-processing solutions to accommodate continued growth in data volumes and product complexity. Operational Excellence Develop and maintain technical documentation, operational procedures, and support run-books. Collaborate with application, platform, infrastructure, and business teams to resolve complex data and production issues. Participate in incident management, problem management, and production support activities. Ensure data engineering solutions comply with relevant architecture, security, governance, and data-management standards. Technical Skills and Experience Strong experience in Data Engineering and ETL development . Advanced SQL and relational database skills. Experience designing and supporting high-volume production data pipelines . Strong understanding of data warehousing and data integration principles. Experience with AWS and cloud-based data platforms . Experience with ETL performance tuning and optimisation . Strong troubleshooting and root-cause analysis capabilities. Experience with production support and incident management . Experience with modernising and migrating legacy data-processing solutions . Experience with Aqueduct, Hadoop - Spark Scala, Java, AWS, SQL & WADE is key. Strong analytical and problem-solving skills. Ability to troubleshoot complex data and production issues. Strong focus on data quality, reliability, performance, and operational stability. Ability to balance BAU production support with development, modernisation, and migration initiatives. Ability to work effectively across technical and business teams. Strong communication and technical documentation skills . The ideal candidate will be a hands-on Data Engineer who can operate effectively across both operational support and engineering delivery . The role will be instrumental in stabilising the current production environment while progressively modernising the data estate to reduce operational risk, improve performance, and support future growth.