Software & Data Engineer – Banking (CIB)

Resource Requirements

Job Summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment.

This role requires a combination of software engineering and data engineering expertise. The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development lifecycle.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, knowledge of ETL/ELT processes and experience with automated testing, CI/CD, monitoring and production support.

The candidate must be a self-starter who can work independently, take ownership of technical deliverables and communicate effectively with technical and business stakeholders.

Key Responsibilities

• Design, develop and maintain software components and data engineering solutions.
  

• Build scalable data ingestion, transformation and integration pipelines.
  

• Develop reusable, maintainable and testable Python modules and services.
  

• Write, optimise and troubleshoot SQL queries.
  

• Apply software engineering principles, coding standards and appropriate design practices.
  

• Work with AWS cloud services to develop and support data-intensive applications.
  

• Develop and maintain ETL/ELT workflows and data processing components.
  

• Build and support APIs, integrations and event-driven components where required.
  

• Implement automated unit, integration, regression and reconciliation testing.
  

• Contribute to Git-based version control and CI/CD pipelines.
  

• Support automated deployment, quality gates and release processes.
  

• Work with distributed processing and event-streaming technologies where required.
  

• Implement logging, monitoring, alerting and operational support mechanisms.
  

• Troubleshoot application and data pipeline incidents and conduct root-cause analysis.
  

• Apply security, access control, encryption and data privacy practices.
  

• Maintain technical documentation, solution designs and operational runbooks.
  

• Collaborate with Data Engineers, Software Engineers and business stakeholders.
  

• Contribute to technical reviews, solution design and continuous improvement.
  

Requirements

Non-Negotiable Requirements

• Relevant banking or financial services experience.
  

• Demonstrable software engineering experience combined with Data Engineering capability.
  

• Strong Python engineering skills, including reusable modules, libraries and testing.
  

• Advanced SQL skills, including CTEs, window functions, query plans and optimisation.
  

• Practical ETL/ELT, data ingestion and transformation experience.
  

• Hands-on cloud engineering experience, with AWS as the core platform requirement.
  

• Experience with Git, CI/CD pipelines and automated deployments.
  

• Knowledge of automated testing, production monitoring and incident troubleshooting.
  

• Understanding of data quality, reconciliation, security and privacy controls.
  

• Strong problem-solving and technical documentation skills.
  

• Ability to work independently and take ownership of technical deliverables.
  

• Excellent communication and stakeholder management skills.
  

• Availability to work onsite in Rosebank approximately 3 days per week.
  

• Availability to commence on 1 January 2027.
  

Core Technical Skills

• AWS
  

• Python and software development
  

• Advanced SQL
  

• ETL/ELT and data pipeline development
  

• Data integration
  

• Git and CI/CD
  

• Automated testing
  

• Cloud-based processing
  

• Monitoring, logging and production support
  

• Data quality and reconciliation
  

Role-Critical Technologies

• AWS S3, Glue, Lambda, Athena, Redshift and EMR.
  

• Serverless processing and cloud-native engineering.
  

• Spark and PySpark.
  

• Kafka and event-driven processing.
  

• SQS, SNS and EventBridge.
  

• Airflow/MWAA and Step Functions.
  

• APIs and software-to-data integrations.
  

• Data warehouses, data lakes and lakehouse architectures.
  

• Terraform and Infrastructure as Code.
  

• Automated deployment and operational resilience.
  

• Performance tuning, monitoring and production readiness.
  

Desirable Capabilities

• Experience with batch processing and workflow scheduling.
  

• Data governance, ownership and classification.
  

• Cloud cost optimisation and FinOps awareness.
  

• Legacy system modernisation and cloud migration.
  

• Data products, interfaces and service-level agreements/objectives.
  

• Data mesh concepts and federated governance.
  

Core Attributes

• Strong banking or financial services awareness.
  

• Combines software engineering discipline with data engineering capability.
  

• Self-starter who works effectively with minimal supervision.
  

• Takes ownership of code, pipelines, deployments and deliverables.
  

• Proactive problem-solver with strong analytical skills.
  

• Excellent written and verbal communication.
  

• Strong attention to detail, reliability and quality.
  

• Effective collaboration with technical and business stakeholders.
  

• Professional stakeholder engagement.
  

• Smart and professional presentation appropriate to a banking environment.
  

Recruitment priority: A strong hybrid Software & Data Engineer who combines practical software development skills with data pipeline engineering, AWS expertise, sound testing and deployment practices, and relevant banking experience.