Software & Data Engineer – Banking (CIB)

Resource Requirements

Company: BluePearl Consulting

Number of Vacancies: 1

Industry: Banking / Financial Services

Department: Corporate and Investment Banking (CIB)

Contract Duration: 12 months, with potential extension up to 36 months

Expected Start Date: 1 January 2027

Location: Rosebank, Johannesburg, Gauteng

Work Arrangement: Hybrid – approximately 3 days onsite per week

Job Summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment.

This role requires a combination of software engineering and data engineering expertise. The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development lifecycle.

The ideal candidate will have strong Python and SQL skills, hands‑on AWS experience, knowledge of ETL/ELT processes and experience with automated testing, CI/CD, monitoring and production support.

The candidate must be a self‑starter who can work independently, take ownership of technical deliverables and communicate effectively with technical and business stakeholders.

Key Responsibilities

• Design, develop and maintain software components and data engineering solutions.
• Build scalable data ingestion, transformation and integration pipelines.
• Develop reusable, maintainable and testable Python modules and services.
• Write, optimise and troubleshoot SQL queries.
• Apply software engineering principles, coding standards and appropriate design practices.
• Work with AWS cloud services to develop and support data‑intensive applications.
• Develop and maintain ETL/ELT workflows and data processing components.
• Build and support APIs, integrations and event‑driven components where required.
• Implement automated unit, integration, regression and reconciliation testing.
• Contribute to Git‑based version control and CI/CD pipelines.
• Support automated deployment, quality gates and release processes.
• Work with distributed processing and event‑streaming technologies where required.
• Implement logging, monitoring, alerting and operational support mechanisms.
• Troubleshoot application and data pipeline incidents and conduct root‑cause analysis.
• Apply security, access control, encryption and data privacy practices.
• Maintain technical documentation, solution designs and operational runbooks.
• Collaborate with Data Engineers, Software Engineers and business stakeholders.
• Contribute to technical reviews, solution design and continuous improvement.

Requirements

Non‑Negotiable Requirements

• Relevant banking or financial services experience.
• Demonstrable software engineering experience combined with Data Engineering capability.
• Strong Python engineering skills, including reusable modules, libraries and testing.
• Advanced SQL skills, including CTEs, window functions, query plans and optimisation.
• Practical ETL/ELT, data ingestion and transformation experience.
• Hands‑on cloud engineering experience, with AWS as the core platform requirement.
• Experience with Git, CI/CD pipelines and automated deployments.
• Knowledge of automated testing, production monitoring and incident troubleshooting.
• Understanding of data quality, reconciliation, security and privacy controls.
• Strong problem‑solving and technical documentation skills.
• Ability to work independently and take ownership of technical deliverables.
• Excellent communication and stakeholder management skills.
• Availability to work onsite in Rosebank approximately 3 days per week.
• Availability to commence on 1 January 2027.

Core Technical Skills

• AWS
• Python and software development
• Advanced SQL
• ETL/ELT and data pipeline development
• Data integration
• Git and CI/CD
• Automated testing
• Cloud-based processing
• Monitoring, logging and production support
• Data quality and reconciliation

Role‑Critical Technologies

• AWS S3, Glue, Lambda, Athena, Redshift and EMR.
• Serverless processing and cloud‑native engineering.
• Spark and PySpark.
• Kafka and event‑driven processing.
• SQS, SNS and EventBridge.
• Airflow/MWAA and Step Functions.
• APIs and software‑to‑data integrations.
• Data warehouses, data lakes and lakehouse architectures.
• Terraform and Infrastructure as Code.
• Automated deployment and operational resilience.
• Performance tuning, monitoring and production readiness.

Desirable Capabilities

• Experience with batch processing and workflow scheduling.
• Data governance, ownership and classification.
• Cloud cost optimisation and FinOps awareness.
• Legacy system modernisation and cloud migration.
• Data products, interfaces and service‑level agreements/objectives.
• Data mesh concepts and federated governance.

Core Attributes

• Strong banking or financial services awareness.
• Combines software engineering discipline with data engineering capability.
• Self‑starter who works effectively with minimal supervision.
• Takes ownership of code, pipelines, deployments and deliverables.
• Proactive problem‑solver with strong analytical skills.
• Excellent written and verbal communication.
• Strong attention to detail, reliability and quality.
• Effective collaboration with technical and business stakeholders.
• Professional stakeholder engagement.
• Smart and professional presentation appropriate to a banking environment.

Recruitment priority: A strong hybrid Software & Data Engineer who combines practical software development skills with data pipeline engineering, AWS expertise, sound testing and deployment practices, and relevant banking experience.