Senior Specialist, Data Engineer
Summary
Designs, builds, and maintains data pipelines and cloud-based analytics systems using AWS, Spark, and SQL to support financial services.
To design, code, test, debug and correct programs in software engineering environments within the continuous delivery pipe line as well as provide support and maintenance of systems. In addition, produce software specifications in accordance with the technical requirements, within the framework of the software quality assurance standards.
Experience with big data and cloud technologies on AWS, including Amazon Athena, AWS Lambda, AWS CloudFormation, Amazon EMR, and Apache Spark.
Advanced SQL proficiency with hands-on experience in Oracle and/or Amazon Redshift.
Type of Qualification: First Degree
Field of Study: Information Technology
Experience Required
Software Engineering
Technology
5-7 years
Broad experience in translating business and functional requirements into technical specifications and developing the programming code to create the solutions.
Behavioural Competencies:
- Adopting Practical Approaches and Articulating Information
- Developing Expertise
- Documenting Facts
- Examining Information and Interpreting Data
Technical Competencies:
- Agile, API and Data Engineering
- Automation
- Cloud Computing
- Continuous Delivery (CD)
- Continuous Deployment
- Continuous Integration (CI)
- Core Systems
- Incident Response
- Infrastructure as Code (IaC)
- Microservices
- Non-abstract Large System Design (NALSD)
- Observability (Application and Web Analytics)
- Platform Engineering
- Security Engineering
- Software Engineering Methods & Tools
- Software Foundations
- System Integration
- Test-driven Design (TDD)