12 months Contract - Senior Data Engineer (Through an External Agency Payroll Provider)
Summary
Build and maintain scalable data pipelines and backend services for wealth-management analytics using Python, Spark, SQL, and cloud platforms like Azure.
- Actively participate in Program Increment (PI) planning processes within GPS
- Environment and configuration management of Murex applications/FICC modules and Java applications
- Design, develop, and maintain scalable data pipelines and robust backend services to support real-time decisioning, reporting, data ingestion, and related functions.
- Collaborate on data requirements gathering and contribute to conceptual and logical data modelling to align solutions with business needs.
- Implement efficient data management strategies, including transformation, integration, and orchestration across diverse sources and systems.
- Deliver high-quality, secure, test-covered code that adheres to software development best practices and regulatory standards.
- Develop and enhance software solutions to strengthen data governance frameworks, ensuring compliance, traceability, and accountability.
- Build and maintain automated processes to enforce data security protocols and uphold stringent data quality standards across the enterprise.
- Demonstration of appropriate values and behaviours including but not limited to standards on honesty and integrity, due care and diligence, fair dealing (treating customers fairly), management of conflicts of interest, competence and continuous development, adequate risk management, and compliance with applicable laws and regulations
- BS/MS in Computer Science, Data Analytics, Data Management, Information Systems or related technical field or equivalent training & experience.
- 5+ years Incorporating data processing and workflow management tools into pipeline design.
- 5+ years' experience in ETL/ELT, Data warehousing, and/ or Business Intelligence Development.
- 5+ years building and maintaining end-to-end data systems and supporting services in Python, Scala or similar.
- 5+ years using SQL to understand data and to investigate data issues or problems and provide solutions.
- 3+ years working with cloud data technologies.
- Experience with structured, semi-structured, and unstructured data.
- Experience utilizing a variety of data stores, including data warehouses, RDBMSes, in-memory caches, and searchable document Databases.
- Experience working with large data sets in SQL/Databricks/PySpark.
- Experience with Spark Streaming, and Delta (Live) Tables.
- Experience with storage systems such as Azure Storage/ Data Lakes.
- Experience with data modelling.
- Strong design, implementation, and testing skills.
- Experience developing for continuous integration and automated deployments.
- Experience developing on cloud platforms (preferably Azure) in a continuous delivery environment.
- Experience with microservices platforms (Kubernetes, Docker, Helm Charts).
- Experience with Event-Driven streaming systems (Kafka, Event Hub, Event Grid, Apache Flink).
- Knowledge and use of DBT.
- Experience with data vault is a plus.
- Experience with BI tools.
- 1+ years software development using languages like JavaScript, Java, or C#.
- Ability to provide technical leadership to other developers.
- Excellent command of verbal and written communication skills
- Able to work autonomously in a global team setup to take on initiative with a positive attitude
- Solution orientated and able to work in an agile setup
- Strong interpersonal and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Ability to work in a fast-paced environment, with a focus on delivering high-quality results under tight deadlines
- Highly motivated blended with a team player spirit