Data Scientist, Platform AI Squad, Group Data Office (AVP/VP)
Summary
The Data Scientist will build and maintain enterprise-grade AI platform components, focusing on MLOps, LLM orchestration, and infrastructure provisioning using tools like Kubernetes, Terraform, and AWS services. They are responsible for the full lifecycle of model deployment, monitoring, and optimization within the bank's data office.
- Build CI CD workflows for model testing and release
- Build multi agent orchestration frameworks
- Configure telemetry for latency token cost and drift monitoring
- Deploy automated evaluation pipelines for RAG and safety
- Deploy low latency LLM serving engines
- Design reusable enterprise agentic platform components
- Implement GPU capacity planning monitoring and budgeting
- Integrate foundation models with Amazon Bedrock and SageMaker AI
- Integrate function calling to databases vector stores and APIs
- Manage model versioning and metadata tracking
- Optimize LLM inference with KV cache and batching
- Package models into production microservices for REST and gRPC
- Provide MLOps operational support and incident resolution
- Provision multi tenant infrastructure on Kubernetes with Terraform and CloudFormation