Financial Crimes Model Analyst
Summary
A model analyst at a national bank who designs, validates, and optimizes financial crime detection models covering fraud, AML/KYC, and sanctions monitoring. Day-to-day work spans SQL/Python experimentation, LLM/SLM output calibration, drift and bias monitoring, and audit-ready Model Risk Management documentation.
The Financial Crimes Model Analyst plays a critical role in designing, validating, and optimizing analytical models that support financial crime prevention, including fraud, AML/KYC, and sanctions monitoring. This role leverages modern data-agnostic, low/no-code analytical platforms and machine-learning tooling to operationalize robust detection logic, integrate LLM/SLM outputs responsibly, and ensure alignment with Model Risk Management (MRM) standards.
PRINCIPAL DUTIES AND RESPONSIBILITIES
- Designs, validates, and enhances financial crime detection models across fraud, AML/KYC screening, and related domains.
- Applies statistical techniques to evaluate and calibrate LLM/SLM outputs when used in decision-support workflows.
- Conducts ablation studies, back testing, and reproducible experiments to ensure model stability and business impact.
- Optimizes model and pipeline efficiency, including latency, throughput, and computational performance.
- Develops, tracks, and interprets performance metrics.
- Implements monitoring for drift, bias, degradation, and shifts.
- Produces audit-ready MRM documentation, including validation plans, governance artifacts, explainability notes, and calibration reports.
- Maintains model health dashboards and reporting for executives, governance bodies, and oversight functions.
- Partners with internal and external data engineers and vendor partners to maintain reliable inputs and production workflows.
- Develops SQL and Python assets for exploration, experimentation, reporting, and automated artifact generation.
- Maintains clear and comprehensive documentation, including data dictionaries, model cards, decision logic, and workflow diagrams.
- Works cross-functionally with engineering, product, compliance, risk, and vendor teams to deploy and maintain models.
- Translates complex analytical concepts into accessible insights for varied technical and business audiences.
Non-Essential Functions: Performs other duties as assigned.