MRM: Model Risk Management
The process of identifying, measuring, monitoring, and controlling risks arising from the use of quantitative models and AI/ML systems in business decisions.
What is MRM?
Model risk management, originally defined in Federal Reserve SR 11-7 for financial institutions, has expanded to cover AI/ML systems across industries. MRM includes model inventory management, independent validation, performance monitoring, documentation standards, and governance structures. Key risks include data quality issues, overfitting, concept drift, adversarial attacks, and unintended bias. The model lifecycle encompasses development, validation, deployment, monitoring, and retirement. Effective MRM requires clear ownership, defined risk appetite, and escalation procedures.
Application to Vendor Screening
When vendors use models or AI that impact your business, assess their MRM practices: Is there an independent validation process? How is model performance monitored? What happens when a model degrades? Request model risk documentation and validation reports for critical vendor AI systems.
Practical Examples
- Requesting a vendor's model inventory for AI systems processing your data
- Reviewing independent validation reports for vendor credit scoring models
- Assessing a vendor's model monitoring and drift detection capabilities
Frequently Asked Questions
What is model risk?
Model risk is the potential for adverse consequences from decisions based on incorrect or misused model outputs. This includes errors in model design, flawed input data, inappropriate use beyond intended scope, and failure to update models as conditions change.
Does SR 11-7 apply to AI/ML models?
While SR 11-7 was written for traditional quantitative models, regulators expect its principles to apply to AI/ML systems. The OCC and Fed have clarified that AI models used in banking decisions fall under existing MRM guidance.