---
title: "Quality Assurance of Analytical Modelling: The importance of QA in Model Risk Management | Hartley McMaster"
description: Find out why quality assurance is so important for analytical modelling and model risk management in the finance sector.
image: https://blog.hmcm.co.uk/hubfs/quality-assurance-testing.png
---
[Skip to the main content.](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#main-content)
[](https://www.hmcm.co.uk)
[](https://www.hmcm.co.uk)
- [Tel: +44 (0)20 4583 4513](tel:+442045834513)
- [Company](https://www.hmcm.co.uk/company)
- [Insights](https://blog.hmcm.co.uk/insights)
- [Contact Us](https://meetings-eu1.hubspot.com/tom-dewar/web-enquiry)
[](https://hubspot-cta-redirect-eu1-prod.s3.amazonaws.com/cta/redirect/25327253/0acd864d-b25e-45d9-9827-af55d4ac0405)
Toggle Menu
Toggle Menu
[](https://hubspot-cta-redirect-eu1-prod.s3.amazonaws.com/cta/redirect/25327253/0acd864d-b25e-45d9-9827-af55d4ac0405)
- [Tel: +44 (0)20 4583 4513](tel:+442045834513)
- [Company](https://www.hmcm.co.uk/company)
- [Insights](https://blog.hmcm.co.uk/insights)
- [Contact Us](https://meetings-eu1.hubspot.com/tom-dewar/web-enquiry)
[*Facebook*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0) [*Instagram*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0) [*LinkedIn*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0) [*Twitter*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0) [*Youtube*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0) [*Medium*](https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management#0)
##### Column Headline
- Testing 1
- Sub Nav 1
- Sub Nav 2
- Testing 2
- Testing 3
##### Column Headline
- Testing 1
- Sub Nav 1
- Sub Nav 2
- Testing 2
- Testing 3
- Testing 1
- Sub Nav 1
- Sub Nav 2
- Testing 2
- Testing 3
3 min read
# Quality Assurance of Analytical Modelling: The importance of QA in Model Risk Management
[ Stewart Williams](https://blog.hmcm.co.uk/insights/author/stewart-williams) Sep 2022
[data leadership](https://blog.hmcm.co.uk/insights/tag/data-leadership) [analytical modelling](https://blog.hmcm.co.uk/insights/tag/analytical-modelling)
*Since the global financial crisis there has been greater recognition that models serve many important strategic purposes for financial services firms, but more importantly they pose many risks that must be recognised and addressed. The importance of quality assurance of analytical modelling in finance and in the public sector is well established. Yet outside these areas, analytical model QA is often not given the attention it demands.*
[Model Risk](https://en.wikipedia.org/wiki/Model_risk) Management in the Finance Sector is now embedded in the regulations, guidance and expectations of supervisory bodies, which emphasise the need for audit and assurance of both individual models and the processes around their development and governance
It was addressed as a major concern by leading global banks in [recent surveys and round tables](https://www.mckinsey.com/business-functions/risk/our-insights/the-evolution-of-model-risk-management) conducted in Europe and the United States by McKinsey and Risk Dynamics. The overall number of models varied widely, ranging from 100 to 3,000 per bank; the number of full-time equivalent staff (FTEs) dedicated to model risk management and validation was also highly variable, with European banks dedicating an average of 8 FTEs per €100 billion of assets, while for US banks this average was 19.
##### **Model risk management is NOT specific to finance**
The importance of analytical model risk management is not limited to the finance sector. During the [Intercity West Coast](https://en.wikipedia.org/wiki/InterCity_West_Coast) franchise competition in 2012 (where a winner was announced, the competition subsequently cancelled, and bidders’ costs refunded before any contracts were signed) the UK Government identified errors in a model used to evaluate bids as being a major contributor to the failure of the process. The total cost to the UK taxpayer of those spreadsheet model errors is estimated to be in excess of £50million.
##### **Quality Assurance of analytical modelling elevated by the Macpherson review**
Following their experiences with that competition, the UK Government instigated the [Macpherson review into quality assurance (QA) of analytical models across government](https://www.gov.uk/government/publications/review-of-quality-assurance-of-government-models), which reported in March 2013, and recommended that departments put in place the right processes and culture to support model development and quality assurance of those models. Inherent in those recommendations was the recognition that analytical model governance and QA processes should recognise both the level of business risk associated with each model’s use, and the complexity of the model itself. Complex models affecting major business decisions justify resource intensive QA.
Following the Macpherson review, a cross-government departmental working group on analytical modelling quality assurance was established and this developed “[The Aqua Book: guidance on producing quality analysis for government](https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government)” (published my HM Treasury). Hartley McMaster consultants (including myself) reviewed and commented on the content of the Aqua book when it was in draft form. Its subsequent publication led to many of the departments implementing their own analytical assurance frameworks in line with the Aqua guidance. It was nice to see model QA finally being taken seriously!
##### **Analytical Modelling Quality Assurance brings new organisational needs**
The increased emphasis on testing of analytical models has provided many opportunities for consultants to provide Analytical Modelling QA support to government departments and to a number of private sector companies.
We’ve been lucky enough to provide Analytical Model Testing and Quality Assurance services ranging from reviewing entire QA processes to auditing individual models. They have not been limited to spreadsheet models but have covered models developed in VBA, Visual Basic, C#, SQL, R, Python, SAS, SPSS and other proprietary modelling languages such as those available in Simul8 (simulation) and FICO XPRESS (optimisation).
##### **Yet quality assurance of high-risk analytical models is being ignored**
In all industries, as critical business decisions are increasingly driven by analytical models, it is imperative for organisations to identify and understand their risks.
To be blunt about it: complex models influencing major decisions demand robust quality assurance as part of their risk management strategies.
As you can probably tell, I’m a bit of an evangelist when it comes to model QA. I’ve consulted with many organisations, many of which have not even considered the need for model QA, despite having models that are high risk or business critical.
##### **Developing a quality assurance process for your analytical models? Here’s a start…**
I believe that analytical model development requires the discipline exhibited by good software engineers.
While talking to one of my colleagues recently, she challenged me to put down in a mind map all the things I thought organisations needed to consider when performing model QA.
I accepted the challenge, and my resulting multi-level mind map was detailed to say the least, covering many aspects of analytical model development, governance and use.
Here’s the simplified version showing the ten top-level stages:
.png?width=628&name=considerations-for-model-development-and-qa-mind-map%20(2).png)
These ten stages encompass the most important components of analytical model development and Quality Assurance and they act as a starting point for organisations considering how they can put a rigorous analytical modelling QA process in place.
In my next blog post I’ll take a brief look at each stage.
We’d be interested in what elements of model development and QA are important to you. Feel free to [get in touch](https://meetings-eu1.hubspot.com/tom-dewar)!
- [Tweet](https://twitter.com/share)
[](https://blog.hmcm.co.uk/insights/connecting-posit-workbench-to-github-with-https)
#### [Connecting Posit Workbench (RStudio) to GitHub with HTTPS](https://blog.hmcm.co.uk/insights/connecting-posit-workbench-to-github-with-https)
 [Tom Dewar](https://blog.hmcm.co.uk/insights/author/tom-dewar): Mar 2023
If you're an RStudio user using Posit Workbench and want to use GitHub for source control (you should), this is the guide for you. There are two ways...
[technical tips](https://blog.hmcm.co.uk/insights/tag/technical-tips)
[Read More](https://blog.hmcm.co.uk/insights/connecting-posit-workbench-to-github-with-https)
[](https://blog.hmcm.co.uk/insights/maximise-value-from-data-analytics)
#### [How to maxmise value from data analytics](https://blog.hmcm.co.uk/insights/maximise-value-from-data-analytics)
 [Tom Dewar](https://blog.hmcm.co.uk/insights/author/tom-dewar): Mar 2023
Many companies investing in data analytics struggle to achieve the full value of their investment, perhaps even becoming disillusioned. To understand...
[data leadership](https://blog.hmcm.co.uk/insights/tag/data-leadership)
[Read More](https://blog.hmcm.co.uk/insights/maximise-value-from-data-analytics)
[](https://blog.hmcm.co.uk/insights/five-ways-data-can-help-your-business-navigate-stormy-waters)
#### [Five ways data can help your business navigate stormy waters](https://blog.hmcm.co.uk/insights/five-ways-data-can-help-your-business-navigate-stormy-waters)
 [Tom Dewar](https://blog.hmcm.co.uk/insights/author/tom-dewar): Oct 2022
We are cursed to live in interesting times. As I write this, a war in Ukraine rumbles on, we sit on the tail of a pandemic and at the jaws of a...
[data leadership](https://blog.hmcm.co.uk/insights/tag/data-leadership)
[Read More](https://blog.hmcm.co.uk/insights/five-ways-data-can-help-your-business-navigate-stormy-waters)
##### Get our latest insights
Get our latest insights
Hartley McMaster is an independent management consultancy specialising in the use of analytical and structured methods to solve business problems.
##### London
London
167-169 Great Portland Street
5th Floor
London, W1W 5PF
United Kingdom
T: +44 (0) 20 4583 4513
[E: contact@hmcm.co.uk](mailto:contact@hmcm.co.uk)
##### Hong Kong
Hong Kong
1104 Crawford House
70 Queen's Road Central
Central
Hong Kong
T: +(852) 5346 5400
[E: contact@hmcm.com.hk](mailto:contact@hmcm.com.hk)
[](https://www.hmcm.co.uk)
- [Privacy Policy](https://www.hmcm.co.uk/privacy-policy)
© 2026 Hartley McMaster Ltd
[*Twitter*](https://twitter.com/hartleymcmaster)[*LinkedIn*](https://www.linkedin.com/company/hartley-mcmaster/)
*Return to Top*
```json
{
"@context" : "https://schema.org",
"@type" : "BlogPosting",
"author" : {
"@type" : "Person",
"name" : "Stewart Williams",
"url" : "https://blog.hmcm.co.uk/insights/author/stewart-williams"
},
"dateModified" : "2023-02-13T14:06:38.498Z",
"datePublished" : "2022-09-15T05:32:42.000Z",
"headline" : "Quality Assurance of Analytical Modelling: The importance of QA in Model Risk Management | Hartley McMaster",
"image" : [ "https://blog.hmcm.co.uk/hubfs/quality-assurance-testing.png" ],
"mainEntityOfPage" : {
"@id" : "https://blog.hmcm.co.uk/insights/quality-assurance-of-analytical-modelling-the-importance-of-qa-in-model-risk-management",
"@type" : "WebPage"
},
"publisher" : {
"@type" : "Organization",
"logo" : {
"@type" : "ImageObject",
"url" : "https://blog.hmcm.co.uk/hubfs/logos/HMCM%20logo%20two-colour%20STANDARD%20100h.png"
},
"name" : "Hartley McMaster Ltd"
}
}
```