Test the performance of a PD model: CAP curve and Accuracy Ratio
Peer uest
Cancel
Forget passwd??
blog
3
Test the performance of a PD model: CAP curve and Accuracy Ratio

In credit risk modeling, the cumulative accuracy profile (CAP) is a way to visualize the discriminative power of a PD model.

The following steps to get a CAP curve

1. Calculate the predicted PD for each sample, and rank the PD from the highest to the lowest
2. The y-axis is the cumulative number of default / total default, and the x-axis is the cumulative percentage of the population

The plot below illustrate a CAP curve. For example, 80% of default occurred amount the population with top 20% of PD,

Analyzing the Curve

In the above plot, the grey curve represents a perfect PD model, and the blue line represents a random model with no discriminative power. A good model will have a CAP that is close to the perfect CAP.

The accuracy ratio (AR) is defined as the ratio of the area between the model CAP and the random CAP and the area between the perfect CAP and the random CAP. For a successful model the AR has values between zero and one, with a higher value for a stronger model.

Python Implementation