Is Your Bank Hiding Something? Unveiling the Secrets of Risk Forecasts
"New backtesting methods use e-values and e-processes to monitor the accuracy of financial risk models and safeguard against underreported risks."
In today's complex financial world, accurately forecasting risk is critical for financial institutions. These forecasts determine the capital reserves needed to manage potential losses and ensure stability. Regulatory bodies are tasked with monitoring these risk forecasts through rigorous testing, known as backtesting, to ensure forecasts are reliable and institutions are not underestimating their true risk exposure.
Traditional backtesting methods, however, face unique challenges. Financial data is rarely straightforward; losses and risk predictions are often neither independent nor identically distributed. Regulators are particularly concerned with underestimation of risk, which could lead to insolvency, while overly conservative forecasts are less of a concern. Moreover, regulators often lack precise knowledge of the sophisticated models used by financial institutions, making it difficult to assess the accuracy of their predictions.
A common approach to backtesting Value-at-Risk (VaR) involves a three-zone method based on binomial tests. This model-free approach directly tests risk forecasts without relying on specific models. However, the recent shift towards Expected Shortfall (ES) as the primary regulatory measure for market risk has created new hurdles. ES, unlike VaR, is not easily backtested, and current methods often require specific assumptions about loss distributions or are limited to fixed data sizes.
E-Values and E-Processes: A New Era in Risk Management
To overcome the limitations of traditional backtesting methods, researchers are exploring innovative techniques using e-values and e-processes. These methods, offering advantages over classical statistical tests, provide a powerful framework for regulators to assess the accuracy and reliability of risk forecasts. E-tests, based on e-values, offer several benefits, including greater robustness, the ability to handle complex data dependencies, and the capacity for anytime-valid inference. E-processes can be updated continuously as new data becomes available, providing an ongoing assessment of risk model performance.
- E-values: An e-variable for a hypothesis is a random variable whose expected value is less than or equal to 1 under the null hypothesis. An e-test rejects the hypothesis if a realized e-variable, called an e-value, is larger than a given threshold.
- E-processes: An e-process is a non-negative stochastic process where the expected value at any stopping time is less than or equal to 1 under the null hypothesis.
- Backtest e-statistics: A backtest e-statistic for a risk measure is a function that, when applied to a realized loss and its forecast, produces an e-variable.
The Future of Risk Assessment
The e-backtesting method represents a significant advancement in risk management, offering a model-free and non-asymptotic approach to backtesting ES. By leveraging e-values and e-processes, regulators can gain a more robust and timely assessment of risk forecasts, safeguarding financial institutions and the broader economy. As financial models become increasingly complex, these innovative techniques will be essential for maintaining stability and trust in the financial system.