Skip to main content
    All articles
    Climate
    Governance
    Modelling

    How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance

    Climate risk models often combine several models rather than one. An emissions scenario may feed a climate model, which feeds a regional hazard model, which feeds an exposure and.

    By Jonas Osman Abdelghafour · · 5 min read
    How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance — technical illustration by Jonas Osman Abdelghafour, climate and governance and modelling risk modelling
    How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and GovernanceClimate · Governance · Modelling

    Climate models create a distinctive model-risk problem

    Climate risk models often combine several models rather than one. An emissions scenario may feed a climate model, which feeds a regional hazard model, which feeds an exposure and vulnerability model, which then feeds a financial model. Each layer has its own data, assumptions, uncertainty and validation problem.

    The source compilation provides several examples of this model chain. RIME-X explicitly separates scenario, global climate response, model and natural variability. The NGFS short-term framework links physical and transition shocks to macroeconomic models, policy rates and credit risk. The KPMG framework then converts climate variables into cash flow, valuation and governance outputs. Validation should therefore challenge the entire chain, not only the final number.

    Layered model governance structure spanning development, independent validation and audit, illustrating "Climate models create a distinctive model-risk problem" in How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance
    Figure 1. Layered model governance structure spanning development, independent validation and audit, in the context of climate models create a distinctive model-risk problem.

    1. Validate conceptual soundness

    The first question is whether the model structure is appropriate for its intended use. A mortgage physical-risk model, a corporate transition-risk model and an insurance catastrophe model require different architectures. The validator should document the risk mechanism, time horizon, portfolio scope, materiality threshold and management use.

    The model should show how climate drivers translate into financial variables. If a climate score changes a PD or valuation without a defensible economic mechanism, conceptual risk is high even if the statistical fit appears acceptable.

    2. Validate data and geospatial mapping

    Climate modelling often combines external hazard data with internal exposure data. Data validation should cover completeness, time alignment, spatial resolution, missing values, coordinate accuracy, exposure mapping, insurance data, borrower financials and version control.

    The ECB flood study demonstrates why spatial precision matters. It combines metre-level flood maps with loan-level AnaCredit data and finds highly localised effects. A bank using coarse regional averages may therefore miss concentrations that are visible only at asset or site level.

    Prior and posterior densities illustrating Bayesian parameter updating, illustrating "2. Validate data and geospatial mapping" in How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance
    Figure 2. Prior and posterior densities illustrating Bayesian parameter updating, in the context of 2. validate data and geospatial mapping.

    3. Validate scenarios and uncertainty

    Scenarios should be treated as conditional pathways, not probability forecasts. Validation should examine whether the selected scenarios cover the relevant physical and transition mechanisms, whether they are internally coherent, and whether key variables have been mapped correctly into internal models.

    The validator should also identify which uncertainty sources are represented. RIME-X distinguishes scenario uncertainty, global response uncertainty, model uncertainty and natural variability. Financial translation adds further uncertainty in damage functions, borrower response, adaptation, insurance, macroeconomic feedbacks and management actions.

    4. Validate calibration and performance

    Historical backtesting is useful where outcomes exist, but it is not sufficient for a non-stationary problem. A model can be well calibrated to past weather and poorly calibrated to future climate. Validation should therefore use multiple tools: holdout testing, cross-validation across regions or events, benchmark models, sensitivity analysis, stability tests, outcome analysis after new events, expert challenge and reverse stress testing.

    For probabilistic models, the validator should examine calibration across quantiles and tails, not only mean error. For credit models, the effect on PD, LGD, EAD and migration should be plausible and supported by borrower economics. For catastrophe models, hazard frequency, severity, vulnerability and dependency should be challenged separately.

    5. Validate use, controls and governance

    A technically sound model can still create risk if users misunderstand it. Validation should review model documentation, limitations, user guidance, override controls, data lineage, change management, approval, monitoring and escalation. The KPMG material calls for independent validation of scenario parameters and exposure estimates as part of periodic climate-risk review.

    The HomeEquity Bank example also shows the importance of integrating climate metrics, monitoring and reporting into established governance rather than treating the model as a one-off regulatory exercise.

    Feature attribution chart showing positive and negative drivers of a model output, illustrating "5. Validate use, controls and governance" in How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance
    Figure 3. Feature attribution chart showing positive and negative drivers of a model output, in the context of 5. validate use, controls and governance.

    A practical validation conclusion

    The strongest validation question is not whether the climate model predicts the future correctly. That standard is impossible for many long-horizon applications. The relevant question is whether the model is conceptually sound, transparent about uncertainty, appropriately calibrated for its purpose, sensitive in the right directions, stable enough for decision use, and governed with controls that prevent false precision.

    Climate model validation should therefore be closer to a full model-risk assessment than a narrow statistical performance test. The output should state where the model is reliable, where it is approximate, what assumptions drive the result, and which decisions should or should not depend on it.

    Conclusion

    The key requirement is decision usefulness. Climate analysis adds value when it improves risk identification, pricing, capital allocation, portfolio management or governance, while making uncertainty and model limitations explicit.

    Sources

    Overlaid physical hazard intensity layers for flood, wind and heat exposure, illustrating "Sources" in How to Validate a Climate Risk Model: Calibration, Uncertainty, Scenarios and Governance
    Figure 4. Overlaid physical hazard intensity layers for flood, wind and heat exposure, in the context of sources.

    Schwind, N. et al. RIME-X v1.0. https://doi.org/10.5194/egusphere-2025-5781

    European Central Bank. Physical climate risk, credit risk and lending activity. Working Paper Series No. 3224, 2026. https://www.ecb.europa.eu

    KPMG Qatar. Integrating climate-risk assessment into corporate decision models. June 2026.

    HomeEquity Bank. Climate Risk Management Report 2026. https://www.homeequitybank.ca

    Disclaimer: This article is professional risk-management analysis and is not investment, legal or regulatory advice.

    Related articles

    Work with Jonas

    For partnerships, modelling reviews, advisory roles, institutional risk projects or technical collaboration.