We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Conditional Probabilities, Relative Operating Characteristics, and Relative Operating Levels.
- Authors
Mason, Simon J.; Graham, Nicholas E.
- Abstract
The relative operating characteristic (ROC) curve is a highly flexible method for representing the quality of dichotomous, categorical, continuous, and probabilistic forecasts. The method is based on ratios that measure the proportions of events and nonevents for which warnings were provided. These ratios provide estimates of the probabilities that an event will be forewarned and that an incorrect warning will be provided for a nonevent. Some guidelines for interpreting the ROC curve are provided. While the ROC curve is of direct interest to the user, the warning is provided in advance of the outcome and so there is additional value in knowing the probability of an event occurring contingent upon a warning being provided or not provided. An alternative method to the ROC curve is proposed that represents forecast quality when expressed in terms of probabilities of events occurring contingent upon the warnings provided. The ratios used provide estimates of the probability of an event occurring given the forecast that is issued. Some problems in constructing the curve in a manner that is directly analogous to that for the ROC curve are highlighted, and so an alternative approach is proposed. In the context of probabilistic forecasts, the ROC curve provides a means of identifying the forecast probability at which forecast value is optimized. In the context of continuous variables, the proposed relative operating levels curve indicates the exceedence threshold for defining an event at which forecast skill is optimized, and can enable the forecast user to estimate the probabilities of events other than that defined by the forecaster.
- Subjects
WEATHER forecasting; PROBABILITY forecasts (Meteorology)
- Publication
Weather & Forecasting, 1999, Vol 14, Issue 5, p713
- ISSN
0882-8156
- Publication type
Article
- DOI
10.1175/1520-0434(1999)014<0713:CPROCA>2.0.CO;2