qa – IntelliAQ https://intelliaq.eu Air Quality forecasting with machine learning. Tue, 23 Jun 2020 14:18:08 +0000 en-GB hourly 1 https://wordpress.org/?v=6.5.5 https://intelliaq.eu/wp-content/uploads/2020/05/cropped-intelliaq_logo_stacked_transparent-32x32.png qa – IntelliAQ https://intelliaq.eu 32 32 Statistics https://intelliaq.eu/2019/04/01/statistics/ Mon, 01 Apr 2019 14:05:00 +0000 https://intelliaq.eu/?p=1515 To evaluate the model performance, we base our analysis on the full joint distribution of forecasts and observations (Murphy and Winkler, 1987). We access detailed information on the joint distribution by factorisation into a conditional, and a marginal distribution [Figure 10].

Moreover, we evaluate our model against persistence and a climatological (observational) reference model. A new model only has a genuine added value against those simple reference models, if it outperforms both of them. To analyses this, we use skill scores which are relative relations of scoring rules like the mean squared error (MSE).

Figure 11: Conditional quantile plot for lead time up to four days ((a) to (d)). Conditional percentiles (.10th and .90th, .25th and .75th and .50th) from the conditional distribution p(o|m) are shown as lines in different styles. The reference line indicates a hypothetic perfect forecast. The marginal distribution of the forecast p(m) is shown as log-histogram.

]]>