The difference between model wind and observed wind differed very much from station to station. For some Helsinki Testbed area stations, the model wind was on average too strong or too weak. When wind speeds were the highest, the model underestimated the speed. Mast observation did not reflect the low-level jet stream because only one measurement level was available.
When comparing observed wind speed and model wind, one has to remember that model wind represents the mean value in a grid box with a homogenous landscape that excludes all the details of the actual landscape itself. The measurements may also include errors.
The above table is a summary of the comparison of model winds and mast observations over the period 1 July 2008 - 31 July 2009. A boldface figure in the column for observations indicates that the number represents less than 50% of all possible observations and that the station was therefore excluded from calculation of the mean error. The boldface figure in the STDE column also indicates that the station was excluded from calculation of the mean value or error over stations.
The summary table showing the comparison of wind speed between FMI sea weather stations and the AROME model over the period 1 July 2008 - 31 July 2009.
The purpose of the validation was to assess how well the model wind speed at a grid point corresponds to the wind speed observed at the mast. The wind speed for a grid point at a certain level corresponds to a mean value of a 2.5 km x 2.5 km square. Furthermore, the model topography corresponds to a mean topography of the same area. On flat areas the difference is not great, whereas in hilly areas the difference can be substantial. The interpolation of wind speed from model levels to constant height levels may also introduce error.
All observations have also errors as well as the model forecasts and the structure of the model error has been studied. The observations obtained with Helsinki Testbed masts also have many peak type errors and discontinuities. A quality control was performed for all the data and indistinct observations were excluded from error calculations. However, the calculations may still contain some erroneous observations. The graphics show all the observations.
The accuracy and reliability were determined from model forecasts. Reliability is more important in this examination. The validation of wind speed was made separately for every available station in order to determine if there are differences in error structure between masts in inland, near the coastline and in sea areas. The mean error was calculated for all stations. It is not easy to compare the results for different masts because the observation data differ from station to station. Only 10% of all possible observations were available for some masts while the corresponding figure for some Testbed stations may be more than 75%. The whole validation period was 13 months and observations from over 20 stations were available. However, only stations having more than 50% of all possible observations were included in the comparison. The outliers were excluded.
The results of the validation indicate that the error differed from station to station. The day/night difference was great as well. The mean errors were calculated for all representative stations.
When the above results are considered, one has to take into account that in the AROME model (or any model), wind speed increases (between levels of 50 - 100 metres) 0.13 m/s over an open sea area and 0.23 m/s over a land area for every 10 metre layer. Even a slight difference in topographical height between the model representation and the real environment can be partly responsible for the errors shown in tables.
The figures below show the results for Viirilä mast as an example of a typical error distribution for model wind speed and observed wind speed. The first figure shows the mean AROME wind speed profile and the mean observation. The second figure shows the scatter diagram for the AROME model wind speed and the wind speed observations.
Mean error (ME) of model wind speed at Viirilä mast for different model levels over the period 1 July 2008 - 31 July 2009. The measurement level at Viirilä mast is 81 metres.
Scatter diagram of the model wind speed and the observed wind speed at Viirilä mast over the period 1 July 2008 - 31 July 2009. The measurement level at Viirilä mast is 81 metres.
Marginal distributions of model wind speed and the observations for all stations. The height of the model winds and observations ranges from 60 to 100 metres.
Some stations overestimate the wind speed while others underestimate it. At stations near the coastline, the model seems to underestimate the wind speed more than in open sea areas or inland areas.