This file summarises HadUK-Grid version changes. Associated files within this folder provide additional information. Comparisons are made between v1.3.1.ceda and v1.3.0.ceda. HadUK-Grid_v1.3.1.ceda_change_log.txt - Audit and summary of files comparing v1.3.1.ceda with v1.3.0.ceda HadUK-Grid_v1.3.1.ceda_grid_file_comparison.csv - Summary statistics of changes to data in each gridded data file HadUK-Grid_v1.3.1.ceda_regional_average_comparison.csv - Summary statistics of changes to regional averages (country, region, river) HadUK-Grid_v1.3.1.ceda_station_changes.csv - Summary of changes to the underlying station observations used to produce the dataset V1.3.1.ceda ----------- Changes to the dataset *Added data for calendar year 2024 *Extended the daily temperature grids back to 1931 Changes to the input data *Incorporated additional daily rainfall data for 60 sites in Scotland, 1922-45 *Incorporated additional monthly rainfall data for two sites - Westonbirt (1880-1951) & Ackworth School (1852-53) *Fixed a 1-day offset for sunshine duration values for six stations between 1971 and 1993 *Corrected the daily rainfall data for Macclesfield, 1958-60 (the values had been stored in the wrong units) *Improved the quality control of the most recent three months of rainfall data (Oct-Dec 2024) *Removed Corpach from the wind speed grids (the station is poorly modelled - this only affects 14 months) *Reviewed the quality control flags that had been applied automatically to historical air and grass minimum temperature data. In many cases it was possible to remove the flags and this has allowed us to incorporate additional data into the grids for 1961-1997 for these variables. *Improved the business logic relating to data completeness. This affects monthly wind speed and has allowed us to re-introduce some of the data that were excluded in the previous release. *Net changes to the input station data: -Total of 131314637 observations -126821432 (96.6%) unchanged -105327 (0.08%) modified for this version -4387878 (3.34%) added in this version -44224 (0.03%) deleted from this version V1.3.0.ceda ----------- *Added data for calendar year 2023 *Added newly digitised data for daily rainfall (62 Scottish stations for 1945-1960) *Daily rainfall data for Bolton, 1916-1919 have been corrected (previous values were corrupted and needed redigitising) *Daily rainfall data for Buxton, 1960 have been corrected (conversion from inches to mm had been applied incorrectly) *Rainfall data from EA and SEPA APIs are included for the last three months of the dataset (Oct-Dec 2023) (for all earlier months the rainfall data from partner agencies is obtained from the Met Office's MIDAS database) *The number of stations used for groundfrost, sunshine and windspeed have reduced at different points in the historical series when comparing v1.3.0.ceda to the previous version v1.2.0.ceda. These reductions in station numbers have been caused by changes made in the data processing steps upstream of the gridding process. *For groundfrost this reduction has been caused by an automated quality control process flagging the historical data which have been removed as suspect (mostly affecting data from 1961 to 1970). *For sunshine the small reduction in the 1960s has been caused by the removal of digitized monthly sunshine data through this period where we wish to reverify the data source. *For windspeed the reduction from 1969 to 2010 has been caused by changes to rules applied relating to data completeness when compiling daily mean windspeeds, which in turn have followed through to monthly statistics. *We plan to carry out a review of the data which have been excluded from this version. Some of it may be reintroduced in a future release. *Net changes to the input station data: -Total of 126970983 observations -125384735 (98.75%) unchanged -28487 (0.02%) modified for this version -1557761 (1.23%) added in this version -188522 (0.15%) deleted from this version V1.2.0.ceda -------- *Added data for calendar year 2022 *Added newly digitised data for monthly sunshine 1910-1918 *Added Rainfall Rescue version 2 doi:10.5281/zenodo.7554242 *Updated shapefiles used for production of area average statistics https://github.com/ukcp-data/ukcp-spatial-files *Updated controlled vocabulary for metadata assignment https://github.com/ukcp-data/UKCP18_CVs *Updated assignment of timepoint for some periods so that the datetime is the middle of the period (e.g. season) rather than a fixed offset from the period start. *Updated ordering of regions within regional values files. Alphabetical ordering. *Files use netcdf level 4 compression using gzip https://www.unidata.ucar.edu/blogs/developer/entry/netcdf_compression *Net changes to the input station data: -Total of 125601744 observations -122621050 (97.6%) unchanged -26700 (0.02%) modified for this version -2953994 (2.35%) added in this version -16315 (0.01%) deleted from this version *Changes to monthly rainfall 1836-1960 -Total of 4823973 observations -3315657 (68.7%) unchanged -21029 (0.4%) modified for this version -1487287 (30.8%) added in this version -11155 (0.2%) deleted from this version V1.1.0.0 -------- *Added data for calendar year 2021 *Added data for 30 year average period 1991-2020 *Updated 30 year averages for 1961-1990 and 1981-2010. This is an order of operation change. In this version the 30 year averages are calculated from the underlying monthly/seasonal/annual grids (grid-then-average) in previous versions they were grids of interpolated station averages (average-then-grid). This order of operation change results in small differences to the values, but provides improved consistency with the monthly/seasonal/annual series grids. *Order of operation change to 30 year averages means that 1961-1990 averages are not included for sfcWind or snowLying variables due to the start date for these variables being 1969 and 1971 respectively. *Added Rainfall Rescue monthly rainfall data. This source now accounts for 84% of pre-1960 monthly rainfall data. Extended monthly rainfall series back to 1836. *Net changes to the input station data: -Total of 122664065 observations -118464870 (96.5%) unchanged -4821 (0.004%) modified for this version -4194374 (3.4%) added in this version -5887 (0.005%) deleted from this version *Changes to monthly rainfall 1836-1960: -Total of 3347841 observations -544198 (16%) unchanged -1823 (0.05%) modified for this version -2801820 (84%) added in this version -4534 (0.1%) deleted from this version *Reference Hawkins et al. (2022): Millions of historical monthly rainfall observations taken in the UK and Ireland rescued by citizen scientists. Geoscience Data Journal. Article DOI: 10.1002/gdj3.157 V1.0.3.0 -------- * Added data for calendar year 2020 * Corrected _FillValue designation in Seasonal and Annual gridded data * Some additional QC amendments applied to historical MIDAS data * Net changes to the input station data: -Total of 118475657 observations -117298602 (99%) unchanged -8162 (0.007%) modified for this version -1168893 (0.99%) added in this version -3566 (0.003%) deleted from this version V1.0.2.1 -------- * Corrected grid definition for 12km grid product to match UKCP18 climate model products * Changed the netcdf _FillValue, now set at 1.0e20 * Updated filter to remove late arriving daily rainfall observations that have not passed through full quality control * Corrections to early monthly sunshine observations * Net changes to the input data for v.1.0.2.1 compared to v1.0.2.0: * Daily rainfall data 2018-2019: -Total of 1776543 observations -109 corrections -285 additions -6274 removals * Monthly sunshine data 1919-1928: -Total of 22041 observations -16 corrections -17 removals V1.0.2.0 (not published, changes have been included in v1.0.2.1) ----------------------------------------------------- * Added data for calendar year 2019 * Added newly digitised data collections: - Monthly Sunshine 1919-1928, extending the related monthly sunshine series accordingly - Operation Weather Rescue. Daily rainfall, monthly temperature and monthly rainfall for 1900-1910 - Operation Weather Rescue. Ben Nevis, daily rainfall, monthly temperature and rainfall 1883-1904 - Rainfall Rescue, early release monthly rainfall 1862-1909 UK stations as available in May 2020 from https://github.com/ed-hawkins/rainfall-rescue * Additional QC corrections and removals applied to historical MIDAS observations * Net changes to the input station data: -Total of 117661423 observations -116106524 (98.6%) unchanged -118294 (0.1%) modified for this version -1436605 (1.2%) added in this version -141719 (0.1%) deleted from this version * Reference: Hawkins, E.; Craig, P. (2019): Meteorological observations recovered by the Weather Rescue project. Centre for Environmental Data Analysis, date of citation. http://catalogue.ceda.ac.uk/uuid/56c03beb2e11472d87d547ea53c95f51 V1.0.1.0 -------- * Added data for calendar year 2018 * Added a 5km resolution grid V1.0.0.0 -------- * First release * DOI:10.1002/gdj3.78