-
Notifications
You must be signed in to change notification settings - Fork 5
/
Reporting_notes.txt
77 lines (77 loc) · 19.6 KB
/
Reporting_notes.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
06/03/2020 - NI reports 3 cases on twitter (https://twitter.com/publichealthni/status/1235928458431205377) and https://www.publichealth.hscni.net/sites/default/files/2020-03/COVID-19%20-%206%20March%202020.pdf but 4 in a website update (https://www.health-ni.gov.uk/news/latest-update-covid-19-coronavirus)
07/03/2020 - Total cases across all Scottish health boards is 11 but 16 cases reported for Scotland
10/03/2020 - PHE dashboard reports 6 cases, CMO for Wales reports 15 cases (8:43pm on twitter) (https://twitter.com/PublicHealthW/status/1237479240548986881)
11/03/2020 - PHE dashboard reports 15 cases in Wales, CMO for Wales reports 19 cases (4:17pm on twitter) (https://gov.wales/chief-medical-officer-wales-confirms-four-new-cases-coronavirus-covid-19; https://twitter.com/PublicHealthW/status/1237774594704052224)
12/03/2020 - PHE dashboard reports 19 cases in NI; NI reports 20 cases in NI (both supposedly at 2pm) (https://twitter.com/publichealthni/status/1238104757186842625 and https://www.health-ni.gov.uk/news/latest-update-coronavirus-covid-19-4)
13/03/2020 - For NI (and rest of UK?): "On the 13th March, the case definition also changed such that testing was limited to acute Trust admissions only. This will likely lead to a reduction in the total number of tests being performed and an increase in the positivity rate."
18/03/2020 - PHW stopped reporting cases in local authorities, instead favouring reporting in health boards.
20/03/2020 - PHW recommenced LA reporting for this one day
21/03/2020 - PHW started reporting health boards, not local authorities
21/03/2020 - PHW reports 3 deaths (archived here: https://github.com/tomwhite/covid-19-uk-data/blob/master/data/raw/coronavirus-covid-19-number-of-cases-in-wales-2020-03-21.html) but a further 2 deaths are reported on twitter (https://twitter.com/PublicHealthW/status/1241402961189888001)
24/03/2020 - NI surveillance report shows 4 cases (https://www.publichealth.hscni.net/publications/covid-19-surveillance-reports); on the same day (later) a fifth case is reported (https://twitter.com/healthdpt/status/1242528268844138497)
25/03/2020 - [DHSC twitter](https://twitter.com/DHSCgovuk/status/1243237211119800323) announced on that from 25/03/2020 their reporting time period for deaths would change. From 25/03/2020, the latest figures counted from the previous day (for a period from 5pm-5pm) are being published at 2pm the following day. The figures for 25/03/2020 did not cover a full 24 hour period, comprising the period from 9am 24 March to 5pm on 24 March. Figures issued on 26/03/2020 are recorded as of 5pm 24 March to 5pm 25 March.
28/03/2020 - "Prior to the 13th March, total tests included only individuals that met the case definition (travel and clinical criteria). However, during this time wider testing was also being conducted across all Trusts in Northern Ireland. These individuals are now included in the overall virology total resulting in an overnight increase of approximately 400 tests which affected the total number of tests and total number of
29/03/2020 - PHE dashboard reports 40 deaths in Scotland, Scottish gov reports 41
29/03/2020 - PHE dashboard reports 15 NI deaths, NI report shows 21 deaths for Data correct to 29/03/2020 at 09:15 (https://www.publichealth.hscni.net/sites/default/files/2020-03/COVID-19%20Surveillance%20Bulletin%2029.03.20.pdf)
29/03/2020 - Scottish government reports that "one case from Forth Valley has been reassigned to Greater Glasgow and Clyde as more information became available" but unclear when this case was first reported
30/03/2020 - PHE dashboard reports 41 deaths in Scotland; Scottish government reports that "47 patients who tested positive have died"
30/03/2020 - PHE dashboard reports 21 deaths in NI; NI report shows 22 deaths in NI correct to 30/03/2020 at 09:58 (https://www.publichealth.hscni.net/sites/default/files/2020-03/COVID-19%20Surveillance%20Bulletin%2030.03.20.pdf)
30/03/2020 - Reporting of numbers of tests switched from being for number of concluded tests/positive tests to number of tested patients/confirmed cases, I.e. "Across the UK, there have been x concluded tests which y were confirmed negative and z positive." Became "Across the UK, x people have been tested of which z tested positive."
31/03/2020 - PHE dashboard reports 47 deaths in Scotland; Scottish government reports 60 deaths
31/03/2020 - PHE dashboard reports 22 deaths in NI; NI report shows 28 deaths in NI correct to 31/03/2020 at 11:10 (https://www.publichealth.hscni.net/sites/default/files/2020-03/COVID-19%20Surveillance%20Report%2031.03.20.pdf)
31/03/2020 - Scotland: "Please note: delays to reporting over the weekend have contributed to the increase in total test figures and deaths confirmed today."
31/03/2020 - Wales: Betsi Cadwaladr cumulative cases 86* & Cwm Taf cumulative cases 189* "*Due to ongoing data reconciliation and refinement, slight variation may occur in the cases reported by health board area."
01/04/2020 - PHE dashboard/UK gov shows no data for deaths in each country of the UK; looking at website for each country Scotland shows 76 deaths, Wales shows 98 deaths and NI shows 30 deaths (later added to historic COVID-19 dashboard data file)
01/04/2020 - Scotland, "Please note: Of the 430 new laboratory reports yesterday, 108 were from the Dundee laboratory which had been unable to submit data over the weekend or Monday morning."
01/04/2020 - DHSC tweet regarding number of tests per day vs number of people tested: "Testing update for England from Public Health England (@PHE_uk):10,412 tests were carried out yesterday in England. Testing capacity for inpatient care in England currently stands at 12,799 tests per day." Image reads that on 31/03 10421 tests were carried out and 7511 people were tested, inpatient test capacity is 12799. This does not fit with the increase of 8240 people tested between 30/03 and 31/03, nor the 9793 between 31/03 and 01/04. Unclear when this testing period on 31/03 was defined/reported. (https://twitter.com/DHSCgovuk/status/1245350948307963911)
02/04/2020 - DHSC tweet states that on 01/04, 10657 tests were carried out and 7771 people were tested which again doesn't fit with numbers reported on either 01/04 or 02/04 (https://twitter.com/DHSCgovuk/status/1245697882130395136)
02/04/2020 - PHE dashboard/UK gov shows 30 deaths for NI, NI report with data correct to 02/04/2020 at 11.15 (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Survellance%20Bulletin%2002.04.20.pdf) showed 36
02/04/2020 - PHE dashboard/UK gov shows 76 deaths in Scotland, Scottish government website shows 126
02/04/2020 - Scottish government website re deaths: "Following a change in how deaths are reported, today’s increased figures reflect the difference between the previous and new reporting systems."
02/04/2020 - Scotland announced that there was a change to how deaths are reported but did not specify how.
03/04/2020 - PHE dashboard/UK gov shows 36 deaths for NI; NI reports 48 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2003.04.20.pdf)
03/04/2020 - PHE dashboard/UK gov shows 126 deaths for Scotland; Scottish government website shows 172 deaths
04/04/2020 - PHE dashboard/UK gov shows 172 deaths for Scotland; Scottish government website shows 218 deaths
04/04/2020 - PHE dashboard/UK gov shows 48 deaths for NI; NI reports 56 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2004.04.20.pdf)
05/04/2020 - Welsh reporting stated that "*Following continuous ongoing data reconciliation, 11 duplicate cases which were previously reported have been identified and removed from the overall figures." referring to data for Cardiff and Vale, Cwm Taf Morgannwg, Swansea Bay and Aneurin Bevan.
05/04/2020 - PHE dashboard/UK gov shows 218 deaths for Scotland; Scottish government website shows 220 deaths
05/04/2020 - From Scottish government website "Please note: as highlighted by the First Minister today, these figures are not fully representative of developments this weekend as we continue to move to a new process for reporting deaths." Using this new approach, "HPS old data collation approach: Tuesday 31 March - 60; Wednesday 1 April - 76; Thursday 2 April - 86; HPS new approach using NRS records linked to laboratory data: Tuesday 31 March - 69; Wednesday 1 April - 97; Thursday 2 April - 126" (https://www.gov.scot/news/new-process-for-reporting-covid-19-deaths/)
05/04/2020 - PHE dashboard/UK gov shows 56 deaths for NI; NI reports 63 deaths
06/04/2020 - PHE dashboard/UK gov shows 220 deaths for Scotland; Scottish government website shows 222 deaths but also states "Please note: as highlighted by the First Minister yesterday, these figures are not fully representative of developments over the weekend as we continue to move to a new process for reporting deaths."
06/04/2020 - PHE dashboard/UK gov shows 63 deaths for NI; NI reports 70 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2006.04.20.pdf)
07/04/2020 - Case and death counts in each country listed as NA when numbers reported have not been updated since the previous day: From PHE dashboard: "DHSC figures for Scotland, Wales and NI not yet received: England case count is as of 09:00 07/04/2020, Scotland case count is as of 09:00 06/04/2020, Wales case count is as of 07:00 06/04/2020, Northern Ireland case count is as of 09:41 06/04/2020, UK death count is as of 17:00 06/04/2020. England, Wales and Northern Ireland death counts are as of 17:00 05/04/2020 and Scotland death count is as of 09:00 05/04/2020."
07/04/2020 - Scotland reports 4229 positive tests and 296 deaths
07/04/2020 - Wales reports 3790 total cases and 212 deaths
07/04/2020 - NI reports 1255 total cases and 73 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2007.04.20.pdf)
08/04/2020 - DHSC tweet (https://twitter.com/DHSCgovuk/status/1247914958568009728) states 5492 new cases but deduction of total cases on 07/04 from total cases on 08/04 gives 5491 and this was stated in the historic dashboard data xlxs released later the same day
08/04/2020 - Scotland reports 366 deaths; PHE dashboard/UK gov shows 296 deaths for Scotland
08/04/2020 - Scotland provides new webpage showing much more detail for cases in Scotland (https://www.gov.scot/publications/coronavirus-covid-19-tests-and-cases-in-scotland/) Here, cases in Shetland and Eileanan Siar (Western Isles), are shown with a * to have <5 cases. In my collated data this is "NA" to maintain machine-readable format.
08/04/2020 - PHE dashboard/UK gov shows 70 deaths for NI; NI reports 78 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2008.04.20.pdf)
08/04/2020 - Wales: "For operational reasons, we are moving the point at which we count new cases of Novel Coronavirus (Covid-19) back from 7pm to 1pm. Case numbers on Thursday will therefore be lower than usual, and will return to normal on Friday."
09/04/2020 - PHE dashboard: "England and Scotland case counts are as of 09:00 09/04/2020, Wales case count is as of 07:00 09/04/2020, Northern Ireland case count is as of 11:15 09/04/2020. Death counts are as of 17:00 08/04/2020, except Scotland which is as of 09:00 08/04/2020."
09/04/2020 - DHSC tweet: "The "tests" figures exclude data from Northern Ireland."
09/04/2020 - Scotland reports 447 deaths; PHE dashboard/UK gov shows 366 deaths for Scotland
09/04/2020 - PHE dashboard/UK gov shows 78 deaths for NI; NI reports 82 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Buleltin%2009.04.20.pdf)
09/04/2020 - From Public Health Wales tweet (https://twitter.com/PublicHealthW/status/1248234293069000705): "Due to a change in our reporting process, today we are reporting a lower than usual number of new cases of Novel Coronavirus (COVID-19) in Wales. 16 new cases have tested positive for Novel Coronavirus (COVID-19) in Wales. We've moved the point at which we count new cases of Novel Coronavirus (COVID-19) back a few hours, so the number of new cases is from a shorter period today. Apologies for any confusion this has caused."
10/04/2020 - Tweets from DHSC (https://twitter.com/DHSCgovuk/status/1248659493610758144) and https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public mention that positive tests now include HCWs and their households but also states number of positive cases through pillar 1 testing. COVID19_by_day.csv will continue to include positive cases arising from pillar 1 testing only and I'll make a new file for further testing/case strategies. There's some things that don't make sense to me and I'll look into them tomorrow.
10/04/2020 - DHSC tweet: "The "tests" figures exclude data from Northern Ireland."
10/04/2020 - Scotland reports 495 deaths; PHE dashboard/UK gov shows 447 deaths for Scotland
10/04/2020 - PHE dashboard/UK gov shows 82 deaths for NI; NI reports 92 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2010.04.20.pdf)
10/04/2020 - PHE dashboard: "England and Scotland case counts are as of 09:00 10/04/2020, Wales case count is as of 07:00 10/04/2020, Northern Ireland case count is as of 12:02 10/04/2020. England and Wales death counts are as of 17:00 09/04/2020, Scotland death count is as of 09:00 09/04/2020, Northern Ireland death count is as of 09:15 09/04/2020."
11/04/2020 - From https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public#history: "The difference between the cumulative numbers from today and yesterday for positive cases is 1 lower than the daily increase figure. This is due to Wales double counting a case from the previous day." so I adjusted new cases on 10/04/2020 from 18668 to 18667 and cumulative cases from 316837 to 316836 on the COVID19_by_day.csv file.
11/04/2020 - From https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public#history: "The difference between the cumulative numbers from today and yesterday for number of cases is 47 lower than the daily increase figures. This is due to PHE correcting some errors in their historical data." Looking at the numbers, I'm a bit confused. The difference between cumulative TESTS reported on 10/04 and 11/04 is 18138 whilst a daily increase of 18091 was reported (47 difference, but the difference between the cumulative figures is 47 HIGHER, not lower?). I can't see any issue between the number of new cases reported today and the differences between cumulative figures? To maintain the "rules" I have set out in my readme for what is in this file, I will CumTests will be as reported and NewTests will be the calculated difference as stated. II'll think about a better way of displaying this data going forward.
11/04/2020 - DHSC tweet: "The "tests" figures exclude data from Northern Ireland."
11/04/2020 - Scotland reports 542 deaths; PHE dashboard/UK gov shows 495 deaths for Scotland
11/04/2020 - PHE dashboard/UK gov shows 92 deaths for NI; NI reports 107 deaths (https://www.publichealth.hscni.net/sites/default/files/2020-04/COVID-19%20Surveillance%20Bulletin%2011.04.20.pdf)
11/04/2020 - From PHE dashboard "England and Scotland case counts are as of 09:00 10/04/2020, Wales case count is as of 07:00 10/04/2020, Northern Ireland case count is as of 12:02 10/04/2020. England and Wales death counts are as of 17:00 09/04/2020, Scotland death count is as of 09:00 09/04/2020, Northern Ireland death count is as of 09:15 09/04/2020."
THE ONE DAY LAG FOR DEATHS IN SCOTLAND AND NI SEEMS TO CONTINUE. TESTS ALSO DOES NOT INCLUDE THOSE CONDUCTED IN NI
14/04/2020 - From PHE dashboard: "Case counts for England are provided by Public Health England. Death counts and data for Devolved Administrations are provided by the Department of Health and Social Care. Maps include Ordnance Survey data © Crown copyright and database right 2020 and Office for National Statistics data © Crown copyright and database right 2020. England and Scotland case counts are as of 09:00 14/04/2020, Wales case count is as of 07:00 14/04/2020, Northern Ireland case count is as of 09:30 14/04/2020. Death counts are as of 13/04/2020 (see About the data for times). UK total includes cases detected through "Pillar 2" testing (tests carried out by commercial partners) and therefore does not equate to the sum of the four countries' counts, which only include "Pillar 1" (tests carried out by NHS/PHE/devolved administration labs). Time series data will be available to download from 15/04/2020."
14/04/2020 - https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public: "The difference between the cumulative numbers from today and from yesterday for number of cases is 1 off the daily increase figures. This is due to PHE correcting some errors in their historical data."
15/04/2020 - DHSC tweet: "The difference between the cumulative numbers for today and yesterday for "number of tests" is 272 off the daily increase figures due to PHE correcting some errors in their historical data." As a consequence, I have modified the cumulative number of cases on 14/04 from 382650 to 382922 to account for this variation as much as possible.
15/04/2020 - https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public reports 87536 positive pillar 1 tests yesterday and 91325 today. The difference between these is 3789 but a daily increase of 3971 is reported. I have used the reported values for COVID_by_day.csv.
15/04/2020 - "The difference between the cumulative numbers from today and yesterday for “number of positive cases” is 2 off the daily increase figures, this is due to Wales removing duplicates from their historic data." This seems to be about total cases reported and pillar 1 cases reported. Cumulative pillar 1 cases reduced by 2 for 14/04.
16/04/2020 - https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public: "The difference between the cumulative numbers from today and yesterday for “number of tests” is 68 off the daily increase figures, this is due to PHE correcting some errors in their historical data.
The difference between the cumulative numbers from today and yesterday for “number of positive cases” is 1 off the daily increase figures, this is due to Wales removing duplicates from their historic data." 1) seems to be about the total number of tests conducted, not people tested so cumulative total for 15/04 has been decreased by 68 as the best I can do to improve the data. 2) Is about totoal number of cases and doesn't seem to impact pillar 1 cases.
17/04/2020 - DHSC tweet: "The difference between the cumulative numbers for today and yesterday for "number of tests" is 14 off the daily increase figures due to PHE correcting some historical data." This seems to be about the total number of tests conducted, not people tested so cumulative total for 16/04 has been decreased by 14 as the best I can do to improve the data.
18/04/2020 - DHSC tweet: "The difference between the cumulative numbers for today and yesterday for "number of tests" is 57 off the daily increase figures due to PHE correcting some historical data and Wales removing a duplicate from their historical data." This seems to be about the total number of tests conducted, not people tested so cumulative total for 16/04 has been increased by 57 as the best I can do to improve the data.
18/04/2020 - https://www.gov.uk/guidance/coronavirus-covid-19-information-for-the-public: "The difference between the cumulative numbers from today and yesterday for “number of positive cases” is 1 off the daily increase figures. This is due to Wales removing a duplicate from their historic data." This is for total number of cases and pillar 1 cases, cases on 17/04 reduced by 1 as the only way to improve the data with the info available