Separate Realities

Being trained as a scientist, I have always believed that there is such a thing as truth and a single reality. But people in the USA seem to be living in completely different realities, as a recent poll shows. It asked Americans if they found the current number of deaths from COVID-19 in the US acceptable. The results vary dramatically by political orientation:

The majority of Republicans (57%) think that the current number of deaths is acceptably, but only 1 out of 10 Democrats thinks this way.

A key to understanding these differences is that "About two-thirds of Republicans (64%) think the number of US fatalities from coronavirus is actually lower than what is being reported".  In sharp contrast, only 12% of Democrats think that the number of COVID-19 deaths is lower. But in both parties, the percentage of people who believe that COVID-19 deaths are overstated closely mimics the percentage of people who deem the current fatalities acceptable. This raises the question:

Are the reported COVID-19 deaths numbers accurate, too low, or too high?

This is a reasonable question. There is no doubt that not all COVID-19 deaths are reported accurately.  If someone dies of COVID-19 without ever being in a hospital and without a positive COVID-19 test, the death will often not be reported as a COVID-19 death, leading to under-reporting. But at other times, COVID-19 may be listed on the death certificate even if the death clearly was not caused by COVID-19, causing over-reporting of death. Many people who believe that actual deaths are lower than reported numbers will have stories of someone without COVID-19 symptoms who died in a motorcycle accident or similar. Some believe that hospitals cheat by listing COVID-19 as the cause of death so they get higher reimbursements.

There is no doubt that both under- and over-reporting of COVID-19 deaths happens. Theoretically, both could happen at a similar rate so over- and under-reporting cancel each other out, but this seems unlikely. So how can we get an idea how many more deaths are really caused by the coronavirus epidemic in the US?

The most straightforward way is to compare the number of people who died since the start of the epidemic to the number of people who died during the same time period in previous years. If COVID-19 has caused a large number of additional death, that should show up in the number of reported death. This approach, named "excess death analysis" is standard when trying to estimate the impact of epidemics; for example, it is generally used to estimate how many people die of influenza. 

Before we get started, let's have a quick look at the number of COVID-19 deaths reported in the US as of today (August 27, 2020, 8:15 pm):

•  The CDC web site reports 178,998 COVID-19 deaths.
• Worldometer.info reports 184,764 COVID-19 deaths.
• Johns Hopkins University reports 180,527  COVID-19 deaths.

Exact numbers differ a bit depending on when and how data are collected, but we can say the reported number is close to 180,000.

Next, we can look at the data from the National Center for Health Statistics, were all states send reports of deaths to. The web page provides a download link for "National and State Estimates of Excess Deaths", so you can download a file in .csv format that you can import into Excel or OpenOffice.

The file contains state-by-state data for weekly reported and expected deaths since 2017, and totals for the entire US. There are three data sets in the table, and we'll look at each in turn.

The first data set we'll examine is the "unweighted, all causes" set. These are the numbers for the death reports that the CDC had received by the time the file was generated. For recent weeks, these numbers will be incomplete, since not all states and counties have reported their numbers yet; typically, it takes about 8 weeks until about 99% of the death certificates have been submitted. Therefore, this data set will give an underestimate of the number of excess deaths.

The latest data included are for the week that ended 8/15/2020. The "unweighted" (incomplete) data set reports an excess of 203,840 deaths for 2020. This number is significantly higher than the number of reported COVID-19 deaths. This is a clear indication that the reported COVID-19 deaths understate the actual number of deaths cause by the epidemic.

Since many recent death certificates are missing from the "unweighted" data set, we need to look at the other data sets. The next one we can look at is the "weighted, all causes" data set. For this set, the CDC has estimated how complete the submission of deaths certificates was for each week and jurisdiction, and adjusted the totals to account for missing reports. The "weighted" (predicted) data set reports an excess of 245,305 deaths for 2020. 

The third data set in the file ("weighted, all causes excluding COVID-10") calculates excess deaths after subtracting reported COVID-19 deaths. This gives the number of excess deaths that are not classified as COVID-19 on the death certificate. This results in 82,049 excess deaths, in addition to 163,256 COVID-19 deaths. In other words, for every 2 reported COVID-19 deaths, there is another additional death that does not list COVID-19 as the cause of death. 

One way of interpreting these results is that only about two thirds of COVID-19 linked deaths are reported. In other words, the actual death toll from the corona virus epidemic in the US is about 50% higher than reported in the official death counts.

There are a few different ways to calculate these numbers, but they all end up with pretty similar results: actual excess deaths are about 40-50% higher than reported deaths.

The final exercise is to provide a "best estimate" of the death toll as of today. The CDC spreadsheet only contains data until 8/15/2020; since then, and additional 10,536 deaths have been reported. Using the under-reporting factor of 50.3% described above means we expect more than 5,000 additional excess deaths, for a total of 261,136 excess deaths in the US linked to the COVID-19 epidemic.

The analysis is based on data submitted by the states to the CDC, a government organization that has been under the control of the current administration for the last 3 1/2 years. The data are publicly available, and anyone can download them and do their own analysis. But even the incomplete "unweighed" data, which does not include many deaths from the most recent weeks, clearly show:

Actual deaths linked to COVID-19 are significantly higher than reported numbers