florida-covid19-deaths-by-day

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

florida-covid19-deaths-by-day

★ 10 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

The Florida Department of Health (FDOH) provides COVID-19 *deaths by day* data
in the [`Florida_COVID_19_Deaths_by_Day`][tbl] table. Unlike the state's
[COVID-19 dashboard][dash], which reports deaths by *date of report*, *deaths
by day* represent the number of deaths by exact date of death, based on death
certificate information.

*Deaths by day* is more useful than deaths by date reported, however the former
is very incomplete due to inherent bureaucratic delays in processing deaths
certificates. For example the last 10 days always show a "permanent dip," which
is very often misinterpreted as decreasing deaths.

This repository provides daily archives of *deaths by day* data, and scripts to
analyze the completeness and reporting delays of this data.

## Bar chart of deaths by day

![Bar chart of deaths by day](https://raw.githubusercontent.com/mbevand/florida-covid19-deaths-by-day/master/chart_bars.png)

This shows deaths by day, created by the script
[chart_bars](chart_bars). The colors emphasize the significant delays in
death reporting. Each day the state reports more deaths, a new "layer" of colors
is added to the bars, with most deaths having occurred in recent days, and some
deaths having occurred weeks earlier.

The dashed line represent the moving average of deaths by day, while the solid
line is deaths by day adjusted for reporting delays. The adjustment is performed
in two steps:

1. The average reporting delay is calculated by fitting an exponential distribution,
  see [Average reporting delay](#average-reporting-delay); this gives us a CDF
  (cumulative distribution function)
1. Deaths by day are multiplied by the inverse of the CDF. For example if at 4 days
  after the date of death the CDF is 0.5 (meaning we expect 50% of deaths to be
  reported,) we multiply deaths by 1 / 0.5 = 2

## "Rainbow" chart

![Rainbow chart](https://raw.githubusercontent.com/mbevand/florida-covid19-deaths-by-day/master/chart_rainbow.png)

Each curve on the above chart, created by the script [chart_rainbow](chart_rainbow),
shows the number of deaths that occurred on a given day. As time goes by, more death
certificates are processed and more deaths are assigned to the correct calendar
day, so the curve goes up. The initial steepness of the curve gives an intuitive sense
of how many deaths will be approximately reported, despite the data being incomplete.
The leftmost curves are expected to establish new record-high numbers of deaths.

## Average reporting delay

![Average reporting delay](https://raw.githubusercontent.com/mbevand/florida-covid19-deaths-by-day/master/chart_average_reporting_delay.png)

This chart, created by the script [chart_average_reporting_delay](chart_average_reporting_delay),
shows the average reporting delay, and fits an exponential distribution. We see that, on average:

* 50% of deaths are reported within 5 days
* 85% of deaths are reported within 13 days
* 95% of deaths are reported within 21 days

The exponential distribution CDF gives the proportion of deaths that are expected to have been
reported within *x* days:

*1 - e<sup>-λx</sup>*

## Deaths occurred vs deaths reported

![Deaths occurred vs deaths reported](https://raw.githubusercontent.com/mbevand/florida-covid19-deaths-by-day/master/chart_deaths_occurred_vs_reported.png)

This chart, created by the script [chart_deaths_occurred_vs_reported](chart_deaths_occurred_vs_reported),
shows the reporting lag. **Deaths by date of death are always higher than deaths by date
of report in periods of increasing deaths** (because of the lag.)

## Fetching "deaths by day"

The CSV files in this repository are daily archives of the
[`Florida_COVID_19_Deaths_by_Day`][tbl] table. FDOH appears to update the table
once a day around 10am-11am Eastern time.

The [download](download) Python script automatically downloads the table, converts it from
JSON to CSV format, and saves it as `deathsbydateexport_YYYYMMDD.csv`. The columns are:

* `Date`: milliseconds since UNIX Epoch time
* `Deaths`: number of deaths on this date
* `ObjectId`: unknown—not important

If for whatever reason you want to download the table without using the script:

1. Browse [`Florida_COVID_19_Deaths_by_Day`][tbl]
1. Click on [View](https://services1.arcgis.com/CY1LXxl9zlJeBuRZ/arcgis/rest/services/Florida_COVID_19_Deaths_by_Day/FeatureServer)
1. Click on table [Florida_COVID_19_Deaths_by_Day](https://services1.arcgis.com/CY1LXxl9zlJeBuRZ/ArcGIS/rest/services/Florida_COVID_19_Deaths_by_Day/FeatureServer/0)
1. Click on [Query](https://services1.arcgis.com/CY1LXxl9zlJeBuRZ/ArcGIS/rest/services/Florida_COVID_19_Deaths_by_Day/FeatureServer/0/query)
1. Type:
   ```
   Where: ObjectId>0
   Result type: standard
   Out Fields: *
   Format: JSON
   ```
1. Click [Query (GET)](https://services1.arcgis.com/CY1LXxl9zlJeBuRZ/ArcGIS/rest/services/Florida_COVID_19_Deaths_by_Day/FeatureServer/0/query?where=ObjectId%3E0&objectIds=&time=&resultType=none&outFields=*&returnIdsOnly=false&returnUniqueIdsOnly=false&returnCountOnly=false&returnDistinctValues=false&cacheHint=false&orderByFields=&groupByFieldsForStatistics=&outStatistics=&having=&resultOffset=&resultRecordCount=&sqlFormat=none&f=pjson&token=)
1. The above URL returns the data in JSON format

## Community effort to archive FDOH data

I would like to encourage you to visit [FLDoH Data Sharing Links](https://docs.google.com/document/d/1BhXjwkwZTbuLhoNidd7FVvrynuzR_EZdV_TXe9zBRj0/edit), a community effort archiving other datasets from FDOH.

[tbl]: https://fdoh.maps.arcgis.com/home/item.html?id=230270972343459a812a1ae8c28574a6
[dash]: https://experience.arcgis.com/experience/96dd742462124fa0b38ddedb9b25e429

florida-covid19-deaths-by-day

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README