Skip to content
/ covid-19-data Public

Mirror of internal repo for code that does data ingestion and munging for the City of Cape Town's Covid-19 dashboard

0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

cityofcapetown/covid-19-data

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

385 Commits
bin
bin
 
 
dags
dags
 
 
resources
resources
 
 
tests
tests
 
 
.gitignore
.gitignore
 
 
Jenkinsfile
Jenkinsfile
 
 
README.md
README.md
 
 
billing_finance_data_munge.R
billing_finance_data_munge.R
 
 
billing_finance_data_to_minio.py
billing_finance_data_to_minio.py
 
 
checkit_c3_lookup_to_ckan.py
checkit_c3_lookup_to_ckan.py
 
 
checkit_ckan_to_sharepoint.py
checkit_ckan_to_sharepoint.py
 
 
checkit_sharepoint_to_ckan.py
checkit_sharepoint_to_ckan.py
 
 
ckan_utils.py
ckan_utils.py
 
 
cod_data_munge.py
cod_data_munge.py
 
 
cod_to_minio.py
cod_to_minio.py
 
 
covid19_announcements_data_to_minio.py
covid19_announcements_data_to_minio.py
 
 
exchange_utils.py
exchange_utils.py
 
 
finance_payment_data_munge.py
finance_payment_data_munge.py
 
 
finance_payment_data_to_minio.py
finance_payment_data_to_minio.py
 
 
health_data_to_ckan.py
health_data_to_ckan.py
 
 
hr_data_munge.py
hr_data_munge.py
 
 
hr_data_org_unit_munge.py
hr_data_org_unit_munge.py
 
 
hr_data_to_minio.py
hr_data_to_minio.py
 
 
hr_master_data_munge.py
hr_master_data_munge.py
 
 
hr_master_data_to_minio.py
hr_master_data_to_minio.py
 
 
hr_sap_data_munge.py
hr_sap_data_munge.py
 
 
hr_sap_data_to_minio.py
hr_sap_data_to_minio.py
 
 
income_finance_data_munge.py
income_finance_data_munge.py
 
 
income_finance_data_to_minio.py
income_finance_data_to_minio.py
 
 
media_data_to_minio.py
media_data_to_minio.py
 
 
mobile_data_date_munge.py
mobile_data_date_munge.py
 
 
ohs_data_to_minio.py
ohs_data_to_minio.py
 
 
once_off_conversions.R
once_off_conversions.R
 
 
private_data_to_minio.R
private_data_to_minio.R
 
 
prov_health_data_to_minio.py
prov_health_data_to_minio.py
 
 
public_data_to_minio.R
public_data_to_minio.R
 
 
sd_media_data_munge.py
sd_media_data_munge.py
 
 
sd_media_data_to_minio.py
sd_media_data_to_minio.py
 
 
service_delivery_area_metrics_munge.py
service_delivery_area_metrics_munge.py
 
 
service_delivery_fact_spatial_munge.py
service_delivery_fact_spatial_munge.py
 
 
service_delivery_fact_spatial_to_minio.py
service_delivery_fact_spatial_to_minio.py
 
 
service_delivery_fact_ts_to_minio.py
service_delivery_fact_ts_to_minio.py
 
 
service_delivery_metrics_hex_munge.py
service_delivery_metrics_hex_munge.py
 
 
service_delivery_metrics_munge.py
service_delivery_metrics_munge.py
 
 
sharepoint_utils.py
sharepoint_utils.py
 
 
socioeconomic_data_munge.py
socioeconomic_data_munge.py
 
 
socioeconomic_sharepoint_to_minio.py
socioeconomic_sharepoint_to_minio.py
 
 
spv-collected-linelist-to-minio.py
spv-collected-linelist-to-minio.py
 
 
spv-get-subplace-metrics.py
spv-get-subplace-metrics.py
 
 
spv-lag-adjustment-to-minio.py
spv-lag-adjustment-to-minio.py
 
 
spv-reporting-lags-to-minio.py
spv-reporting-lags-to-minio.py
 
 
spv-subplace-metrics-to-ckan.py
spv-subplace-metrics-to-ckan.py
 
 
spv_age_distribution_munge.py
spv_age_distribution_munge.py
 
 
spv_doubling_time_munge.py
spv_doubling_time_munge.py
 
 
spv_metro_subdistricts_munge.py
spv_metro_subdistricts_munge.py
 
 
vaccine_annotate_HR_munge.py
vaccine_annotate_HR_munge.py
 
 
vaccine_annotate_non_HR_munge.py
vaccine_annotate_non_HR_munge.py
 
 
vaccine_data_to_minio.py
vaccine_data_to_minio.py
 
 
vaccine_register_munge.py
vaccine_register_munge.py
 
 
vaccine_register_willing_munge.py
vaccine_register_willing_munge.py
 
 
vaccine_rollout_time_series.py
vaccine_rollout_time_series.py
 
 
vaccine_rollout_willing_time_series.py
vaccine_rollout_willing_time_series.py
 
 
vaccine_sequencing_aggregation.py
vaccine_sequencing_aggregation.py
 
 
vaccine_sequencing_munge.py
vaccine_sequencing_munge.py
 
 
vaccine_staff_data_to_wcgh.py
vaccine_staff_data_to_wcgh.py
 
 
vodacom_data_munge.py
vodacom_data_munge.py
 
 

Repository files navigation

covid-19-data

Listing:

  • public_data_to_minio.R - pulls data from various public datasets, pushes into minio
  • income_finance_data_to_minio.py - pulls "TOTAL ISU" data file from OPM Data email account, pushes into minio
  • income_finance_data_munge.py - pulls "TOTAL_ISU" data file from minio, cleans up, and puts back in as "income_totals.csv"
  • media_data_to_mino.py - pulls all media data from Brandseye API, and puts it into Minio as "media_complete.csv". Since it's trivial, also does a filter, and produces "media_filtered.csv".

About

Mirror of internal repo for code that does data ingestion and munging for the City of Cape Town's Covid-19 dashboard

Resources

Readme
Activity
Custom properties

Stars

0 stars

Watchers

8 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages