SHMU Environment Observation Data

SHMU made available for DanubeHack 3.0 some environment observation data at:

http://meteo.shmu.sk/customer/home/opendata/

We can say it is a REST API with CSV payload. Thus this scraper is not "the usual one" (thanks to REST and CSV, its job would be much easier compared to other scrapers):

1. crawl all data
2. (optionally) keep local copy of CSV snapshots
3. compile all snapshots into one SQLite database

Data

• source: http://meteo.shmu.sk/customer/home/opendata/
• data license: CC-BY
• reference: https://data.gov.sk/dataset/atmosfericke-podmienky-a-meteorologicke-geograficke-prvky

Status

works

How to run

python3 -m venv .venv

source .venv/bin/activate

pip install -U pip # optional step

pip install -r requirements.txt

python scraper.py

License

Scraper is licensed under BSD license, see full text of license.

Scraper is on Morph

This is a scraper that runs on Morph. To get started see the documentation

TODO

• ...