Demo version (#1)

* Add stellite loading and test

* add basic NWP loading

* add GSP loading

* add minimum selection functions

* add minimum numpybatch conversion functions

* add reduced PVNet dataset

* add reqs

* linting and docs

* update project cov dir

* rename package

* minor tweaks

* docs

* contiguous tests

* add test for dataset.pvnet

* add test select time

* refactor coe

* fix

* stash spatial slice tests

* remove data file, and use temp files instead

* remove zarr path

* update test PR comment

* make coords always in order x, y and always increasing

* note TODO

* add spatial slice fixes and tests

* fix param name

* clean up time selection tests

* add more extensive time slicing tests

* type hints

* add test and fix for fill time periods

* add dropout tests

* refactor t0_idx and minor fix

* add numpybatch convert NWP test

* add numpybatch convert GSP test

* add numpybatch convert satellite test

* import change and test data reduction

* linting and better t0 time filtering

* tidy up pvnet dataset and test

* add sun position tests

* update and clean

* change to pandas timestamp and timedelta

* fix test

* fix channel selection and update tests to catch this

* remove redundant assignment

* only account for dropout in find_contiguous_t0_periods_nwp after first dt_init

* account for history when beginning new period in find_contiguous_t0_period_nwp

* update test_find_contiguous_t0_periods_nwp

* renaming, cleaning and linting

* move national GSP filter

* slight tidy

* clean up config check

* nit-picking

* Revert "nit-picking"

This reverts commit 709178a.

* add comments to pvnet tests

* add test comments

---------

Co-authored-by: peterdudfield <[email protected]>
Co-authored-by: Peter Dudfield <[email protected]>
Co-authored-by: Alexandra Udaltsova <[email protected]>
Co-authored-by: AUdaltsova <[email protected]>

.github/workflows/workflows.yaml

@@ -11,8 +11,8 @@ jobs:
       # 0 means don't use pytest-xdist
       pytest_numcpus: "4"
       # pytest-cov looks at this folder
-      pytest_cov_dir: "src"
+      pytest_cov_dir: "ocf_data_sampler"
       # extra things to install
-      sudo_apt_install: "libgeos++-dev libproj-dev proj-data proj-bin"
+      #sudo_apt_install: "libgeos++-dev libproj-dev proj-data proj-bin"
       #      brew_install: "proj geos librttopo"
       os_list: '["ubuntu-latest"]'

README.md

@@ -1,13 +1,2 @@
-# OCF Template Repository
-Template Repository for OCF Projects
-
-## Usage
-
-Do the following to customize the repo to the project:
-
-- Replace `src` with name of the library/project
-- Update `setup.py` with the proper info
-- Change `commit` to `True` in `.bumpversion.cfg` if you want the minor version
-  to increment on every commit.
-- Add PyPi access token to release to PyPi
-- Update name of folder in the test workflow
+# OCF Data Sampler
+A repo for sampling from weather data for renewable energy prediction