Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demo version #1

Merged
merged 65 commits into from
Aug 13, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
97bd8b3
Add stellite loading and test
dfulu Jul 30, 2024
4d0b450
add basic NWP loading
dfulu Jul 30, 2024
a0f05a1
add GSP loading
dfulu Jul 30, 2024
d8852b3
add minimum selection functions
dfulu Aug 1, 2024
ba3fb97
add minimum numpybatch conversion functions
dfulu Aug 1, 2024
5629418
add reduced PVNet dataset
dfulu Aug 1, 2024
281bc7e
add reqs
dfulu Aug 1, 2024
64d8ae0
linting and docs
dfulu Aug 1, 2024
d4cd844
update project cov dir
peterdudfield Aug 2, 2024
626ebbb
Merge pull request #2 from openclimatefix/ci-fix
peterdudfield Aug 2, 2024
6433b49
rename package
peterdudfield Aug 2, 2024
e681508
minor tweaks
dfulu Aug 2, 2024
1b3f877
Merge commit 'e681508bdac866d011c5953842cc218146b8e865' into rename-p…
peterdudfield Aug 2, 2024
29e1ec3
Merge pull request #3 from openclimatefix/rename-package
peterdudfield Aug 2, 2024
9595d25
docs
dfulu Aug 2, 2024
d0f4771
contiguous tests
dfulu Aug 2, 2024
f864e37
add test for dataset.pvnet
peterdudfield Aug 2, 2024
da09475
add test select time
peterdudfield Aug 2, 2024
0f59e54
refactor coe
peterdudfield Aug 2, 2024
6385b2c
fix
peterdudfield Aug 2, 2024
23cea7f
stash spatial slice tests
dfulu Aug 2, 2024
14dc676
remove data file, and use temp files instead
peterdudfield Aug 2, 2024
6276ba3
Merge branch 'development' into pvnet_test
peterdudfield Aug 2, 2024
109ebe5
remove zarr path
peterdudfield Aug 2, 2024
804aeb0
Merge pull request #4 from openclimatefix/pvnet_test
peterdudfield Aug 2, 2024
d7d3659
Merge commit '804aeb02c7ef454332384b6ff4b8489fab130da6' into select_t…
peterdudfield Aug 2, 2024
52ffb47
update test PR comment
peterdudfield Aug 2, 2024
387c8d0
make coords always in order x, y and always increasing
dfulu Aug 6, 2024
092147d
note TODO
dfulu Aug 6, 2024
fcfd9b6
add spatial slice fixes and tests
dfulu Aug 6, 2024
ce0bd32
Merge branch 'development' into spatial_slice_tests
dfulu Aug 6, 2024
c292728
Merge pull request #9 from openclimatefix/spatial_slice_tests
dfulu Aug 6, 2024
7ee100d
fix param name
dfulu Aug 6, 2024
155bad3
clean up time selection tests
dfulu Aug 6, 2024
b322b20
add more extensive time slicing tests
dfulu Aug 7, 2024
abea626
type hints
dfulu Aug 7, 2024
981384f
Merge pull request #5 from openclimatefix/select_time_test
dfulu Aug 7, 2024
e9719d9
add test and fix for fill time periods
dfulu Aug 7, 2024
2c31c34
add dropout tests
dfulu Aug 7, 2024
e37d924
refactor t0_idx and minor fix
dfulu Aug 7, 2024
a511da1
add numpybatch convert NWP test
dfulu Aug 7, 2024
5a439e0
add numpybatch convert GSP test
dfulu Aug 7, 2024
6706142
add numpybatch convert satellite test
dfulu Aug 7, 2024
cd72890
import change and test data reduction
dfulu Aug 7, 2024
38a38ca
linting and better t0 time filtering
dfulu Aug 7, 2024
15057b4
tidy up pvnet dataset and test
dfulu Aug 7, 2024
d164a9b
add sun position tests
dfulu Aug 8, 2024
0fc805a
update and clean
dfulu Aug 8, 2024
b420cb8
change to pandas timestamp and timedelta
dfulu Aug 8, 2024
b781e37
fix test
dfulu Aug 8, 2024
b3aa1ab
fix channel selection and update tests to catch this
dfulu Aug 12, 2024
afd83fc
remove redundant assignment
dfulu Aug 12, 2024
f84c9c0
only account for dropout in find_contiguous_t0_periods_nwp after firs…
AUdaltsova Aug 12, 2024
e5cb0ab
account for history when beginning new period in find_contiguous_t0_p…
AUdaltsova Aug 12, 2024
1225963
update test_find_contiguous_t0_periods_nwp
AUdaltsova Aug 13, 2024
fa0cc63
renaming, cleaning and linting
dfulu Aug 13, 2024
ae3a57a
Merge branch 'development' of https://github.com/openclimatefix/ocf_d…
dfulu Aug 13, 2024
7d46f3f
move national GSP filter
dfulu Aug 13, 2024
ca16f99
slight tidy
dfulu Aug 13, 2024
f6f9220
clean up config check
dfulu Aug 13, 2024
709178a
nit-picking
dfulu Aug 13, 2024
b15a656
Revert "nit-picking"
dfulu Aug 13, 2024
3ed14c0
add comments to pvnet tests
peterdudfield Aug 13, 2024
0b6f06e
Merge commit 'b15a6562d16c90777c6486fbf59fd6c1a70708e1' into development
peterdudfield Aug 13, 2024
3186681
add test comments
peterdudfield Aug 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/workflows.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,8 +11,8 @@ jobs:
# 0 means don't use pytest-xdist
pytest_numcpus: "4"
# pytest-cov looks at this folder
pytest_cov_dir: "src"
pytest_cov_dir: "ocf_data_sampler"
# extra things to install
sudo_apt_install: "libgeos++-dev libproj-dev proj-data proj-bin"
#sudo_apt_install: "libgeos++-dev libproj-dev proj-data proj-bin"
# brew_install: "proj geos librttopo"
os_list: '["ubuntu-latest"]'
15 changes: 2 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,2 @@
# OCF Template Repository
Template Repository for OCF Projects

## Usage

Do the following to customize the repo to the project:

- Replace `src` with name of the library/project
- Update `setup.py` with the proper info
- Change `commit` to `True` in `.bumpversion.cfg` if you want the minor version
to increment on every commit.
- Add PyPi access token to release to PyPi
- Update name of folder in the test workflow
# OCF Data Sampler
A repo for sampling from weather data for renewable energy prediction
319 changes: 319 additions & 0 deletions ocf_data_sampler/data/uk_gsp_locations.csv

Large diffs are not rendered by default.

Loading
Loading