Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wire up Zarr property tests EAR-1189 #68

Merged
merged 18 commits into from
Nov 15, 2024
Merged

Wire up Zarr property tests EAR-1189 #68

merged 18 commits into from
Nov 15, 2024

Conversation

dcherian
Copy link
Contributor

@dcherian dcherian commented Sep 17, 2024

@dcherian dcherian changed the title Wire up Zarr property tests Wire up Zarr property tests EAR-1189 Sep 17, 2024
Copy link

linear bot commented Sep 17, 2024

@dcherian dcherian changed the title Wire up Zarr property tests EAR-1189 Wire up Zarr property tests EAR-1189 EAR-1296 Sep 17, 2024
Copy link

linear bot commented Sep 17, 2024

EAR-1296 setting metadata can fail

import icechunk
from zarr.core.buffer.cpu import Buffer

props = b'{\n  "shape": [\n    1\n  ],\n  "fill_value": false,\n  "chunk_grid": {\n    "name": "regular",\n    "configuration": {\n      "chunk_shape": [\n        1\n      ]\n    }\n  },\n  "attributes": {},\n  "zarr_format": 3,\n  "data_type": "bool",\n  "chunk_key_encoding": {\n    "name": "default",\n    "configuration": {\n      "separator": "/"\n    }\n  },\n  "codecs": [\n    {\n      "name": "bytes",\n      "configuration": {\n        "endian": "little"\n      }\n    }\n  ],\n  "node_type": "array"\n}'

store = await icechunk.IcechunkStore.from_json(
    config={"storage": {"type": "in_memory"}, "dataset": {}}, mode="w"
)

await store.set("/0/zarr.json", Buffer.from_bytes(props))
ValueError: store error: invalid zarr key format `/0/zarr.json`

@dcherian dcherian changed the title Wire up Zarr property tests EAR-1189 EAR-1296 Wire up Zarr property tests EAR-1189 Sep 23, 2024
dcherian and others added 8 commits September 27, 2024 10:06
* main: (167 commits)
  Bump actions/checkout from 2 to 4 in the actions group (#305)
  update zarr pin to v3.0.0b1 (#302)
  Fix non-conformant "attributes" metadata (#303)
  Implement branch reset functionality (#301)
  README minor tune up: syntax and other very minor typos etc (#300)
  remove awaits in icechunk notebook (#298)
  Add missing permission to release action (#295)
  Minor changes to virtual docs (#293)
  Add changelogs (#291)
  Install cargo release (#290)
  Update python ci (#289)
  GHA workflow to release Rust (#288)
  Release 0.1.0-alpha.3 to the Rust world (#287)
  `ByteRange` can do last n bytes now (#285)
  Introduce `Store::list_dir_items` (#286)
  [Docs] Improve virtual ref docs (#284)
  [Docs] correct output dimensions in xr example (#283)
  [Docs] add note for requirements of tutorial data download (#282)
  [Docs] correct module calls to match imports (#281)
  fix(docs): Docs postlaunch fixes (#278)
  ...
@dcherian dcherian marked this pull request as ready for review November 15, 2024 20:06
@dcherian dcherian merged commit 3546db5 into main Nov 15, 2024
3 checks passed
@dcherian dcherian deleted the zarr-prop-tests branch November 15, 2024 22:05
import hypothesis.strategies as st
from hypothesis import assume, given, settings

from zarr.testing.strategies import arrays, numpy_arrays
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is awesome... we should embrace this for the other tests as well in the future

dcherian added a commit that referenced this pull request Nov 22, 2024
* main:
  Set store to read only after unpickling (#405)
  Update roadmap documentation (#398)
  Wire up Zarr property tests EAR-1189 (#68)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants