Skip to content

Releases: projectnessie/nessie

Nessie 0.101.3

18 Dec 18:07
@github-actions github-actions
nessie-0.101.3
427b2cc
Compare
Choose a tag to compare
Nessie 0.101.3 Latest
Latest

Try it

The attached nessie-quarkus-0.101.3-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.101.3/nessie-quarkus-0.101.3-runner.jar
java -jar nessie-quarkus-0.101.3-runner.jar

Nessie CLI is attached as nessie-cli-0.101.3.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.101.3.

Nessie GC tool is attached as nessie-gc-0.101.3.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.101.3 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.101.3-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.101.3 --help.

The attached nessie-helm-0.101.3.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Add the cut-history command to the Nessie server admin tool. This command allows advanced users to
    detach certain commits from their predecessors (direct and merge parents).

Full Changelog (minus renovate commits):

  • Add admin tool command to cut commit log at a certain point. (#10048)
  • Revert "Workaround for CI failures because of missing vectorized/redpanda images (#10074)" (#10087)
Assets 9
Loading

Nessie 0.101.2

12 Dec 04:34
@github-actions github-actions
nessie-0.101.2
007f057
Compare
Choose a tag to compare
Nessie 0.101.2

Try it

The attached nessie-quarkus-0.101.2-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.101.2/nessie-quarkus-0.101.2-runner.jar
java -jar nessie-quarkus-0.101.2-runner.jar

Nessie CLI is attached as nessie-cli-0.101.2.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.101.2.

Nessie GC tool is attached as nessie-gc-0.101.2.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.101.2 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.101.2-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.101.2 --help.

The attached nessie-helm-0.101.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Fix large index processing in the cleanup-repository admin command.

Full Changelog (minus renovate commits):

  • Fix clean-up of reference index objects (#10083)
  • Workaround for CI failures because of missing vectorized/redpanda images (#10074)
Assets 9
Loading

Nessie 0.101.1

09 Dec 16:17
@github-actions github-actions
nessie-0.101.1
5989919
Compare
Choose a tag to compare
Nessie 0.101.1

Try it

The attached nessie-quarkus-0.101.1-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.101.1/nessie-quarkus-0.101.1-runner.jar
java -jar nessie-quarkus-0.101.1-runner.jar

Nessie CLI is attached as nessie-cli-0.101.1.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.101.1.

Nessie GC tool is attached as nessie-gc-0.101.1.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.101.1 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.101.1-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.101.1 --help.

The attached nessie-helm-0.101.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Fixes

  • Fix handling of Iceberg update-requirement "no current snapshot"

Full Changelog (minus renovate commits):

  • Fix update-requirement check to handle "no current snapshot" requirement properly (#10064)
Assets 9
Loading

Nessie 0.101.0

06 Dec 08:42
@github-actions github-actions
nessie-0.101.0
5780712
Compare
Choose a tag to compare
Nessie 0.101.0

Try it

The attached nessie-quarkus-0.101.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.101.0/nessie-quarkus-0.101.0-runner.jar
java -jar nessie-quarkus-0.101.0-runner.jar

Nessie CLI is attached as nessie-cli-0.101.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.101.0.

Nessie GC tool is attached as nessie-gc-0.101.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.101.0 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.101.0-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.101.0 --help.

The attached nessie-helm-0.101.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Helm: Add clusterIP and traffic policy to helm service config
  • Add functionality to the Nessie server admin tool, the cleanup-repository command, to delete
    unneeded objects from a Nessie repository (backend database).

Full Changelog (minus renovate commits):

  • Server admin tool: add command to purge unreferenced Objs (#9753)
  • Persistence: purge unreferenced Objs (#9688)
  • Disable tests using containers on macOS in CI (#10038)
  • Docs: update environment variables table and add section on Kubernetes memory settings (#10035)
  • Ninja: changelog
  • Add clusterIP and traffic policy to helm service config (#10011)
  • Port some CatalogTests updates from Iceberg (#10036)
  • Propagate CDI scopes to health checks (#10026)
Assets 9
Loading

Nessie 0.100.3

02 Dec 13:31
@github-actions github-actions
nessie-0.100.3
bbdacbf
Compare
Choose a tag to compare
Nessie 0.100.3

Try it

The attached nessie-quarkus-0.100.3-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.100.3/nessie-quarkus-0.100.3-runner.jar
java -jar nessie-quarkus-0.100.3-runner.jar

Nessie CLI is attached as nessie-cli-0.100.3.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.100.3.

Nessie GC tool is attached as nessie-gc-0.100.3.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.100.3 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.100.3-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.100.3 --help.

The attached nessie-helm-0.100.3.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

New Features

  • Add deploymentStrategy to Helm deployment configs

Fixes

  • Allow multiple SetProperties updates via Iceberg REST.

Full Changelog (minus renovate commits):

  • Ninja: changelog
  • Add deployment strategy to helm deployment configs (#10012)
  • Catalog: Allow multiple SetProperties updates (#10024)
  • Build: Allow testing GC with Java 23 (#10023)
  • Renovate: Update config for trino-client (#10004)
  • Quarkus/Agoral: fix deprecation (#10000)
  • Migrate to org.apache.cassandra:java-driver-bom and bump to latest version 4.18.1 (#9992)
  • Support v2 iceberg views with gzip (#9982)
  • Snapshot publishing: no build scan (#9976)
  • Nit: Remove antlr-removal left-over (#9977)
  • Spark integrations: enhance tests to use merge-on-read for compaction and rewrite-manifests (#9974)
  • Build/release: Fix Git info after #9965 (#9975)
  • Remove "AWS Athena" from the index page (#9972)
  • Nit: fix an "unchecked/unsafe case" warning (#9966)
  • CI: Use a non-rate-limiting docker.io mirror (#9911)
  • Build: tackle Gradle deprecations marked as for-removal in Gradle 9 (#9965)
  • CI: Explicitly configure Scala version (#9970)
Assets 9
Loading

Nessie 0.100.2

20 Nov 15:54
@github-actions github-actions
nessie-0.100.2
ae2cfde
Compare
Choose a tag to compare
Nessie 0.100.2

Try it

The attached nessie-quarkus-0.100.2-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.100.2/nessie-quarkus-0.100.2-runner.jar
java -jar nessie-quarkus-0.100.2-runner.jar

Nessie CLI is attached as nessie-cli-0.100.2.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.100.2.

Nessie GC tool is attached as nessie-gc-0.100.2.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.100.2 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.100.2-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.100.2 --help.

The attached nessie-helm-0.100.2.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • Export: ZIP file exports were broken in all Nessie versions from 0.92.1 until 0.100.0.
    If you are using any of these versions, you must not use ZIP export mode, but use the
    file (directory) based exporter (--output-format=DIRECTORY)!

Fixes

  • Export: ZIP file exports are fixed with this Nessie version 0.100.1.

Full Changelog (minus renovate commits):

  • Force dnsjava downgrade to 3.5.3 (#9951)
Assets 9
Loading

Nessie 0.100.1

19 Nov 21:23
@github-actions github-actions
nessie-0.100.1
ae1843b
Compare
Choose a tag to compare
Nessie 0.100.1

Try it

The attached nessie-quarkus-0.100.1-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.100.1/nessie-quarkus-0.100.1-runner.jar
java -jar nessie-quarkus-0.100.1-runner.jar

Nessie CLI is attached as nessie-cli-0.100.1.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.100.1.

Nessie GC tool is attached as nessie-gc-0.100.1.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.100.1 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.100.1-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.100.1 --help.

The attached nessie-helm-0.100.1.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • Export: ZIP file exports were broken in all Nessie versions from 0.92.1 until 0.100.0.
    If you are using any of these versions, you must not use ZIP export mode, but use the
    file (directory) based exporter (--output-format=DIRECTORY)!

Fixes

  • Export: ZIP file exports are fixed with this Nessie version 0.100.1.

Full Changelog (minus renovate commits):

  • Export: fix ZIP output after #9034 (#9945)
  • Helm chart: fix incorrect documentation (#9923)
  • Testing: use age-based pull policy for postgres images (#9910)
Assets 9
Loading

Nessie 0.100.0

12 Nov 11:54
@github-actions github-actions
nessie-0.100.0
2359515
Compare
Choose a tag to compare
Nessie 0.100.0

Try it

The attached nessie-quarkus-0.100.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.100.0/nessie-quarkus-0.100.0-runner.jar
java -jar nessie-quarkus-0.100.0-runner.jar

Nessie CLI is attached as nessie-cli-0.100.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.100.0.

Nessie GC tool is attached as nessie-gc-0.100.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.100.0 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.100.0-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.100.0 --help.

The attached nessie-helm-0.100.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Upgrade notes

  • Helm chart: the old logLevel field has been replaced with a new log section with many more
    options to configure logging. You can now configure console- and file-based logging separately. It
    is also possible to enable JSON logging instead of plain text (but this feature requires Nessie >=
    0.99.1). For file-based logging, it is also possible to configure rotation and retention policies,
    and a persistent volume claim is now automatically created when file-based logging is enabled.
    Furthermore, Sentry integration can also be enabled and configured. And finally, it is now
    possible to configure the log level for specific loggers, not just the root logger. The old
    logLevel field is still supported, but will be removed in a future release.

Changes

  • The persistence cache tries to avoid deserialization overhead when getting an object from the
    cache by using Java's SoftReference. There is no guarantee that cached objects keep their
    Java object tree around, but it should eventually for the majority of accesses to frequently
    accessed cached objects. The default cache capacity fraction has been reduced from 70% of the
    heap size to 60% of the heap size. However, extreme heap pressure may let Java GC clear all
    SoftReferences.
  • Sends the following default options, which are convenient when using pyiceberg:
    • py-io-impl=pyiceberg.io.fsspec.FsspecFileIO
    • s3.signer=S3V4RestSigner when S3 signing is being used
  • Iceberg REST: No longer return *FileIO options from the Iceberg REST config endpoint

Fixes

  • GC: Consider referenced statistics (and partition statistics) files as 'live'.
  • JDBC: Perform JDBC commit when auto-creating tables to please transactional schema changes.

Full Changelog (minus renovate commits):

  • Catalog/Iceberg: support new remove-partition-specs metadata-update (#9906)
  • Testing/Docker: use exact version for C* images (#9908)
  • Catalog: Fix "load credendials" model (#9907)
  • Catalog: add new model and api (#9905)
  • Refactor Nessie's HTTP authentication (Quarkus 3.16 prep) (#9863)
  • Catalog/S3,GCS: Adopt IAM policies to new object-storage layout (Iceberg 1.7.0) (#9897)
  • Catalog/config: add endpoints to config response (Iceberg 1.7.0) (#9895)
  • Testing: disable looking up GCP credentials (#9900)
  • JDBC: commit after DDL setup + more info (#9901)
  • GC: consider statistics files (#9898)
  • Catalog/S3: Adopt S3 signing to new object-storage layout (Iceberg 1.7.0) (#9896)
  • Revert "Prevent tracing initialization race (Quarkus 3.16 prep) (#9866)" (#9899)
  • [Catalog] Do not return *FileIO options from the Iceberg REST config endpoint (#9642)
  • Send s3-signer only when signing is enabled (#9869)
  • Prevent tracing initialization race (Quarkus 3.16 prep) (#9866)
  • Remove @Nested from a Quarkus test (Quarkus 3.16 prep) (#9865)
  • Adopt AmazonSecretsManagerBuilder (Quarkus 3.16 prep) (#9864)
  • Convenience for pyiceberg (#9868)
  • Build only: Prefer Maven Local if enabled (#9861)
  • Build/internal/NesQuEIT: enforce no colon : for nessieProject() (#9842)
  • Docs: update troubleshooting guide with recent UID/GID changes (#9783)
  • Helm chart: add extraInitContainers value (#9773)
  • fix/keycloak-v26-deprecated-vars (#9778)
  • Helm chart: redesign logging options (#9775)
  • Fix some IDE warnings, remove unused code (#9772)
  • server-admin-tool intTest: Re-add forkEvery (#9762)
  • Remove validatation annotations from static functions (#9761)
  • Do not access Apache snapshots repository by default (#9754)
  • Transfer/related: make CoreTransferRelatedObjects generally accessible (#9752)
  • Persist: introduce deleteWithReferenced(Obj) (#9731)
  • ReferenceLogic: parameterized purge of the commit log of a Reference (#9735)
  • Add convenience functionality to get all storage locations defined in LakehouseConfig (#9742)
  • More verbose "Unauthorized signing request" warnings (#9743)
  • Move catalog-config types to separate module (#9741)
  • Site: fix formatting in Time travel with Iceberg REST chapter (#9732)
  • Docker compose: enhance all-in-one example with Spark SQL and Nessie CLI (#9719)
  • Helm chart: explicitly include namespace in created resources (#9711)
  • Let Persist.scanAllObjects() accept an empty set to return all object types (#9687)
  • Make the composite TransferRelatedObjects accessible to other projects (#9689)
  • Events SPI: load implementations via CDI (#9696)
  • Events RI: use Quarkus Messaging extension (#9686)
  • Fix ObjId.longAt() for non-256-bit object IDs (#9685)
  • Fix deprecation of o.t.containers.CassandraContainer + KafkaContainer (#9680)
  • Replace deprecated Aws4Signer with AwsV4HttpSigner (#9681)
  • Cache: keep (deserialized) object around (#9648)
  • Patch version bumps of Scala + Spark 3.5 (#9667)
  • Fix running nessie-quarkus instructions (#9668)
  • Update Docker Compose instructions in Getting Started guide (#9662)
  • Helm chart: remove bogus default value for oidcAuthServerUrl (#9654)
  • Events API: test JSON serde with views (#9645)
  • Events RI: add example with JSON serialization (#9639)
Assets 9
Loading

Nessie 0.99.0

26 Sep 18:10
@github-actions github-actions
nessie-0.99.0
e04c7e1
Compare
Choose a tag to compare
Nessie 0.99.0

Try it

The attached nessie-quarkus-0.99.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.99.0/nessie-quarkus-0.99.0-runner.jar
java -jar nessie-quarkus-0.99.0-runner.jar

Nessie CLI is attached as nessie-cli-0.99.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.99.0.

Nessie GC tool is attached as nessie-gc-0.99.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.99.0 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.99.0-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.99.0 --help.

The attached nessie-helm-0.99.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Breaking changes

  • The Events API has been redesigned to import the Nessie Model API directly, instead of using
    specific DTO classes. This change is intended to simplify the API and facilitate consumption of
    the events. The following classes from the org.projectnessie.events.api package have been
    removed and replaced with their respective model classes from the org.projectnessie.model
    package:
    • CommitMeta
    • Content and its subclasses
    • ContentKey
    • Reference and its subclasses
  • Helm chart: the service section has been redesigned to allow for extra services to be defined.
    If you have customized the service.ports field, beware that this field is now an array. Also,
    the management port configuration has been moved to a new managementService section. And
    finally, a new extraServices section has been added to allow for additional services to be
    defined.
  • ADLS: The way how storage URIs are resolved to ADLS "buckets" (container @ storage-account) has been
    changed (fixed). An ADLS "bucket" is technically identified by the storage-account, optionally further
    identified by a container/file-system name. It is recommended to specify the newly added via the
    nessie.catalog.service.adls.file-systems.<key>.authority=container@storageAccount option(s).
    The container@storageAccount part is what is mentioned as <file_system>@<account_name> in the Azure
    docs    .

New Features

  • Access check SPI has been enhanced to provide richer information in the Check type about the receiving
    API (Nessie REST or Iceberg REST) and about the individual changes, especially during a commit operation.

Changes

  • S3/GCS/ADLS: Bucket settings
    • The resolution of the specific bucket options has been enhanced to select the specific bucket options
      using the longest matching option including an optional path-prefix.
    • All bucket specific options (nessie.catalog.service.adls.buckets.<key>.,
      nessie.catalog.service.gcs.buckets.<key>., nessie.catalog.service.adls.file-systems.<key>.) got a
      new option path-prefix, which is used to restrict settings to a specific object store path prefix.
    • All bucket specific options (nessie.catalog.service.adls.buckets.<key>.,
      nessie.catalog.service.gcs.buckets.<key>., nessie.catalog.service.adls.file-systems.<key>.) got a
      new option authority, which is recommended to specify the technical bucket name. If authority is
      not specified, it will default to the value of the name option, then default to the key part of the
      formerly mentioned maps.
  • The base location of a new entity (e.g. tables) created via Iceberg REST is derived from the nearest
    parent namespace that has an explicitly set location property. (Path separator character is /.)
  • The location property on tables (and view) created via Iceberg REST may be explicitly configured, as
    long as it can be resolved against the configured object storage locations. (Path separator character
    is /.)

Fixes

  • CLI: Fix connecting to Nessie's Iceberg REST

Full Changelog (minus renovate commits):

  • CLI: Pull in essential *FileIO dependencies for Iceberg REST (#9640)
  • Events API: add support for direct JSON serialization (#9637)
  • Remove unused sourceHashes from TransplantResult (#9628)
  • Events API: use Nessie model API directly and remove DTOs (#9588)
  • remove rocksdb dependency from nessie-compatibility-common (#9632)
  • Helm chart: more flexible services configuration (#9625)
  • Also initialize Iceberg-View location (#9629)
  • [Catalog] More flexible named buckets (#9617)
  • Nit: remove unintentional output (#9626)
  • LakehouseConfigObj as transfer-related for export/import (#9623)
  • Persistable LakehouseConfig (#9614)
  • Derive location of new tables from parent namespaces, add some validations (#9612)
  • HTTP client: Update Apache HTTP client impl to avoid deprecated classes (#9610)
  • Richer access checks (#9553)
  • Version Store Result API enhancements (#9592)
Assets 9
Loading

Nessie 0.98.0

23 Sep 17:26
@github-actions github-actions
nessie-0.98.0
8aed125
Compare
Choose a tag to compare
Nessie 0.98.0

Try it

The attached nessie-quarkus-0.98.0-runner.jar is a standalone uber-jar file that runs on Java 17 or newer and it is also available via Maven Central. Download and run it (requires Java 17):

wget https://github.com/projectnessie/nessie/releases/download/nessie-0.98.0/nessie-quarkus-0.98.0-runner.jar
java -jar nessie-quarkus-0.98.0-runner.jar

Nessie CLI is attached as nessie-cli-0.98.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Nessie CLI is also available as a Docker image: docker run --rm -it ghcr.io/projectnessie/nessie-cli:0.98.0.

Nessie GC tool is attached as nessie-gc-0.98.0.jar, which is a standalone uber-jar file that runs on Java 11 or newer. Shell completion can be generated from the tool, check its help command. Nessie GC tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-gc:0.98.0 --help.

Nessie Server Admin tool is attached as nessie-server-admin-tool-0.98.0-runner.jar, which is a standalone uber-jar file that runs on Java 17 or newer. Shell completion can be generated from the tool, check its help command. Nessie Server Admin tool is also available as a Docker image: docker run --rm ghcr.io/projectnessie/nessie-server-admin:0.98.0 --help.

The attached nessie-helm-0.98.0.tgz is a packaged Helm chart, which can be downloaded and installed via Helm. There is also the Nessie Helm chart repo, which can be added and used to install the Nessie Helm chart.

Changelog

Highlights

  • Alert: If you are using MySQL or MariaDB, make sure to update objs table immediately: 
    ALTER TABLE objs MODIFY c_headers LONGBLOB;
ALTER TABLE objs MODIFY c_incremental_index LONGBLOB;
ALTER TABLE objs MODIFY c_reference_index_stripes LONGBLOB;
ALTER TABLE objs MODIFY i_index LONGBLOB;
ALTER TABLE objs MODIFY i_stripes LONGBLOB;
ALTER TABLE objs MODIFY s_text LONGBLOB;
ALTER TABLE objs MODIFY t_headers LONGBLOB;
ALTER TABLE objs MODIFY t_signature LONGBLOB;
ALTER TABLE objs MODIFY u_value LONGBLOB;
ALTER TABLE objs MODIFY v_data LONGBLOB;
ALTER TABLE objs MODIFY x_data LONGBLOB;

Fixes

  • MySQL: Change type of binary columns from BLOB to LONGBLOB.

Full Changelog (minus renovate commits):

  • Helm chart: allow setting config options when the value is a zero-value (#9587)
  • Helm chart: fix Azure SAS token settings (#9585)
  • Nit: move constant used in tests (#9579)
  • Construct *ApiImpl instead of injecting the V1 rest instances (#9577)
  • Simplify IcebergMetadataUpdate/trusted-location (#9576)
Assets 9
Loading