diff --git a/CHANGELOG.md b/CHANGELOG.md index 04be24fb56c..e67ea841f9a 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -10,6 +10,22 @@ as necessary. Empty sections will not end in the release notes. ### Upgrade notes +### Breaking changes + +### New Features + +### Changes + +### Deprecations + +### Fixes + +### Commits + +## [0.100.0] Release (2024-11-12) + +### Upgrade notes + - Helm chart: the old `logLevel` field has been replaced with a new `log` section with many more options to configure logging. You can now configure console- and file-based logging separately. It is also possible to enable JSON logging instead of plain text (but this feature requires Nessie >= @@ -19,10 +35,6 @@ as necessary. Empty sections will not end in the release notes. possible to configure the log level for specific loggers, not just the root logger. The old `logLevel` field is still supported, but will be removed in a future release. -### Breaking changes - -### New Features - ### Changes - The persistence cache tries to avoid deserialization overhead when getting an object from the @@ -36,15 +48,11 @@ as necessary. Empty sections will not end in the release notes. * `s3.signer=S3V4RestSigner` when S3 signing is being used - Iceberg REST: No longer return `*FileIO` options from the Iceberg REST config endpoint -### Deprecations - ### Fixes - GC: Consider referenced statistics (and partition statistics) files as 'live'. - JDBC: Perform JDBC commit when auto-creating tables to please transactional schema changes. -### Commits - ## [0.99.0] Release (2024-09-26) ### Breaking changes @@ -931,7 +939,8 @@ as necessary. Empty sections will not end in the release notes. - Tests: Make `ITCassandraBackendFactory` less flaky (#7186) - IntelliJ: Exclude some more directories from indexing (#7181) -[Unreleased]: https://github.com/projectnessie/nessie/compare/nessie-0.99.0...HEAD +[Unreleased]: https://github.com/projectnessie/nessie/compare/nessie-0.100.0...HEAD +[0.100.0]: https://github.com/projectnessie/nessie/compare/nessie-0.99.0...nessie-0.100.0 [0.99.0]: https://github.com/projectnessie/nessie/compare/nessie-0.97.1...nessie-0.99.0 [0.97.1]: https://github.com/projectnessie/nessie/compare/nessie-0.96.1...nessie-0.97.1 [0.96.1]: https://github.com/projectnessie/nessie/compare/nessie-0.96.0...nessie-0.96.1 diff --git a/README.md b/README.md index 0ecce698f73..97994c18254 100644 --- a/README.md +++ b/README.md @@ -106,7 +106,7 @@ Nessie Iceberg's integration is compatible with Iceberg as in the following tabl | Nessie version | Iceberg version | Spark version (Scala 2.12+2.13) | Hive version | Flink version | Presto version | Trino version | |----------------|-----------------|---------------------------------|--------------|------------------------|-------------------------------------|---------------| -| 0.99.0 | 1.5.0 | 3.3.x, 3.4.x, 3.5.x | n/a | 1.16.x, 1.17.x, 1.18.x | 0.277, 0.278.x, 0.279, 0.280, 0.281 | 419 | +| 0.100.0 | 1.5.0 | 3.3.x, 3.4.x, 3.5.x | n/a | 1.16.x, 1.17.x, 1.18.x | 0.277, 0.278.x, 0.279, 0.280, 0.281 | 419 | ### Distribution To run: diff --git a/SECURITY.md b/SECURITY.md index 7195acb3889..c0cb1aada9e 100644 --- a/SECURITY.md +++ b/SECURITY.md @@ -6,8 +6,8 @@ Currently supported versions are listed below. | Version | Supported | |----------|--------------------| -| 0.99.0 | :white_check_mark: | -| < 0.99.0 | :x: | +| 0.100.0 | :white_check_mark: | +| < 0.100.0 | :x: | All Nessie 0.x.x versions are considered beta or even alpha releases and not supported after release of Nessie 1.0.0. diff --git a/helm/nessie/Chart.yaml b/helm/nessie/Chart.yaml index e21a2aa8a12..0f75c63ed25 100644 --- a/helm/nessie/Chart.yaml +++ b/helm/nessie/Chart.yaml @@ -18,7 +18,7 @@ apiVersion: v2 name: nessie description: A Helm chart for Nessie type: application -version: 0.99.0 +version: 0.100.0 home: https://projectnessie.org/ icon: https://raw.githubusercontent.com/projectnessie/nessie/main/site/docs/img/nessie.svg sources: diff --git a/helm/nessie/README.md b/helm/nessie/README.md index dd5a50b31aa..f5c7e1099cd 100644 --- a/helm/nessie/README.md +++ b/helm/nessie/README.md @@ -8,7 +8,7 @@ helm-docs --chart-search-root=helm # Nessie Helm chart -![Version: 0.99.0](https://img.shields.io/badge/Version-0.99.0-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) +![Version: 0.100.0](https://img.shields.io/badge/Version-0.100.0-informational?style=flat-square) ![Type: application](https://img.shields.io/badge/Type-application-informational?style=flat-square) A Helm chart for Nessie. diff --git a/site/docs/releases.md b/site/docs/releases.md index 24329d55664..1b201da7056 100644 --- a/site/docs/releases.md +++ b/site/docs/releases.md @@ -2,6 +2,92 @@ **See [Nessie Server upgrade notes](server-upgrade.md) for supported upgrade paths.** +## 0.100.0 Release (November 12, 2024) + +See [Release information on GitHub](https://github.com/projectnessie/nessie/releases/tag/nessie-0.100.0). + +### Upgrade notes + +- Helm chart: the old `logLevel` field has been replaced with a new `log` section with many more + options to configure logging. You can now configure console- and file-based logging separately. It + is also possible to enable JSON logging instead of plain text (but this feature requires Nessie >= + 0.99.1). For file-based logging, it is also possible to configure rotation and retention policies, + and a persistent volume claim is now automatically created when file-based logging is enabled. + Furthermore, Sentry integration can also be enabled and configured. And finally, it is now + possible to configure the log level for specific loggers, not just the root logger. The old + `logLevel` field is still supported, but will be removed in a future release. + +### Changes + +- The persistence cache tries to avoid deserialization overhead when getting an object from the + cache by using Java's `SoftReference`. There is no guarantee that cached objects keep their + Java object tree around, but it should eventually for the majority of accesses to frequently + accessed cached objects. The default cache capacity fraction has been reduced from 70% of the + heap size to 60% of the heap size. However, extreme heap pressure may let Java GC clear all + `SoftReference`s. +- Sends the following default options, which are convenient when using pyiceberg: + * `py-io-impl=pyiceberg.io.fsspec.FsspecFileIO` + * `s3.signer=S3V4RestSigner` when S3 signing is being used +- Iceberg REST: No longer return `*FileIO` options from the Iceberg REST config endpoint + +### Fixes + +- GC: Consider referenced statistics (and partition statistics) files as 'live'. +- JDBC: Perform JDBC commit when auto-creating tables to please transactional schema changes. + +### Commits +* Catalog/Iceberg: support new `remove-partition-specs` metadata-update (#9906) +* Testing/Docker: use exact version for C* images (#9908) +* Catalog: Fix "load credendials" model (#9907) +* Catalog: add new model and api (#9905) +* Refactor Nessie's HTTP authentication (Quarkus 3.16 prep) (#9863) +* Catalog/S3,GCS: Adopt IAM policies to new object-storage layout (Iceberg 1.7.0) (#9897) +* Catalog/config: add endpoints to config response (Iceberg 1.7.0) (#9895) +* Testing: disable looking up GCP credentials (#9900) +* JDBC: commit after DDL setup + more info (#9901) +* GC: consider statistics files (#9898) +* Catalog/S3: Adopt S3 signing to new object-storage layout (Iceberg 1.7.0) (#9896) +* Revert "Prevent tracing initialization race (Quarkus 3.16 prep) (#9866)" (#9899) +* [Catalog] Do not return `*FileIO` options from the Iceberg REST config endpoint (#9642) +* Send s3-signer only when signing is enabled (#9869) +* Prevent tracing initialization race (Quarkus 3.16 prep) (#9866) +* Remove `@Nested` from a Quarkus test (Quarkus 3.16 prep) (#9865) +* Adopt `AmazonSecretsManagerBuilder` (Quarkus 3.16 prep) (#9864) +* Convenience for pyiceberg (#9868) +* Build only: Prefer Maven Local if enabled (#9861) +* Build/internal/NesQuEIT: enforce no colon `:` for `nessieProject()` (#9842) +* Docs: update troubleshooting guide with recent UID/GID changes (#9783) +* Helm chart: add `extraInitContainers` value (#9773) +* fix/keycloak-v26-deprecated-vars (#9778) +* Helm chart: redesign logging options (#9775) +* Fix some IDE warnings, remove unused code (#9772) +* server-admin-tool intTest: Re-add `forkEvery` (#9762) +* Remove validatation annotations from static functions (#9761) +* Do not access Apache snapshots repository by default (#9754) +* Transfer/related: make `CoreTransferRelatedObjects` generally accessible (#9752) +* Persist: introduce `deleteWithReferenced(Obj)` (#9731) +* ReferenceLogic: parameterized purge of the commit log of a `Reference` (#9735) +* Add convenience functionality to get all storage locations defined in `LakehouseConfig` (#9742) +* More verbose "Unauthorized signing request" warnings (#9743) +* Move catalog-config types to separate module (#9741) +* Site: fix formatting in `Time travel with Iceberg REST` chapter (#9732) +* Docker compose: enhance all-in-one example with Spark SQL and Nessie CLI (#9719) +* Helm chart: explicitly include namespace in created resources (#9711) +* Let `Persist.scanAllObjects()` accept an empty set to return all object types (#9687) +* Make the composite `TransferRelatedObjects` accessible to other projects (#9689) +* Events SPI: load implementations via CDI (#9696) +* Events RI: use Quarkus Messaging extension (#9686) +* Fix `ObjId.longAt()` for non-256-bit object IDs (#9685) +* Fix deprecation of `o.t.containers.CassandraContainer` + `KafkaContainer` (#9680) +* Replace deprecated `Aws4Signer` with `AwsV4HttpSigner` (#9681) +* Cache: keep (deserialized) object around (#9648) +* Patch version bumps of Scala + Spark 3.5 (#9667) +* Fix running `nessie-quarkus` instructions (#9668) +* Update Docker Compose instructions in Getting Started guide (#9662) +* Helm chart: remove bogus default value for oidcAuthServerUrl (#9654) +* Events API: test JSON serde with views (#9645) +* Events RI: add example with JSON serialization (#9639) + ## 0.99.0 Release (September 26, 2024) See [Release information on GitHub](https://github.com/projectnessie/nessie/releases/tag/nessie-0.99.0). diff --git a/site/docs/server-upgrade.md b/site/docs/server-upgrade.md index 572175b89af..aa199f8c800 100644 --- a/site/docs/server-upgrade.md +++ b/site/docs/server-upgrade.md @@ -14,7 +14,7 @@ are not supported and must be avoided. | Rolling Upgrade Supported | _From_ Nessie version | _To_ Nessie version | |---------------------------|-----------------------|---------------------| -| :heavy_check_mark: | 0.61.0 or newer | 0.99.0 or newer | +| :heavy_check_mark: | 0.61.0 or newer | 0.100.0 or newer | | :x: | 0.40.0 or newer | 0.61.0 or newer | | :heavy_check_mark: | 0.40.0 or newer | 0.60.0 or newer | | :x: | < 0.40.0 | 0.40.0 or newer | diff --git a/site/mkdocs.yml b/site/mkdocs.yml index 3777395f170..365bb874e25 100644 --- a/site/mkdocs.yml +++ b/site/mkdocs.yml @@ -33,7 +33,7 @@ extra_css: extra: versions: - nessie: 0.99.0 + nessie: 0.100.0 iceberg: 1.5.2 double_curly: "{{" analytics: diff --git a/site/nav.yml b/site/nav.yml index 0fbb85504e7..00b7848bed0 100644 --- a/site/nav.yml +++ b/site/nav.yml @@ -53,6 +53,7 @@ nav: - Unreleased (nightly): '!include build/versions/nightly/mkdocs.yml' # Do NOT change, move or remove the following line!! # RELEASE_PLACEHOLDER_MARKER + - Nessie 0.100.0: '!include build/versions/0.100.0/mkdocs.yml' - Nessie 0.99.0: '!include build/versions/0.99.0/mkdocs.yml' - Nessie 0.98.0: '!include build/versions/0.98.0/mkdocs.yml' - Nessie 0.97.1: '!include build/versions/0.97.1/mkdocs.yml' diff --git a/version.txt b/version.txt index 396a21149c1..fbd7ac6f8e4 100644 --- a/version.txt +++ b/version.txt @@ -1 +1 @@ -0.99.1-SNAPSHOT \ No newline at end of file +0.100.0 \ No newline at end of file