From 4463cb0de67c11296345164c82412f6845507ead Mon Sep 17 00:00:00 2001 From: David Kilfoyle <david.kilfoyle@elastic.co> Date: Tue, 29 Oct 2024 13:54:57 -0400 Subject: [PATCH 01/17] Add Fleet & Agent 8.16.0 Release Notes --- .../release-notes/release-notes-8.16.asciidoc | 204 ++++++++++++++++++ 1 file changed, 204 insertions(+) create mode 100644 docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc new file mode 100644 index 000000000..54a50ae6d --- /dev/null +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -0,0 +1,204 @@ +// Use these for links to issue and pulls. +:kibana-issue: https://github.com/elastic/kibana/issues/ +:kibana-pull: https://github.com/elastic/kibana/pull/ +:beats-issue: https://github.com/elastic/beats/issues/ +:beats-pull: https://github.com/elastic/beats/pull/ +:agent-libs-pull: https://github.com/elastic/elastic-agent-libs/pull/ +:agent-issue: https://github.com/elastic/elastic-agent/issues/ +:agent-pull: https://github.com/elastic/elastic-agent/pull/ +:fleet-server-issue: https://github.com/elastic/fleet-server/issues/ +:fleet-server-pull: https://github.com/elastic/fleet-server/pull/ + +[[release-notes]] += Release notes + +This section summarizes the changes in each release. + +* <<release-notes-8.16.0>> + +Also see: + +* {kibana-ref}/release-notes.html[{kib} release notes] +* {beats-ref}/release-notes.html[{beats} release notes] + +// begin 8.16.0 relnotes + +[[release-notes-8.15.0]] +== {fleet} and {agent} 8.15.0 + +Review important information about the {fleet} and {agent} 8.16.0 release. + +[discrete] +[[security-updates-8.16.0]] +=== Security updates + +{fleet-server}:: +* Update {fleet-server} Go version to 1.23.1. {fleet-server-pull}3924[#3924] + +[discrete] +[[new-features-8.16.0]] +=== New features + +The 8.16.0 release Added the following new and notable features. + +{fleet-server}:: +* Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to enable accurate status reporting in the {fleet} UI. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] +* Add a `secret_paths` attribute to the policy data sent to agents. This attribute is a list of keys that {fleet-server} has replaced with a reference to a secret value. {fleet-server-pull}3908[#3908] {fleet-server-issue}3657[#3657] + + +{agent}:: + + +[discrete] +[[enhancements-8.16.0]] +=== Enhancements + +{fleet}:: + +{fleet-server}:: +* Alter the checkin API to remove attributes set by the audit or unenroll API (follow-up to {fleet-server-pull}3818[#3818] above). {fleet-server-pull}3827[#3827] {agent-issue}484[#484] +* Enable warnings for configuration options that have been deprecated throughout the 8.x lifecycle. {fleet-server-pull}3901[#3901] + +{agent}:: + + +[discrete] +[[bug-fixes-8.16.0]] +=== Bug fixes + +{fleet}:: +// EXAMPLE * Fix navigating back to Agent policy integration list. ({kibana-pull}189165[#189165]) + +{fleet-server}:: +* Fix the error handling when {fleet-server} attempts to authenticate with {es}. {fleet-server-pull}3935[#3935] {fleet-server-issue}3929[#3929] + +{agent}:: + + +// end 8.16.0 relnotes + +// --------------------- +//TEMPLATE +//Use the following text as a template. Remember to replace the version info. + +// begin 8.7.x relnotes + +//[[release-notes-8.7.x]] +//== {fleet} and {agent} 8.7.x + +//Review important information about the {fleet} and {agent} 8.7.x release. + +//[discrete] +//[[security-updates-8.7.x]] +//=== Security updates + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +//[discrete] +//[[breaking-changes-8.7.x]] +//=== Breaking changes + +//Breaking changes can prevent your application from optimal operation and +//performance. Before you upgrade, review the breaking changes, then mitigate the +//impact to your application. + +//[discrete] +//[[breaking-PR#]] +//.Short description +//[%collapsible] +//==== +//*Details* + +//<Describe new behavior.> For more information, refer to {kibana-pull}PR[#PR]. + +//*Impact* + +//<Describe how users should mitigate the change.> For more information, refer to {fleet-guide}/fleet-server.html[Fleet Server]. +//==== + +//[discrete] +//[[notable-changes-8.13.0]] +//=== Notable changes + +//The following are notable, non-breaking updates to be aware of: + +//* Changes to features that are in Technical Preview. +//* Changes to log formats. +//* Changes to non-public APIs. +//* Behaviour changes that repair critical bugs. + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +//[discrete] +//[[known-issues-8.7.x]] +//=== Known issues + +//[[known-issue-issue#]] +//.Short description +//[%collapsible] +//==== + +//*Details* + +//<Describe known issue.> + +//*Impact* + + +//<Describe impact or workaround.> + +//==== + +//[discrete] +//[[deprecations-8.7.x]] +//=== Deprecations + +//The following functionality is deprecated in 8.7.x, and will be removed in +//8.7.x. Deprecated functionality does not have an immediate impact on your +//application, but we strongly recommend you make the necessary updates after you +//upgrade to 8.7.x. + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +//[discrete] +//[[new-features-8.7.x]] +//=== New features + +//The 8.7.x release Added the following new and notable features. + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +//[discrete] +//[[enhancements-8.7.x]] +//=== Enhancements + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +//[discrete] +//[[bug-fixes-8.7.x]] +//=== Bug fixes + +//{fleet}:: +//* add info + +//{agent}:: +//* add info + +// end 8.7.x relnotes From f70afdc2ba1f5bd090414d5ed59cada9db618bf1 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <david.kilfoyle@elastic.co> Date: Tue, 29 Oct 2024 18:23:06 -0400 Subject: [PATCH 02/17] Add agent items --- .../release-notes/release-notes-8.16.asciidoc | 23 ++++++++++++++----- 1 file changed, 17 insertions(+), 6 deletions(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 54a50ae6d..34fc75d7c 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -23,8 +23,8 @@ Also see: // begin 8.16.0 relnotes -[[release-notes-8.15.0]] -== {fleet} and {agent} 8.15.0 +[[release-notes-8.16.0]] +== {fleet} and {agent} 8.16.0 Review important information about the {fleet} and {agent} 8.16.0 release. @@ -45,9 +45,13 @@ The 8.16.0 release Added the following new and notable features. * Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to enable accurate status reporting in the {fleet} UI. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] * Add a `secret_paths` attribute to the policy data sent to agents. This attribute is a list of keys that {fleet-server} has replaced with a reference to a secret value. {fleet-server-pull}3908[#3908] {fleet-server-issue}3657[#3657] - {agent}:: - +* Uninstalling a {fleet}-managed {agent} instance will now do a best-effort attempt to notify {fleet-server} of the agent removal so the agent status appears correctly in the {fleet} UI (related to {fleet-server-pull}3818[#3818] above). {agent-pull}5302[#5302] {agent-issue}484[#484] +* Remove support for the experimental shippers feature. Removal is non-breaking since the feature was experimental only. {agent-pull}5308[#5308] {agent-issue}4547[#4547] +* Add the GCP Asset Inventory input to Cloudbeat. {agent-pull}5422[#5422] +* Add support for passphrase protected mTLS client certificate key during install/enroll. {agent-pull}5494[#5494] {agent-issue}5489[#5489] +* Elastic Defend now accepts a passphrase protected client certificate key for mTLS. {agent-pull}5542[#5542] {agent-issue}5490[#5490] +* Add a Kustomize template to enable hints-based autodiscovery by default when deploying standalone {agent} in a Kubernetes cluster. This also removes `root` privileges from the init container. {agent-pull}5643[#5643] [discrete] [[enhancements-8.16.0]] @@ -60,7 +64,12 @@ The 8.16.0 release Added the following new and notable features. * Enable warnings for configuration options that have been deprecated throughout the 8.x lifecycle. {fleet-server-pull}3901[#3901] {agent}:: - +* Re-enable support for Elastic Defend on Windows Server 2012 and 2012 R2. {agent-pull}5429[#5429] +* Include the correct Elastic License 2.0 file in build artifacts and packages. {agent-pull}5464[#5464] +* Add the `pprofextension` to the {agent} OTel collector. {agent-pull}5556[#5556] +* Update the base container image from Ubuntu 20.04 to Ubuntu 24.04. {agent-pull}5644[#5644] {agent-issue}5501[#5501] +* Redact values from the `elastic-agent inspect` command output for any keys in the `secret_paths` array. {agent-pull}5621[#5621] +* Redact secret paths in files written in {agent} diagnostics bundles. {agent-pull}5745[#5745] [discrete] [[bug-fixes-8.16.0]] @@ -73,7 +82,9 @@ The 8.16.0 release Added the following new and notable features. * Fix the error handling when {fleet-server} attempts to authenticate with {es}. {fleet-server-pull}3935[#3935] {fleet-server-issue}3929[#3929] {agent}:: - +* Fix {agent} crashing when self unenrolling due to too many authentication failures against {fleet-server}. {agent-pull}5438[#5438] {agent-issue}5434[#5434] +* Set the default log level on policy change, when policy does not have a log level +* Change the deprecated `maintainer` label in Dockerfile to use the `org.opencontainers.image.authors` label instead. {agent-pull}5527[#5527] // end 8.16.0 relnotes From 1d855883c924c3eef16481049c42532b3d2e0836 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <david.kilfoyle@elastic.co> Date: Wed, 30 Oct 2024 09:52:17 -0400 Subject: [PATCH 03/17] Add Fleet contents --- docs/en/ingest-management/index.asciidoc | 2 +- .../release-notes/release-notes-8.16.asciidoc | 24 +++++++++++++++++-- 2 files changed, 23 insertions(+), 3 deletions(-) diff --git a/docs/en/ingest-management/index.asciidoc b/docs/en/ingest-management/index.asciidoc index f85081f37..f98df845a 100644 --- a/docs/en/ingest-management/index.asciidoc +++ b/docs/en/ingest-management/index.asciidoc @@ -227,7 +227,7 @@ include::troubleshooting/troubleshooting.asciidoc[leveloffset=+2] include::troubleshooting/faq.asciidoc[leveloffset=+2] -include::release-notes/release-notes-8.15.asciidoc[leveloffset=+1] +include::release-notes/release-notes-8.16.asciidoc[leveloffset=+1] include::elastic-agent/install-fleet-managed-agent.asciidoc[leveloffset=+2] diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 34fc75d7c..98ab44da1 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -41,6 +41,14 @@ Review important information about the {fleet} and {agent} 8.16.0 release. The 8.16.0 release Added the following new and notable features. +{fleet}:: +* Support content packages in UI. {kibana-pull}195831[#195831] +* Advanced agent monitoring options UI for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] +* Add option to have Kafka dynamic topics in outputs. {kibana-pull}192720[#192720] +* Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] +* Add agentless UX creation flow. {kibana-pull}189932[#189932] +* Enable feature flag for reusable integration policies. {kibana-pull}187153[#187153] + {fleet-server}:: * Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to enable accurate status reporting in the {fleet} UI. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] * Add a `secret_paths` attribute to the policy data sent to agents. This attribute is a list of keys that {fleet-server} has replaced with a reference to a secret value. {fleet-server-pull}3908[#3908] {fleet-server-issue}3657[#3657] @@ -58,6 +66,17 @@ The 8.16.0 release Added the following new and notable features. === Enhancements {fleet}:: +* Update maximum supported package version. {kibana-pull}196551[#196551] +* Add additional columns to {agent} Logs UI. {kibana-pull}192262[#192262] +* Show `+build` versions for {agent} upgrades. {kibana-pull}192171[#192171] +* Add format parameter to `agent_policies` APIs. {kibana-pull}191811[#191811] +* Add toggles for `agent.monitoring.http.enabled` and `agent.monitoring.http.buffer.enabled` to agent policy advanced settings. {kibana-pull}190984[#190984] +* Support integration policies without agent policy references (aka orphaned integration policies). {kibana-pull}190649[#190649] +* Chang the UX of the Edit Integration Policy page to update agent policies. {kibana-pull}190583[#190583] +* Allow `traces` to be added to the `monitoring_enabled` array in Agent policies. {kibana-pull}189908[#189908] +* Create a task that periodically unenrolls inactive agents. {kibana-pull}189861[#189861] +* Add setup technology selector to the Add Integration page. {kibana-pull}189612[#189612] +* Support integration-level outputs. {kibana-pull}189125[#189125] {fleet-server}:: * Alter the checkin API to remove attributes set by the audit or unenroll API (follow-up to {fleet-server-pull}3818[#3818] above). {fleet-server-pull}3827[#3827] {agent-issue}484[#484] @@ -76,14 +95,15 @@ The 8.16.0 release Added the following new and notable features. === Bug fixes {fleet}:: -// EXAMPLE * Fix navigating back to Agent policy integration list. ({kibana-pull}189165[#189165]) +* Revert "Fix client-side validation for agent policy timeout fields". {kibana-pull}194338[#194338] +* Add proxy arguments to install snippets. {kibana-pull}193922[#193922] +* Rollover if dimension mappings changed in dynamic templates. {kibana-pull}192098[#192098] {fleet-server}:: * Fix the error handling when {fleet-server} attempts to authenticate with {es}. {fleet-server-pull}3935[#3935] {fleet-server-issue}3929[#3929] {agent}:: * Fix {agent} crashing when self unenrolling due to too many authentication failures against {fleet-server}. {agent-pull}5438[#5438] {agent-issue}5434[#5434] -* Set the default log level on policy change, when policy does not have a log level * Change the deprecated `maintainer` label in Dockerfile to use the `org.opencontainers.image.authors` label instead. {agent-pull}5527[#5527] // end 8.16.0 relnotes From 1f5c6deee6203c33ac1c04d3b5ed727ddae118e5 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <david.kilfoyle@elastic.co> Date: Mon, 4 Nov 2024 14:15:06 -0500 Subject: [PATCH 04/17] Add agent and fleet-server items from BC3 --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 98ab44da1..35e09b962 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -89,6 +89,7 @@ The 8.16.0 release Added the following new and notable features. * Update the base container image from Ubuntu 20.04 to Ubuntu 24.04. {agent-pull}5644[#5644] {agent-issue}5501[#5501] * Redact values from the `elastic-agent inspect` command output for any keys in the `secret_paths` array. {agent-pull}5621[#5621] * Redact secret paths in files written in {agent} diagnostics bundles. {agent-pull}5745[#5745] +* Update the versions of OpenTelemetry Collector components from v0.111.0/v1.17.0 to v0.112.0/v1.18.0. {agent-pull}5838[#5838] [discrete] [[bug-fixes-8.16.0]] @@ -101,6 +102,7 @@ The 8.16.0 release Added the following new and notable features. {fleet-server}:: * Fix the error handling when {fleet-server} attempts to authenticate with {es}. {fleet-server-pull}3935[#3935] {fleet-server-issue}3929[#3929] +* Fix an issue that caused {fleet-server} to report a `500` error on {agent} check-in because the agent has upgrade details but the referenced action ID is not found. {fleet-server-pull}3991[#3991] {agent}:: * Fix {agent} crashing when self unenrolling due to too many authentication failures against {fleet-server}. {agent-pull}5438[#5438] {agent-issue}5434[#5434] From 9323922dc3ecdb2797281d488c53100e027b47e1 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Tue, 5 Nov 2024 16:52:03 -0500 Subject: [PATCH 05/17] Add descriptions from feature summary issue --- .../release-notes/release-notes-8.16.asciidoc | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 35e09b962..8c9a5be65 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -44,10 +44,13 @@ The 8.16.0 release Added the following new and notable features. {fleet}:: * Support content packages in UI. {kibana-pull}195831[#195831] * Advanced agent monitoring options UI for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] -* Add option to have Kafka dynamic topics in outputs. {kibana-pull}192720[#192720] +* Create a task that periodically unenrolls inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] +* Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] * Add agentless UX creation flow. {kibana-pull}189932[#189932] -* Enable feature flag for reusable integration policies. {kibana-pull}187153[#187153] +* Enable feature flag for reusable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] +* Support integration-level outputs. This feature enables you to send integration data to a specific output, over-writing the output defined in the {agent} Policy. {kibana-pull}189125[#189125] + {fleet-server}:: * Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to enable accurate status reporting in the {fleet} UI. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] @@ -55,6 +58,7 @@ The 8.16.0 release Added the following new and notable features. {agent}:: * Uninstalling a {fleet}-managed {agent} instance will now do a best-effort attempt to notify {fleet-server} of the agent removal so the agent status appears correctly in the {fleet} UI (related to {fleet-server-pull}3818[#3818] above). {agent-pull}5302[#5302] {agent-issue}484[#484] +* Introduce a Helm Chart for deploying {agent} in Kubernetes. {agent-pull}5331[#5331] {agent-issue}3847[#3847] * Remove support for the experimental shippers feature. Removal is non-breaking since the feature was experimental only. {agent-pull}5308[#5308] {agent-issue}4547[#4547] * Add the GCP Asset Inventory input to Cloudbeat. {agent-pull}5422[#5422] * Add support for passphrase protected mTLS client certificate key during install/enroll. {agent-pull}5494[#5494] {agent-issue}5489[#5489] @@ -74,9 +78,7 @@ The 8.16.0 release Added the following new and notable features. * Support integration policies without agent policy references (aka orphaned integration policies). {kibana-pull}190649[#190649] * Chang the UX of the Edit Integration Policy page to update agent policies. {kibana-pull}190583[#190583] * Allow `traces` to be added to the `monitoring_enabled` array in Agent policies. {kibana-pull}189908[#189908] -* Create a task that periodically unenrolls inactive agents. {kibana-pull}189861[#189861] * Add setup technology selector to the Add Integration page. {kibana-pull}189612[#189612] -* Support integration-level outputs. {kibana-pull}189125[#189125] {fleet-server}:: * Alter the checkin API to remove attributes set by the audit or unenroll API (follow-up to {fleet-server-pull}3818[#3818] above). {fleet-server-pull}3827[#3827] {agent-issue}484[#484] From 5d14338ecaacbfdd7818aa323d832eac071828e6 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Tue, 5 Nov 2024 16:52:18 -0500 Subject: [PATCH 06/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Craig MacKenzie <craig.mackenzie@elastic.co> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 8c9a5be65..b74bdc6ee 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -53,7 +53,7 @@ The 8.16.0 release Added the following new and notable features. {fleet-server}:: -* Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to enable accurate status reporting in the {fleet} UI. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] +* Add `/api/fleet/agents/:id/audit/unenroll` API that an {agent} or Endpoint process may use to report that an agent was uninstalled or unenrolled to {fleet}. {fleet-server-pull}3818[#3818] {agent-issue}484[#484] * Add a `secret_paths` attribute to the policy data sent to agents. This attribute is a list of keys that {fleet-server} has replaced with a reference to a secret value. {fleet-server-pull}3908[#3908] {fleet-server-issue}3657[#3657] {agent}:: From 3b4a46f0db54773a74c8681aa1c494b9b690daec Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Tue, 5 Nov 2024 16:52:25 -0500 Subject: [PATCH 07/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Craig MacKenzie <craig.mackenzie@elastic.co> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index b74bdc6ee..12d997721 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -59,7 +59,7 @@ The 8.16.0 release Added the following new and notable features. {agent}:: * Uninstalling a {fleet}-managed {agent} instance will now do a best-effort attempt to notify {fleet-server} of the agent removal so the agent status appears correctly in the {fleet} UI (related to {fleet-server-pull}3818[#3818] above). {agent-pull}5302[#5302] {agent-issue}484[#484] * Introduce a Helm Chart for deploying {agent} in Kubernetes. {agent-pull}5331[#5331] {agent-issue}3847[#3847] -* Remove support for the experimental shippers feature. Removal is non-breaking since the feature was experimental only. {agent-pull}5308[#5308] {agent-issue}4547[#4547] +* Remove support for the experimental shippers feature. {agent-pull}5308[#5308] {agent-issue}4547[#4547] * Add the GCP Asset Inventory input to Cloudbeat. {agent-pull}5422[#5422] * Add support for passphrase protected mTLS client certificate key during install/enroll. {agent-pull}5494[#5494] {agent-issue}5489[#5489] * Elastic Defend now accepts a passphrase protected client certificate key for mTLS. {agent-pull}5542[#5542] {agent-issue}5490[#5490] From 066dae366cab4042f118c72131ba9edc8005137c Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:33:48 -0500 Subject: [PATCH 08/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 1 - 1 file changed, 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 12d997721..3f27970fe 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -76,7 +76,6 @@ The 8.16.0 release Added the following new and notable features. * Add format parameter to `agent_policies` APIs. {kibana-pull}191811[#191811] * Add toggles for `agent.monitoring.http.enabled` and `agent.monitoring.http.buffer.enabled` to agent policy advanced settings. {kibana-pull}190984[#190984] * Support integration policies without agent policy references (aka orphaned integration policies). {kibana-pull}190649[#190649] -* Chang the UX of the Edit Integration Policy page to update agent policies. {kibana-pull}190583[#190583] * Allow `traces` to be added to the `monitoring_enabled` array in Agent policies. {kibana-pull}189908[#189908] * Add setup technology selector to the Add Integration page. {kibana-pull}189612[#189612] From 5afd371df0faf69176bbf51a6dc6c665a25db04e Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:01 -0500 Subject: [PATCH 09/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 3f27970fe..216edca5f 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -42,7 +42,7 @@ Review important information about the {fleet} and {agent} 8.16.0 release. The 8.16.0 release Added the following new and notable features. {fleet}:: -* Support content packages in UI. {kibana-pull}195831[#195831] +* Add support for content-only packages in integrations UI. {kibana-pull}195831[#195831] * Advanced agent monitoring options UI for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] * Create a task that periodically unenrolls inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] * Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] From 9936ee2a4eec088433997f7744678f2255277887 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:12 -0500 Subject: [PATCH 10/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 1 - 1 file changed, 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 216edca5f..313d6a465 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -47,7 +47,6 @@ The 8.16.0 release Added the following new and notable features. * Create a task that periodically unenrolls inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] * Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] -* Add agentless UX creation flow. {kibana-pull}189932[#189932] * Enable feature flag for reusable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] * Support integration-level outputs. This feature enables you to send integration data to a specific output, over-writing the output defined in the {agent} Policy. {kibana-pull}189125[#189125] From e6b4f869dfd43858c8219fe45e1dfb4028f922e1 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:20 -0500 Subject: [PATCH 11/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 313d6a465..7126b26b8 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -43,7 +43,7 @@ The 8.16.0 release Added the following new and notable features. {fleet}:: * Add support for content-only packages in integrations UI. {kibana-pull}195831[#195831] -* Advanced agent monitoring options UI for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] +* Add advanced agent monitoring options for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] * Create a task that periodically unenrolls inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] * Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] From 333ce4aac46689d780a415f31d73592439e87bf4 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:32 -0500 Subject: [PATCH 12/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 7126b26b8..827c26a24 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -44,7 +44,7 @@ The 8.16.0 release Added the following new and notable features. {fleet}:: * Add support for content-only packages in integrations UI. {kibana-pull}195831[#195831] * Add advanced agent monitoring options for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] -* Create a task that periodically unenrolls inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] +* Add support for periodic unenrollment of inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] * Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] * Enable feature flag for reusable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] From ada3d73c924507295fc1be25d72fc71dd502a9ac Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:46 -0500 Subject: [PATCH 13/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 827c26a24..c7f569406 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -45,7 +45,7 @@ The 8.16.0 release Added the following new and notable features. * Add support for content-only packages in integrations UI. {kibana-pull}195831[#195831] * Add advanced agent monitoring options for HTTP endpoint and diagnostics. {kibana-pull}193361[#193361] * Add support for periodic unenrollment of inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] -* Add option to have Kafka dynamic topics in outputs. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] +* Add support for dynamic topics to the Kafka output. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] * Enable feature flag for reusable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] * Support integration-level outputs. This feature enables you to send integration data to a specific output, over-writing the output defined in the {agent} Policy. {kibana-pull}189125[#189125] From c50b29a69ce368a02a3af50f42cd80b3614301e8 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:34:56 -0500 Subject: [PATCH 14/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index c7f569406..f9f1f27f6 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -47,7 +47,7 @@ The 8.16.0 release Added the following new and notable features. * Add support for periodic unenrollment of inactive agents. Once an {agent} transitions to an `inactive` state and after a configurable timeout has expired, the agent will be unenrolled. {kibana-pull}189861[#189861] * Add support for dynamic topics to the Kafka output. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] -* Enable feature flag for reusable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] +* Add support for reusable/shareable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] * Support integration-level outputs. This feature enables you to send integration data to a specific output, over-writing the output defined in the {agent} Policy. {kibana-pull}189125[#189125] From 9648b521f3f71da52a6c05a67fc2dd94703b06ae Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:35:05 -0500 Subject: [PATCH 15/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc Co-authored-by: Kyle Pollich <kpollich1@gmail.com> --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index f9f1f27f6..11f320fc5 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -48,7 +48,7 @@ The 8.16.0 release Added the following new and notable features. * Add support for dynamic topics to the Kafka output. This allows the Kafka output to write to a topic which is dynamically set in an event field. {kibana-pull}192720[#192720] * Add support for GeoIP processor databases in Ingest Pipelines. {kibana-pull}190830[#190830] * Add support for reusable/shareable integration policies. This feature allows you to create integrations policies that can be shared with multiple {agent} policies, thereby reducing the number of integrations policies that you need to actively manage. {kibana-pull}187153[#187153] -* Support integration-level outputs. This feature enables you to send integration data to a specific output, over-writing the output defined in the {agent} Policy. {kibana-pull}189125[#189125] +* Add support for integration-level outputs. This feature enables you to send integration data to a specific output, overwriting the output defined in the {agent} Policy. {kibana-pull}189125[#189125] {fleet-server}:: From d39fe367ea87f7fe78d59a350c187adac58cdb7b Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 10:58:05 -0500 Subject: [PATCH 16/17] Update docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc --- .../release-notes/release-notes-8.16.asciidoc | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 11f320fc5..96080b735 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -35,6 +35,17 @@ Review important information about the {fleet} and {agent} 8.16.0 release. {fleet-server}:: * Update {fleet-server} Go version to 1.23.1. {fleet-server-pull}3924[#3924] +[discrete] +[[breaking-changes-8.16.0]] +=== Breaking changes + +Breaking changes can prevent your application from optimal operation and +performance. Before you upgrade, review the breaking changes, then mitigate the +impact to your application. + +{agent}:: +* When using the System integration, uppercase characters in the `host.hostname` are being converted to lowercase in {agent} output. This can possibly result in duplicated host entries appearing in {kib}. {beats-issue}39993[#39993] + [discrete] [[new-features-8.16.0]] === New features From be899be9b31013971ecdc5b87f6e4e220459fe35 Mon Sep 17 00:00:00 2001 From: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> Date: Wed, 6 Nov 2024 11:00:09 -0500 Subject: [PATCH 17/17] Update release-notes-8.16.asciidoc --- .../ingest-management/release-notes/release-notes-8.16.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc index 96080b735..0bf7228f9 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.16.asciidoc @@ -44,7 +44,7 @@ performance. Before you upgrade, review the breaking changes, then mitigate the impact to your application. {agent}:: -* When using the System integration, uppercase characters in the `host.hostname` are being converted to lowercase in {agent} output. This can possibly result in duplicated host entries appearing in {kib}. {beats-issue}39993[#39993] +* When using the System integration, uppercase characters in the `host.hostname` are being converted to lowercase in {agent} output. This can possibly result in duplicated host entries appearing in {kib}. {beats-issue}39993[#3993] [discrete] [[new-features-8.16.0]]