From 8eba943336ed06f2ef0e69443268453bb182b693 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Wed, 20 Sep 2023 16:17:08 +0900 Subject: [PATCH 01/18] in_process_exporter_metrics: Add documentation for process_exporter_metrics Signed-off-by: Hiroshi Hatake --- SUMMARY.md | 1 + pipeline/inputs/process-exporter-metrics.md | 84 +++++++++++++++++++++ 2 files changed, 85 insertions(+) create mode 100644 pipeline/inputs/process-exporter-metrics.md diff --git a/SUMMARY.md b/SUMMARY.md index da19a1bc5..0a466fe55 100644 --- a/SUMMARY.md +++ b/SUMMARY.md @@ -103,6 +103,7 @@ * [Node Exporter Metrics](pipeline/inputs/node-exporter-metrics.md) * [Podman Metrics](pipeline/inputs/podman-metrics.md) * [Process Log Based Metrics](pipeline/inputs/process.md) + * [Process Exporter Metrics](pipeline/inputs/process-exporter-metrics.md) * [Prometheus Scrape Metrics](pipeline/inputs/prometheus-scrape-metrics.md) * [Random](pipeline/inputs/random.md) * [Serial Interface](pipeline/inputs/serial-interface.md) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md new file mode 100644 index 000000000..1e55f2f3e --- /dev/null +++ b/pipeline/inputs/process-exporter-metrics.md @@ -0,0 +1,84 @@ +--- +description: >- + A plugin based on Process Exporter to collect process level of metrics of system + metrics +--- + +# Process Exporter Metrics + +[Prometheus Node Exporter](https://github.com/prometheus/node_exporter) is a popular way to collect system level metrics from operating systems, such as CPU / Disk / Network / Process statistics. Fluent Bit 2.2 includes process exporter metrics plugin that builds off the Prometheus design to collect process level metrics without having to manage two separate processes or agents. + +The initial release of Process Exporter Metrics refers a process group level collector to collect metrics available from [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter) and we plan to expand them over time if needed. + +**Important note:** Metrics collected with Process Exporter Metrics flow through a separate pipeline from logs and current filters do not operate on top of metrics. + +This plugin is only supported on Linux based operating systems. + + +## Configuration + +| Key | Description | Default | +| ------------------------- | -------------------------------------------------------------------------------------- | --------- | +| scrape_interval | The rate at which metrics are collected from the host operating system | 5 seconds | +| path.procfs | The mount point used to collect process information and metrics | /proc/ | +| process\_include\_pattern | regex to determine which processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | +| process\_exclude\_pattern | regex to determine which units are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | + +## Getting Started + +### Simple Configuration File + +In the following configuration file, the input plugin _process\_exporter\_metrics collects _metrics every 2 seconds and exposes them through our [Prometheus Exporter](../outputs/prometheus-exporter.md) output plugin on HTTP/TCP port 2021. + +``` +# Process Exporter Metrics + Prometheus Exporter +# ------------------------------------------- +# The following example collect host metrics on Linux and expose +# them through a Prometheus HTTP end-point. +# +# After starting the service try it with: +# +# $ curl http://127.0.0.1:2021/metrics +# +[SERVICE] + flush 1 + log_level info + +[INPUT] + name process_exporter_metrics + tag process_metrics + scrape_interval 2 + +[OUTPUT] + name prometheus_exporter + match process_metrics + host 0.0.0.0 + port 2021 +``` + +You can test the expose of the metrics by using _curl:_ + +```bash +curl http://127.0.0.1:2021/metrics +``` + +### Container to Collect Host Metrics + +When deploying Fluent Bit in a container you will need to specify additional settings to ensure that Fluent Bit has access to the host operating system. The following docker command deploys Fluent Bit with specific mount path for ptocfs and settings enabled to ensure that Fluent Bit can collect from the host. These are then exposed over port 2021. + +``` +docker run -ti -v /proc:/host/proc \ + -v /sys:/host/sys \ + -p 2021:2021 \ + fluent/fluent-bit:2.2.0 \ + /fluent-bit/bin/fluent-bit \ + -i process_exporter_metrics -p path.procfs=/host/proc \ + -o prometheus_exporter -p "add_label=host $HOSTNAME" \ + -f 1 +``` + +## Enhancement Requests + +Our current plugin refers a sub-set of the available collectors in the 3rd party implementation of Prometheus Process Exporter, if you would like that we prioritize a specific metrics please open a Github issue by using the following template:\ +\ +\- [in_process_exporter_metrics](https://github.com/fluent/fluent-bit/issues/new?assignees=\&labels=\&template=feature_request.md\&title=in_process_exporter_metrics:%20add%20ABC%20collector) From 672bcafd123f3d7bc1e11dcd79ab8f4d52c9e9c4 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:06:49 +0900 Subject: [PATCH 02/18] Explain the detail of process level of metrics Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 1e55f2f3e..dbb000fc9 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -6,7 +6,8 @@ description: >- # Process Exporter Metrics -[Prometheus Node Exporter](https://github.com/prometheus/node_exporter) is a popular way to collect system level metrics from operating systems, such as CPU / Disk / Network / Process statistics. Fluent Bit 2.2 includes process exporter metrics plugin that builds off the Prometheus design to collect process level metrics without having to manage two separate processes or agents. +[Prometheus Node Exporter](https://github.com/prometheus/node_exporter) is a popular way to collect system level metrics from operating systems, such as CPU / Disk / Network / Process statistics. +Fluent Bit 2.2 onwards includes a process exporter plugin that builds off the Prometheus design to collect process level metrics without having to manage two separate processes or agents. The initial release of Process Exporter Metrics refers a process group level collector to collect metrics available from [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter) and we plan to expand them over time if needed. From 312fa2947480a62e343bf923552b17fde8e54abd Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:07:26 +0900 Subject: [PATCH 03/18] Clearify meanings of the sentence Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index dbb000fc9..c08b5ceb8 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -9,7 +9,7 @@ description: >- [Prometheus Node Exporter](https://github.com/prometheus/node_exporter) is a popular way to collect system level metrics from operating systems, such as CPU / Disk / Network / Process statistics. Fluent Bit 2.2 onwards includes a process exporter plugin that builds off the Prometheus design to collect process level metrics without having to manage two separate processes or agents. -The initial release of Process Exporter Metrics refers a process group level collector to collect metrics available from [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter) and we plan to expand them over time if needed. +The Process Exporter Metrics plugin implements collecting of the various metrics available from [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter) and these will be expanded over time as needed. **Important note:** Metrics collected with Process Exporter Metrics flow through a separate pipeline from logs and current filters do not operate on top of metrics. From 8acb9aaf8dcd82b4c1d17fe55a3c6f0a946f5609 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:08:43 +0900 Subject: [PATCH 04/18] Simplify the description of scrape_interval parameter Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index c08b5ceb8..11053fa2b 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -20,7 +20,7 @@ This plugin is only supported on Linux based operating systems. | Key | Description | Default | | ------------------------- | -------------------------------------------------------------------------------------- | --------- | -| scrape_interval | The rate at which metrics are collected from the host operating system | 5 seconds | +| scrape_interval | The rate at which metrics are collected. | 5 seconds | | path.procfs | The mount point used to collect process information and metrics | /proc/ | | process\_include\_pattern | regex to determine which processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | | process\_exclude\_pattern | regex to determine which units are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | From b7d5d54f492bd9fc3764505100cfe60f86e7f305 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:09:13 +0900 Subject: [PATCH 05/18] Separate sentence to review easily Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 11053fa2b..a38bd3faa 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -65,7 +65,9 @@ curl http://127.0.0.1:2021/metrics ### Container to Collect Host Metrics -When deploying Fluent Bit in a container you will need to specify additional settings to ensure that Fluent Bit has access to the host operating system. The following docker command deploys Fluent Bit with specific mount path for ptocfs and settings enabled to ensure that Fluent Bit can collect from the host. These are then exposed over port 2021. +When deploying Fluent Bit in a container you will need to specify additional settings to ensure that Fluent Bit has access to the process details. +The following `docker` command deploys Fluent Bit with a specific mount path for `procfs` and settings enabled to ensure that Fluent Bit can collect from the host. +These are then exposed over port 2021. ``` docker run -ti -v /proc:/host/proc \ From 8f8968b022f77790b39245be158a17061a376d35 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:10:19 +0900 Subject: [PATCH 06/18] Use 2.2 version of fluent-bit on command line example Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index a38bd3faa..4ab8f337b 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -73,7 +73,7 @@ These are then exposed over port 2021. docker run -ti -v /proc:/host/proc \ -v /sys:/host/sys \ -p 2021:2021 \ - fluent/fluent-bit:2.2.0 \ + fluent/fluent-bit:2.2 \ /fluent-bit/bin/fluent-bit \ -i process_exporter_metrics -p path.procfs=/host/proc \ -o prometheus_exporter -p "add_label=host $HOSTNAME" \ From eca66871781198c558a100604964f54ce3dbbf73 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:11:06 +0900 Subject: [PATCH 07/18] Clearify measings of the sentence for enhancements Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 4ab8f337b..c131f3956 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -82,6 +82,6 @@ docker run -ti -v /proc:/host/proc \ ## Enhancement Requests -Our current plugin refers a sub-set of the available collectors in the 3rd party implementation of Prometheus Process Exporter, if you would like that we prioritize a specific metrics please open a Github issue by using the following template:\ +Development prioritises a subset of the available collectors in the [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter), to request others please open a Github issue by using the following template:\ \ \- [in_process_exporter_metrics](https://github.com/fluent/fluent-bit/issues/new?assignees=\&labels=\&template=feature_request.md\&title=in_process_exporter_metrics:%20add%20ABC%20collector) From 58e01190bf4a4ed9dc5d6988a850b749ace65c2b Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:11:44 +0900 Subject: [PATCH 08/18] Simplify the sentence Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index c131f3956..53f56e553 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -57,7 +57,7 @@ In the following configuration file, the input plugin _process\_exporter\_metric port 2021 ``` -You can test the expose of the metrics by using _curl:_ +You can see the metrics by using _curl:_ ```bash curl http://127.0.0.1:2021/metrics From bb8d385e5971ba152dc8b819f282adcfd9d1ff2e Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:13:31 +0900 Subject: [PATCH 09/18] Remove a needless sysfs mount Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 1 - 1 file changed, 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 53f56e553..9e516e517 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -71,7 +71,6 @@ These are then exposed over port 2021. ``` docker run -ti -v /proc:/host/proc \ - -v /sys:/host/sys \ -p 2021:2021 \ fluent/fluent-bit:2.2 \ /fluent-bit/bin/fluent-bit \ From 0c992c337361cdd9fcde0d2495e9006ea825ef48 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:15:03 +0900 Subject: [PATCH 10/18] Use readonly option on docker commandline Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 9e516e517..f539ea5a8 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -70,7 +70,7 @@ The following `docker` command deploys Fluent Bit with a specific mount path for These are then exposed over port 2021. ``` -docker run -ti -v /proc:/host/proc \ +docker run -ti -v /proc:/host/proc:ro \ -p 2021:2021 \ fluent/fluent-bit:2.2 \ /fluent-bit/bin/fluent-bit \ From 70ad3c2c905d1ce24578873ca5f09eb054e94266 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:23:45 +0900 Subject: [PATCH 11/18] Add more descriptions for procfs and macOS is not supported Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index f539ea5a8..3f03122e5 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -13,7 +13,9 @@ The Process Exporter Metrics plugin implements collecting of the various metrics **Important note:** Metrics collected with Process Exporter Metrics flow through a separate pipeline from logs and current filters do not operate on top of metrics. -This plugin is only supported on Linux based operating systems. +This plugin is only supported on Linux based operating systems due to heavily relying on proc filesystem. + +macOS does not have procfs. Therefore, this plugin won't work for it. ## Configuration From d8e073872e2bb35794ff7847ed2984ce905fabb8 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:26:57 +0900 Subject: [PATCH 12/18] Clarify read-only to be enough Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 3f03122e5..6da29004d 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -23,7 +23,7 @@ macOS does not have procfs. Therefore, this plugin won't work for it. | Key | Description | Default | | ------------------------- | -------------------------------------------------------------------------------------- | --------- | | scrape_interval | The rate at which metrics are collected. | 5 seconds | -| path.procfs | The mount point used to collect process information and metrics | /proc/ | +| path.procfs | The mount point used to collect process information and metrics. Read-only is enough | /proc/ | | process\_include\_pattern | regex to determine which processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | | process\_exclude\_pattern | regex to determine which units are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | From 6cad96ecc88c97a684705ed0b2efea2127e1632f Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Mon, 2 Oct 2023 20:29:00 +0900 Subject: [PATCH 13/18] Fix incorrect descriptions of regex parameters Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 6da29004d..e3fedc491 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -24,8 +24,8 @@ macOS does not have procfs. Therefore, this plugin won't work for it. | ------------------------- | -------------------------------------------------------------------------------------- | --------- | | scrape_interval | The rate at which metrics are collected. | 5 seconds | | path.procfs | The mount point used to collect process information and metrics. Read-only is enough | /proc/ | -| process\_include\_pattern | regex to determine which processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | -| process\_exclude\_pattern | regex to determine which units are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | +| process\_include\_pattern | regex to determine which names of processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | +| process\_exclude\_pattern | regex to determine which names of processes are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | ## Getting Started From 41420d44b7e9048b291b628ef09384ce18f7af70 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Tue, 3 Oct 2023 17:42:15 +0900 Subject: [PATCH 14/18] Clarify the behavior of metrics type of events in pipelines Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index e3fedc491..2591dcf66 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -11,7 +11,7 @@ Fluent Bit 2.2 onwards includes a process exporter plugin that builds off the Pr The Process Exporter Metrics plugin implements collecting of the various metrics available from [the 3rd party implementation of Prometheus Process Exporter](https://github.com/ncabatoff/process-exporter) and these will be expanded over time as needed. -**Important note:** Metrics collected with Process Exporter Metrics flow through a separate pipeline from logs and current filters do not operate on top of metrics. +**Important note:** All metrics including those collected with this plugin flow through a separate pipeline from logs and current filters do not operate on top of metrics. This plugin is only supported on Linux based operating systems due to heavily relying on proc filesystem. From 005bc41266864dbfb29d8c7a179e1179aa5a1398 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Wed, 25 Oct 2023 17:03:08 +0900 Subject: [PATCH 15/18] in_process_exporter_metrics: Add descriptions for metrics parameter and their metrics Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 17 ++++++++++++++++- 1 file changed, 16 insertions(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index 2591dcf66..c20d346a0 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -22,10 +22,25 @@ macOS does not have procfs. Therefore, this plugin won't work for it. | Key | Description | Default | | ------------------------- | -------------------------------------------------------------------------------------- | --------- | -| scrape_interval | The rate at which metrics are collected. | 5 seconds | +| scrape\_interval | The rate at which metrics are collected. | 5 seconds | | path.procfs | The mount point used to collect process information and metrics. Read-only is enough | /proc/ | | process\_include\_pattern | regex to determine which names of processes are included in the metrics produced by this plugin | It is applied for all process unless explicitly set. Default is `.+`. | | process\_exclude\_pattern | regex to determine which names of processes are excluded in the metrics produced by this plugin | It is not applied unless explicitly set. Default is `NULL`. | +| metrics | To specify which process level of metrics are collected from the host operating system. These metrics depend on `/proc` fs. The actual values of metrics will be read from `/proc` when needed. cpu, io, memory, state, context\_switches, fd, start\_time, thread\_wchan, thread depend on procfs. | `cpu,io,memory,state,context_switches,fd,start_time,thread_wchan,thread` | + +## Metrics Available + +| Name | Description | +| ----------------- | -------------------------------------------------- | +| cpu | Exposes CPU statistics from `/proc`. | +| io | Exposes I/O statistics from `/proc`. | +| memory | Exposes memory statistics from `/proc`. | +| state | Exposes process state statistics from `/proc`. | +| context\_switches | Exposes context\_switches statistics from `/proc`. | +| fd | Exposes file descriptors statistics from `/proc`. | +| start\_time | Exposes start\_time statistics from `/proc`. | +| thread\_wchan | Exposes thread\_wchan from `/proc`. | +| thread | Exposes thread statistics from `/proc`. | ## Getting Started From dba5f869b4dd64d76493b270de10cb1b8b718930 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Wed, 1 Nov 2023 17:15:34 +0900 Subject: [PATCH 16/18] Clarify the sentence meaning Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index c20d346a0..ef57faa16 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -13,7 +13,7 @@ The Process Exporter Metrics plugin implements collecting of the various metrics **Important note:** All metrics including those collected with this plugin flow through a separate pipeline from logs and current filters do not operate on top of metrics. -This plugin is only supported on Linux based operating systems due to heavily relying on proc filesystem. +This plugin is only supported on Linux based operating systems as it uses the `proc` filesystem to access the relevant metrics. macOS does not have procfs. Therefore, this plugin won't work for it. From a88027ab1d5e86cfa70c6b942ebcd142de6c224f Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Wed, 1 Nov 2023 17:18:05 +0900 Subject: [PATCH 17/18] Explain why this plugin won't work on macOS clearly Co-authored-by: Pat Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index ef57faa16..d99ed6987 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -15,7 +15,7 @@ The Process Exporter Metrics plugin implements collecting of the various metrics This plugin is only supported on Linux based operating systems as it uses the `proc` filesystem to access the relevant metrics. -macOS does not have procfs. Therefore, this plugin won't work for it. +macOS does not have the `proc` filesystem so this plugin will not work for it. ## Configuration From 28fc64bf5bc1dea60e2d65e8a14f32da4d8b85a8 Mon Sep 17 00:00:00 2001 From: Hiroshi Hatake Date: Wed, 1 Nov 2023 17:19:24 +0900 Subject: [PATCH 18/18] Remove environment variable related arugment for simplicity Signed-off-by: Hiroshi Hatake --- pipeline/inputs/process-exporter-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/inputs/process-exporter-metrics.md b/pipeline/inputs/process-exporter-metrics.md index d99ed6987..5c933bce2 100644 --- a/pipeline/inputs/process-exporter-metrics.md +++ b/pipeline/inputs/process-exporter-metrics.md @@ -92,7 +92,7 @@ docker run -ti -v /proc:/host/proc:ro \ fluent/fluent-bit:2.2 \ /fluent-bit/bin/fluent-bit \ -i process_exporter_metrics -p path.procfs=/host/proc \ - -o prometheus_exporter -p "add_label=host $HOSTNAME" \ + -o prometheus_exporter \ -f 1 ```