-
Hi, Here are the 2 commands which specify the path and the file name. Seems that they both decide where the collected metrics would land up on file system
aforementioned configuration would put data from all configured producers in a single file at /home/user1/ldmscon2021/basic/exercises/ldms/data/memory_metrics/meminfo here are the queries - b) Can the similar approach be done for the file name ? i.e. schema=meminfo_%Y%m%d so that c) Also, Is it possible to maintain separate logs for each hosts?. Example - |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
@puneet336 Thank you for your questions. re a) You will want to examine the rollover options in the Plugin_store_csv man page installed with ldms. With rollover enabled and particularly the rename-on-close options you have a lot of flexibility in output renaming. re b) I cannot think why you would want schema name (which in most cases is intended to map to a fixed downstream database schema) to change with the date. If you really want that, you'll need to stop ldmsd at midnight, regenerate the configuration file with the new date substituted in the configuration values that include date strings, and restart ldmsd. This could also be orchestrated via the python interface (ldmsd_controller) without restarting (just stop/reconfigure/start the plugins on all daemons). re c) None of our storage plugins presently support writing a data file per producerName (host) in the metric sets. This would not be a difficult feature to create a custom store for, but it would scale poorly to systems with thousands of nodes. We have in the past had experimental plugins that wrote a data file per parallel job identifier (e.g. slurm_jobid), so I have evidence that the difficulty is not high. |
Beta Was this translation helpful? Give feedback.
@puneet336 Thank you for your questions.
re a) You will want to examine the rollover options in the Plugin_store_csv man page installed with ldms. With rollover enabled and particularly the rename-on-close options you have a lot of flexibility in output renaming.
re b) I cannot think why you would want schema name (which in most cases is intended to map to a fixed downstream database schema) to change with the date. If you really want that, you'll need to stop ldmsd at midnight, regenerate the configuration file with the new date substituted in the configuration values that include date strings, and restart ldmsd. This could also be orchestrated via the python interface (ldmsd_controller)…