Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for remote logging in feelpp #42

Open
prudhomm opened this issue Oct 1, 2018 · 0 comments
Open

Add support for remote logging in feelpp #42

prudhomm opened this issue Oct 1, 2018 · 0 comments
Assignees
Labels
enhancement madf:feelpp related to Feel++ mathematical framework

Comments

@prudhomm
Copy link
Contributor

prudhomm commented Oct 1, 2018

The application logger is already integrated and deployed in http://portal-dev.mso4sc.eu. The experiments tool at portal-dev now displays 2 buttons, 'Execution logs' and 'Application logs'. If you click in application logs now you can see your experiments logs in real time.

To integrate your application with the logger you have to introduce minor modification to your current blueprints.

  • Add a log filter YAML file
  • Launch the remotelogger to track your application logs

We have created a blueprint example to show how it works. You can find it in the following link:

https://github.com/MSO4SC/resources/tree/master/blueprint-examples/single-singularity-logger

Note that a new job_option 'pre' has been added. This is a list of shell commands that run before the 'command' job_option in the sbatch script.

To launch the logger within your simulation, you have to add exactly the following to your blueprint:


pre:
- 'singularity run -B /mnt remotelogger-cli.simg -f logfilter.yaml -sh logging.mso4sc.eu -u mso4sc -p remotelogger -rk $CFY_EXECUTION_ID -q $CFY_JOB_NAME &'

The same line is in the provided blueprint example:
https://github.com/MSO4SC/resources/blob/master/blueprint-examples/single-singularity-logger/blueprint.yaml#L71

You have to be aware that the 'logfilter.yaml' is the glue between your application and the logger. This is a YAML file in which you must specify the path to the file you want to track (the application log file).

In the example we create the 'logfilter.yaml' file during the bootstrap process. You can see how we are doing this in the following link:
https://github.com/MSO4SC/resources/blob/master/blueprint-examples/single-singularity-logger/scripts/bootstrap.sh#L8

Additionally you can filter your log lines using regular expressions. You can get more info about how to use the application logger command line interface in the following link:

https://github.com/MSO4SC/remotelogger-cli

@prudhomm prudhomm added enhancement madf:feelpp related to Feel++ mathematical framework labels Oct 1, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement madf:feelpp related to Feel++ mathematical framework
Projects
None yet
Development

No branches or pull requests

2 participants