Skip to content

Commit

Permalink
Started working on issue #1
Browse files Browse the repository at this point in the history
  • Loading branch information
kbruegge committed Jan 15, 2016
1 parent 9953b73 commit d620d9c
Show file tree
Hide file tree
Showing 2 changed files with 17 additions and 2 deletions.
10 changes: 8 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ These scripts require a few dependencies. More documentation to follow.

- Java 1.8
- Python 3.4+


## erna.py
The erna.py script allows you to find datafiles and the optimal (closest) drs-files for a chosen period of time.
Expand All @@ -17,4 +17,10 @@ The script creates a json-file (*earliest_run_latest_run_source_name.json*), whi

## execute.py

The execute.py script calls the *erna* module and creates jobs for submission to a grid. This needs to be run from a server which can submit jobs to the queueing system.
The execute.py script calls the *erna* module and creates jobs for submission to a grid. This needs to be run from a server which can submit jobs to the queueing
system. You need to provide the path to the fact-tools.jar file and the xml you want to use.
An example xml can be found in the repository. It shows how to read fact data files and how to output the result. the resulting json files are automatically collected and merged into one big outputfile.

You cann call execute like this:

python erna/execute.py 20140101 20140130 /fhgfs/groups/app/fact/raw/ fact-tools-0.9.9 example.xml big_output_file.h5 --engine=PBS --vmem=10000 --num_jobs=60 --queue=one_day --source=Crab
9 changes: 9 additions & 0 deletions example.xml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
<container>
<stream id="random" class="stream.generator.RandomStream" limit="120"/>

<process id="1" input="random">
<PrintData />
<Delay time="500ms" />
<fact.io.JSONWriter keys="att1" url="${output}" writeListOfItems="True"/>
</process>
</container>

0 comments on commit d620d9c

Please sign in to comment.