Skip to content

Commit

Permalink
README how to dump-date
Browse files Browse the repository at this point in the history
  • Loading branch information
Vehnem committed Mar 30, 2020
1 parent ccde369 commit efedf6d
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 3 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,12 @@ To run the other extractions, use either of
./marvin_extraction_run.sh wikidata
```

To specify a different dump-date
```
# Set it in extractionConfiguration/{download|extraction}.*.properties
dump-date=20200301
```
If specified dump-date is newer as current local dumps, then adding it to `extractionConfiguration/download.*.properties` is enough
## Cronjobs

Below is a list of cronjobs we use on the different servers:
Expand Down
2 changes: 1 addition & 1 deletion extractionConfiguration/download.generic.properties
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,4 @@ retry-max=5
retry-millis=10000

#for specific dump dates (e.g. 20170101) if empty: the most recent dump-date is used
dump-date=20200201
dump-date=
2 changes: 1 addition & 1 deletion extractionConfiguration/download.mappings.properties
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@ retry-max=5
retry-millis=10000

#for specific dump dates (e.g. 20170101) if empty: the most recent dump-date is used
dump-date=20200201
dump-date=
2 changes: 1 addition & 1 deletion extractionConfiguration/download.text.properties
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,4 @@ retry-max=5
retry-millis=10000

#for specific dump dates (e.g. 20170101) if empty: the most recent dump-date is used
dump-date=20200201
dump-date=

0 comments on commit efedf6d

Please sign in to comment.