Skip to content

Commit

Permalink
update: README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Vehnem committed Nov 21, 2019
1 parent 88874aa commit bc45b93
Showing 1 changed file with 21 additions and 7 deletions.
28 changes: 21 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,8 @@ To run the other extractions, use either of
Below is a list of cronjobs we use on the different servers:

```
TODO
# extraction and release for wikidata
0 0 7 * * bin/bash -c 'cd /data/marvin-config/marvin-extraction-run.sh wikidata && ./ && ./databus-release.sh'
```

##
Expand All @@ -60,16 +61,29 @@ This contribution by TIB to DBpedia & its community is a great push towards ince

# Workflow Description

##
## Update and Run the extraction

## Downloading the wikimedia dumps
TODO
To run a generic, mappings, or wikidata extraction the following script will do the rest.
Its default behavior is to create all folder relative to its execution directory.
If you want to adapt some paths you can edit them inside `fucntions.sh`.

## Update and Run the extraction
TODO
```bash
./marvin-extraction-run.sh
```

## Deploy MARVIN on Databus
TODO


The `databus-release.sh` script contains the workflow how the extracted files are renamed and copied into a databus-maven-plugin readable structure (.e.g artfact and content variants).
Further, which parameters are used to deploy the MARVIN relases on the databus.

```bash
./databus-release.sh
```

> **NOTE:** This scrtipt sill uses absolute paths and dependens on the private key of the publishers webid
>
> **TODO:** Refactor `./databus-release.sh`
## [Manual] Run Databus-Derive (clone and parse)
On the respective server there is a user marvin-fetch, that has access to `/data/derive` containing the pom.xml of https://github.com/dbpedia/databus-maven-plugin/tree/master/dbpedia
Expand Down

0 comments on commit bc45b93

Please sign in to comment.