Message-queue-mapper: automatically parse YARRRML

[SvenLieber]

Currently the mapping relies on RML files, however, in this repo we provide RML files in the human-friendly YARRRML syntax. This means that right now whenever a mapping changes there is a manual step of creating RML from YARRRML and updating the RML file used by the message-queue-mapper.

This manual step could be avoided if the transformation from YARRRML to RML happens automatically.

On the receiving end,

• lib/generators/warc-generator.js needs to be extended with an if( msg['type']=== 'yarrrml_mapping')
• the connected lib/targets/rmlmapper.js needs to be extended with an if( msg['type] ...) to check for both yarrrml and rml
• the connected lib/targets/rmlmapper.js should use the yarrrml-parser on the input YARRRML file to create a RML file usable by the RMLMapper if the type is yarrrml_mapping.

On the sending end

• lib/targets/rabbitmq.js should emit yarrrml_mapping as type
• the key mappingFileLookup of the config config-rabbitmq.json from lib/targets/rabbitmq.js should use yarrrml_files