pip install -r requirements.txt
-
cd /config
-
docker-compose up -d --build
Send messages to Qualichain Mediator using this command: python producer.py
QualiChain Mediator also uses Dobie to extract skills from crawled job posts and save these skills to extracted_skill
Table in Qualichain Table
In order to run this pipeline you should run:
- Locally:
python run_skill_extraction.py
- From Docker Command
docker exec -it qmediator_consumer python run_skill_extraction.py
This project is licensed under MIT