how to use helper scripts

[jonodd]

Apologies for the novice question but I'm unsure how to add a helper script, specifically the import_4plebs script, when running through docker. Thanks!

[sal-uva]

Hi @jonodd , the import_4plebs.py helper script is a separate Python script that you can e.g. run through your command line terminal (i.e. with python3 import_4plebs.py followed by the input parameters).

Hope that helps!

[dale-wahl]

Docker has a few ways to use the command line, but one thing you will need to do is transfer the files you are importing into the container environment. If you use your command line, you could do something like...
Transfer file:
docker cp /path/to/your_import_file 4cat_backend:/
Run the script:
docker exec 4cat_backend python /usr/src/app/helper-scripts/import_4plebs.py -i /your_import_file (add other parameters here; --help should print them out)

[jonodd]

Got it! thanks for the help

[jonodd]

quick follow up: I have imported a 4plebs file using the script and followed the wiki for enabling sphinx. However, when I attempt to create a dataset all my searches return no matches. Any ideas what I'm missing? Thanks again

[dale-wahl]

Not really based on that information. Each dataset creates a log so perhaps there is information there if something failed. The backend and frontend have logs as well that may give you more information (in your case visible in the Docker UI by clicking on the containers). You also might check that the 4plebs data was properly imported into the database (docker exec -it 4cat_db psql fourcat fourcat to connect to it assuming you did not adjust database settings). Look for the 4chan related tables (e.g., posts_4chan) and check that your data was imported.

[jonodd]

Thanks for the help