Replies: 1 comment
-
|
Best way seems to be to implement your own crawler queue following the provided interface (e.g. using Redis) so that you can easily store/restore the state of the crawler queue. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there any good/easy way to pause a crawl and restart from that point later in time?
Beta Was this translation helpful? Give feedback.
All reactions