Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not working with MQL5 docs #3

Open
biohazardxxx opened this issue Dec 12, 2024 · 2 comments
Open

Not working with MQL5 docs #3

biohazardxxx opened this issue Dec 12, 2024 · 2 comments

Comments

@biohazardxxx
Copy link

Hi, with this page https://www.mql5.com/en/docs
I can not get it to work with neither of the both methods for crawling. I have set depth to 3.
Can you give it a try please?

Thanks for the extension!

@3choff
Copy link
Owner

3choff commented Dec 12, 2024

Hi! Thank you for reporting this issue.
I've just released version 1.6.0 which specifically improves the browser-based crawling method. I tested it with the MQL5 documentation, and it now successfully crawls the content.
Let me know if you are still experiencing any issues after updating.

@biohazardxxx
Copy link
Author

Just gave it a try and I can confirm it worked with the API method better! However it does not follow all links and I am not able to get the full documentation crawled.
Just a side question Is there a chance to let it create several files for each page instead of one huge md file?
Also in this MQL5docs case, the header and foter at the page are always repeating not sure if that can be fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants