New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

一个疑问 #2

Open

lb-chc opened this issue Nov 7, 2021 · 1 comment

lb-chc commented Nov 7, 2021

你好，我在网站看到“目前负载: 1763.8%”，这意味着性能缺口还是过载？
这种分布式采集器（爬虫？）需要中心化调度嘛？

Member

simon300000 commented Nov 8, 2021

是的需要中心化调度

我订的是最短5分钟爬一轮，但是有时一轮需要超过一小时负载就会很高

比如1000%就是花了50分钟

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment