Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle WebMeUp bots (BLEXBot) #158

Merged
merged 2 commits into from
Sep 19, 2024
Merged

Handle WebMeUp bots (BLEXBot) #158

merged 2 commits into from
Sep 19, 2024

Conversation

gabrieljablonski
Copy link
Contributor

BLEXBot is a crawler that is responsible for a good chunk of bot requests on a website I manage (>200k requests over multiple IPs), so handling it with legitbot seems like a good idea.

The bot specs are available here: http://webmeup-crawler.com/

Let me know if any changes are needed.

@gabrieljablonski
Copy link
Contributor Author

gabrieljablonski commented Sep 19, 2024

Btw, sorry for spamming PRs.

I'm going over some IP addresses that are littering user tracking in my project, so I'm submitting for each of the top crawler bots that aren't already covered by legitbot.

This should be the last one for now. Thanks!

@alaz
Copy link
Owner

alaz commented Sep 19, 2024

Btw, sorry for spamming PRs.

No, no, your PRs are perfect. I do prefer to have separate commits for bots.

alaz
alaz previously approved these changes Sep 19, 2024
Copy link
Owner

@alaz alaz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@codecov-commenter
Copy link

codecov-commenter commented Sep 19, 2024

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 98.77%. Comparing base (13d53f6) to head (e5ad758).
Report is 1 commits behind head on master.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #158      +/-   ##
==========================================
+ Coverage   98.75%   98.77%   +0.02%     
==========================================
  Files          25       26       +1     
  Lines         240      245       +5     
==========================================
+ Hits          237      242       +5     
  Misses          3        3              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@alaz
Copy link
Owner

alaz commented Sep 19, 2024

This should be the last one for now

I am a bit tied up at the moment, but will make a release this weekend latest.

@gabrieljablonski
Copy link
Contributor Author

I am a bit tied up at the moment, but will make a release this weekend latest.

No worries. Thanks for taking a look so quickly!

@alaz alaz merged commit 2318e26 into alaz:master Sep 19, 2024
6 checks passed
@gabrieljablonski gabrieljablonski deleted the blexbot branch September 19, 2024 18:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants